Understanding the Limitations of Variational Mutual Information Estimators

14 October 2019

Papers citing "Understanding the Limitations of Variational Mutual Information Estimators"

50 / 133 papers shown

Title
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 28 9 0 27 Dec 2022
Generalized Balancing Weights via Deep Neural Networks Yoshiaki Kitazawa BDL CML 16 1 0 14 Nov 2022
A robust estimator of mutual information for deep learning interpretability Davide Piras H. Peiris A. Pontzen Luisa Lucie-Smith Ningyuan Guo Brian D. Nord SSL DRL 34 15 0 31 Oct 2022
Function-space regularized Rényi divergences Jeremiah Birrell Yannis Pantazis P. Dupuis Markos A. Katsoulakis Luc Rey-Bellet 47 7 0 10 Oct 2022
Decomposed Mutual Information Optimization for Generalized Context in Meta-Reinforcement Learning Yao Mu Yuzheng Zhuang Fei Ni Bin Wang Jianyu Chen Jianye Hao Ping Luo 23 2 0 09 Oct 2022
OOD-Probe: A Neural Interpretation of Out-of-Domain Generalization Zining Zhu Soroosh Shahtalebi Frank Rudzicz 30 4 0 25 Aug 2022
RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence Kyungmin Lee Jinwoo Shin SSL DRL 36 10 0 12 Aug 2022
Self-Supervision Can Be a Good Few-Shot Learner Yuning Lu Liangjiang Wen Jianzhuang Liu Yajing Liu Xinmei Tian SSL 30 37 0 19 Jul 2022
InfoAT: Improving Adversarial Training Using the Information Bottleneck Principle Mengting Xu Tao Zhang Zhongnian Li Daoqiang Zhang AAML 48 17 0 23 Jun 2022
k-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension Ziv Goldfeld Kristjan Greenewald Theshani Nuradha Galen Reeves 36 0 0 17 Jun 2022
Discrete Contrastive Diffusion for Cross-Modal Music and Image Generation Ye Zhu Yuehua Wu Kyle Olszewski Jian Ren Sergey Tulyakov Yan Yan DiffM 30 47 0 15 Jun 2022
COIN: Co-Cluster Infomax for Bipartite Graphs Baoyu Jing Yuchen Yan Yada Zhu Hanghang Tong 35 21 0 31 May 2022
MIND: Maximum Mutual Information Based Neural Decoder Andrea M. Tonello N. A. Letizia 19 7 0 14 May 2022
Learning Disentangled Textual Representations via Statistical Measures of Similarity Pierre Colombo Guillaume Staerman Nathan Noiry Pablo Piantanida FaML DRL 38 22 0 07 May 2022
Statistical Model Criticism of Variational Auto-Encoders Claartje Barkhof Wilker Aziz DRL 27 3 0 06 Apr 2022
Chaos is a Ladder: A New Theoretical Understanding of Contrastive Learning via Augmentation Overlap Yifei Wang Qi Zhang Yisen Wang Jiansheng Yang Zhouchen Lin 32 98 0 25 Mar 2022
A Perspective on Neural Capacity Estimation: Viability and Reliability Farhad Mirkarimi Stefano Rini Nariman Farsad 27 1 0 22 Mar 2022
Rethinking Minimal Sufficient Representation in Contrastive Learning Haoqing Wang Xun Guo Zhiwei Deng Yan Lu SSL 19 73 0 14 Mar 2022
Policy-Based Bayesian Experimental Design for Non-Differentiable Implicit Models Vincent Lim Ellen R. Novoseller Jeffrey Ichnowski Huang Huang Ken Goldberg OffRL 33 10 0 08 Mar 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 25 21 0 14 Feb 2022
Fundamental Limits for Sensor-Based Robot Control Anirudha Majumdar Zhi-Yong Mei Vincent Pacelli 27 1 0 31 Jan 2022
Representation Learning for Conversational Data using Discourse Mutual Information Maximization Bishal Santra Sumegh Roychowdhury Aishik Mandal Vasu Gurram Atharva Naik Manish Gupta Pawan Goyal SSL 27 4 0 04 Dec 2021
Learning Conditional Invariance through Cycle Consistency M. Samarin V. Nesterov Mario Wieser Aleksander Wieczorek S. Parbhoo Volker Roth 41 3 0 25 Nov 2021
Density Ratio Estimation via Infinitesimal Classification Kristy Choi Chenlin Meng Yang Song Stefano Ermon 14 38 0 22 Nov 2021
Neural Capacity Estimators: How Reliable Are They? Farhad Mirkarimi Stefano Rini Nariman Farsad 27 9 0 14 Nov 2021
Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods Desi R. Ivanova Adam Foster Steven Kleinegesse Michael U. Gutmann Tom Rainforth OffRL 21 46 0 03 Nov 2021
Recent Advancements in Self-Supervised Paradigms for Visual Feature Representation Mrinal Anand Aditya Garg SSL 34 2 0 03 Nov 2021
Quantifying the Task-Specific Information in Text-Based Classifications Zining Zhu Aparna Balagopalan Marzyeh Ghassemi Frank Rudzicz 42 4 0 17 Oct 2021
The Information Geometry of Unsupervised Reinforcement Learning Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine SSL OffRL 61 31 0 06 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 46 19 0 06 Oct 2021
Reliable Estimation of KL Divergence using a Discriminator in Reproducing Kernel Hilbert Space S. Ghimire A. Masoomi Jennifer Dy 31 7 0 29 Sep 2021
Neural Dependency Coding inspired Multimodal Fusion Shiv Shankar 39 2 0 28 Sep 2021
Improving Multimodal fusion via Mutual Dependency Maximisation Pierre Colombo E. Chapuis Matthieu Labeau Chloé Clavel 15 30 0 31 Aug 2021
Clustering by Maximizing Mutual Information Across Views Kien Do T. Tran Svetha Venkatesh VLM SSL 16 37 0 24 Jul 2021
AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense Duhun Hwang Eunjung Lee Wonjong Rhee AAML 167 15 0 14 Jul 2021
Discriminative Mutual Information Estimators for Channel Capacity Learning N. A. Letizia Andrea M. Tonello 16 5 0 07 Jul 2021
Featurized Density Ratio Estimation Kristy Choi Madeline Liao Stefano Ermon TPM 22 22 0 05 Jul 2021
Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE Junya Chen Zhe Gan Xuan Li Qing Guo Liqun Chen ... Belinda Zeng Wenlian Lu Fan Li Lawrence Carin Chenyang Tao 43 28 0 02 Jul 2021
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization Qing Guo Junya Chen Dong Wang Yuewei Yang Xinwei Deng Lawrence Carin Fan Li Jing-Zheng Huang Chenyang Tao 29 19 0 02 Jul 2021
Leveraging Hidden Structure in Self-Supervised Learning Emanuele Sansone SSL 28 0 0 30 Jun 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 24 30 0 25 Jun 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 26 39 0 14 Jun 2021
Information-Theoretic Analysis of Epistemic Uncertainty in Bayesian Meta-learning Sharu Theresa Jose Sangwook Park Osvaldo Simeone PER UD UQCV 27 17 0 01 Jun 2021
Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds Steven Kleinegesse Michael U. Gutmann FedML 38 25 0 10 May 2021
Self-supervised Representation Learning with Relative Predictive Coding Yao-Hung Hubert Tsai Martin Q. Ma Muqiao Yang Han Zhao Louis-Philippe Morency Ruslan Salakhutdinov SSL AI4TS 38 36 0 21 Mar 2021
A Hybrid Gradient Method to Designing Bayesian Experiments for Implicit Models Jiaxin Zhang Sirui Bi Guannan Zhang 11 0 0 14 Mar 2021
A Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models Jiaxin Zhang Sirui Bi Guannan Zhang 24 9 0 14 Mar 2021
Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularization Jizong Peng M. Pedersoli Christian Desrosiers SSL 27 21 0 08 Mar 2021
Multimodal Representation Learning via Maximization of Local Mutual Information Ruizhi Liao Daniel Moyer Miriam Cha Keegan Quigley Seth Berkowitz Steven Horng Polina Golland W. Wells SSL 21 41 0 08 Mar 2021
MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approach Yves-Laurent Kom Samo 13 8 0 25 Feb 2021