On Variational Bounds of Mutual Information

16 May 2019

Papers citing "On Variational Bounds of Mutual Information"

50 / 172 papers shown

Title
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 13 68 0 12 Jan 2022
Optimal Representations for Covariate Shift Yangjun Ruan Yann Dubois Chris J. Maddison OOD 28 68 0 31 Dec 2021
Disentanglement and Generalization Under Correlation Shifts Christina M. Funke Paul Vicol Kuan-Chieh Jackson Wang Matthias Kümmerer R. Zemel Matthias Bethge OOD 39 7 0 29 Dec 2021
How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness? Xinhsuai Dong Anh Tuan Luu Min-Bin Lin Shuicheng Yan Hanwang Zhang SILM AAML 20 55 0 22 Dec 2021
Projected Sliced Wasserstein Autoencoder-based Hyperspectral Images Anomaly Detection Yurong Chen Hui Zhang Yaonan Wang Q. M. J. Wu Yimin Yang 22 0 0 20 Dec 2021
Unsupervised Representation Learning via Neural Activation Coding Yookoon Park Sangho Lee Gunhee Kim David M. Blei SSL 23 8 0 07 Dec 2021
Towards Empirical Sandwich Bounds on the Rate-Distortion Function Yibo Yang Stephan Mandt 30 24 0 23 Nov 2021
Neural Capacity Estimators: How Reliable Are They? Farhad Mirkarimi Stefano Rini Nariman Farsad 27 9 0 14 Nov 2021
Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods Desi R. Ivanova Adam Foster Steven Kleinegesse Michael U. Gutmann Tom Rainforth OffRL 21 46 0 03 Nov 2021
Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergence Tianshi Cao Alex Bie Arash Vahdat Sanja Fidler Karsten Kreis SyDa DiffM 19 71 0 01 Nov 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp G. Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 207 102 0 21 Oct 2021
Injecting Text and Cross-lingual Supervision in Few-shot Learning from Self-Supervised Models Matthew Wiesner Desh Raj Sanjeev Khudanpur 59 6 0 10 Oct 2021
Temperature as Uncertainty in Contrastive Learning Oliver Zhang Mike Wu Jasmine Bayrooti Noah D. Goodman UQCV 22 30 0 08 Oct 2021
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 126 302 0 07 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 41 19 0 06 Oct 2021
Stochastic Contrastive Learning Jason Ramapuram Dan Busbridge Xavier Suau Russ Webb BDL SSL 44 3 0 01 Oct 2021
Robust Control Under Uncertainty via Bounded Rationality and Differential Privacy Vincent Pacelli Anirudha Majumdar 37 9 0 17 Sep 2021
X-GOAL: Multiplex Heterogeneous Graph Prototypical Contrastive Learning Baoyu Jing Shengyu Feng Yuejia Xiang Xi Chen Yu Chen Hanghang Tong 41 27 0 08 Sep 2021
Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis Wei Han Hui Chen Soujanya Poria 37 316 0 01 Sep 2021
Layer-wise Model Pruning based on Mutual Information Chun Fan Jiwei Li Xiang Ao Fei Wu Yuxian Meng Xiaofei Sun 46 19 0 28 Aug 2021
Revealing the Distributional Vulnerability of Discriminators by Implicit Generators Zhilin Zhao LongBing Cao Kun-Yu Lin 29 11 0 23 Aug 2021
M2IOSR: Maximal Mutual Information Open Set Recognition Xin Sun Henghui Ding Chi Zhang Guosheng Lin K. Ling 23 17 0 05 Aug 2021
Clustering by Maximizing Mutual Information Across Views Kien Do T. Tran Svetha Venkatesh VLM SSL 11 37 0 24 Jul 2021
Towards quantifying information flows: relative entropy in deep neural networks and the renormalization group J. Erdmenger Kevin T. Grosvenor R. Jefferson 54 17 0 14 Jul 2021
Featurized Density Ratio Estimation Kristy Choi Madeline Liao Stefano Ermon TPM 22 22 0 05 Jul 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 24 29 0 25 Jun 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 26 38 0 14 Jun 2021
Temporal Predictive Coding For Model-Based Planning In Latent Space Tung D. Nguyen Rui Shu Tu Pham Hung Bui Stefano Ermon OffRL 17 56 0 14 Jun 2021
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping Runshi Liu Pengda Qin Yuhong Li Weigao Wen Dong Li Kefeng Deng Qiang Wu AI4TS 15 0 0 13 Jun 2021
MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graph Mengying Sun Jing Xing Huijun Wang Bin Chen Jiayu Zhou 16 115 0 05 Jun 2021
Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs Mohammad Malekzadeh Anastasia Borovykh Deniz Gündüz MIACV 19 42 0 25 May 2021
TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learning Lu Wang Xiaofu Chang Shuang Li Yunfei Chu Hui Li Wei Zhang Xiaofeng He Le Song Jingren Zhou Hongxia Yang 24 51 0 17 May 2021
Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds Steven Kleinegesse Michael U. Gutmann FedML 33 25 0 10 May 2021
Deep Adaptive Design: Amortizing Sequential Bayesian Experimental Design Adam Foster Desi R. Ivanova Ilyas Malik Tom Rainforth 28 78 0 03 Mar 2021
Sequential- and Parallel- Constrained Max-value Entropy Search via Information Lower Bound Shion Takeno T. Tamura Kazuki Shitara Masayuki Karasuyama 37 17 0 19 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 22 43 0 13 Feb 2021
Neural Joint Entropy Estimation Yuval Shalev Amichai Painsky I. Ben-Gal 26 8 0 21 Dec 2020
Mutual Information Based Method for Unsupervised Disentanglement of Video Representation Aditya Sreekar Ujjwal Tiwari A. Namboodiri DRL 26 4 0 17 Nov 2020
Towards Learning Controllable Representations of Physical Systems Kevin Haninger R. Vicente-Garcia J. Krüger 31 1 0 16 Nov 2020
Unsupervised Video Representation Learning by Bidirectional Feature Prediction Nadine Behrmann Juergen Gall M. Noroozi SSL MDE 32 29 0 11 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 36 173 0 05 Nov 2020
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 34 1,073 0 27 Oct 2020
Unsupervised Learning of Disentangled Speech Content and Style Representation Andros Tjandra Ruoming Pang Yu Zhang Shigeki Karita BDL DRL 23 15 0 24 Oct 2020
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 250 114 0 20 Oct 2020
A Neural Network MCMC sampler that maximizes Proposal Entropy Zengyi Li Yubei Chen Friedrich T. Sommer 25 14 0 07 Oct 2020
Usable Information and Evolution of Optimal Representations During Training Michael Kleinman Alessandro Achille Daksh Idnani J. Kao 29 13 0 06 Oct 2020
EqCo: Equivalent Rules for Self-supervised Contrastive Learning Benjin Zhu Junqiang Huang Zeming Li Xiangyu Zhang Jian Sun SSL 22 13 0 05 Oct 2020
Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning Haotian Fu Hongyao Tang Jianye Hao Chong Chen Xidong Feng Dong Li Wulong Liu OffRL 35 51 0 29 Sep 2020
Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination Xudong Wang Ziwei Liu Stella X. Yu SSL 20 76 0 09 Aug 2020
Representation Learning with Video Deep InfoMax R. Devon Hjelm Philip Bachman SSL MDE 26 28 0 27 Jul 2020