MINE: Mutual Information Neural Estimation

12 January 2018

Mohamed Ishmael Belghazi

Aaron Courville

Papers citing "MINE: Mutual Information Neural Estimation"

50 / 632 papers shown

Title
Neural Approximate Sufficient Statistics for Implicit Models Yanzhi Chen Dinghuai Zhang Michael U. Gutmann Aaron Courville Zhanxing Zhu 30 79 0 20 Oct 2020
Layer-wise Characterization of Latent Information Leakage in Federated Learning Fan Mo Anastasia Borovykh Mohammad Malekzadeh Hamed Haddadi Soteris Demetriou FedML 12 31 0 17 Oct 2020
Distributed Representations of Entities in Open-World Knowledge Graphs Lingbing Guo Zhuo Chen Jiaoyan Chen Weiqing Wang Zequn Sun Zhongpo Bo Yin Fang Chenghao Liu Huajun Chen Wei Hu GNN 38 11 0 16 Oct 2020
Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustness Long Zhao Ting Liu Xi Peng Dimitris N. Metaxas OOD AAML 24 165 0 15 Oct 2020
An Empowerment-based Solution to Robotic Manipulation Tasks with Sparse Rewards Siyu Dai Wenyuan Xu Andreas G. Hofmann B. Williams 17 8 0 15 Oct 2020
Graph Information Bottleneck for Subgraph Recognition Junchi Yu Tingyang Xu Yu Rong Yatao Bian Junzhou Huang Ran He 22 153 0 12 Oct 2020
Causal learning with sufficient statistics: an information bottleneck approach D. Chicharro M. Besserve S. Panzeri CML 15 5 0 12 Oct 2020
InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective Wei Ping Shuohang Wang Yu Cheng Zhe Gan R. Jia Bo-wen Li Jingjing Liu AAML 46 113 0 05 Oct 2020
Graph Cross Networks with Vertex Infomax Pooling Maosen Li Siheng Chen Ya Zhang Ivor W. Tsang 19 58 0 05 Oct 2020
Capacity-Approaching Autoencoders for Communications N. A. Letizia Andrea M. Tonello 12 6 0 11 Sep 2020
Beyond Localized Graph Neural Networks: An Attributed Motif Regularization Framework Aravind Sankar Junting Wang A. Krishnan Hari Sundaram 27 21 0 11 Sep 2020
Large-scale nonlinear Granger causality: A data-driven, multivariate approach to recovering directed networks from short time-series data A. Wismüller Adora M. DSouza A. Abidin AI4TS 6 62 0 10 Sep 2020
Mutual Information for Explainable Deep Learning of Multiscale Systems S. Taverniers E. Hall M. Katsoulakis D. Tartakovsky 16 15 0 07 Sep 2020
Learning Unbiased Representations via Rényi Minimization Vincent Grari Oualid El Hajouji Sylvain Lamprier Marcin Detyniecki FaML 23 20 0 07 Sep 2020
Are Deep Neural Architectures Losing Information? Invertibility Is Indispensable Yang Liu Zhenyue Qin Saeed Anwar Sabrina Caldwell Tom Gedeon 6 18 0 07 Sep 2020
Active Contrastive Learning of Audio-Visual Video Representations Shuang Ma Zhaoyang Zeng Daniel J. McDuff Yale Song VLM SSL 24 8 0 31 Aug 2020
DANA: Dimension-Adaptive Neural Architecture for Multivariate Sensor Data Mohammad Malekzadeh R. Clegg Andrea Cavallaro Hamed Haddadi AI4TS 19 3 0 05 Aug 2020
Parametric Copula-GP model for analyzing multidimensional neuronal and behavioral relationships N. Kudryashova Theoklitos Amvrosiadis Nathalie Dupuy Nathalie L Rochefort A. Onken 14 5 0 03 Aug 2020
Dynamics Generalization via Information Bottleneck in Deep Reinforcement Learning Xingyu Lu Kimin Lee Pieter Abbeel Stas Tiomkin DRL AI4CE 13 33 0 03 Aug 2020
Representation Learning with Video Deep InfoMax R. Devon Hjelm Philip Bachman SSL MDE 26 28 0 27 Jul 2020
Domain2Vec: Domain Embedding for Unsupervised Domain Adaptation Xingchao Peng Yichen Li Kate Saenko 11 32 0 17 Jul 2020
General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Models Christoph Molnar Gunnar Konig J. Herbinger Timo Freiesleben Susanne Dandl Christian A. Scholbeck Giuseppe Casalicchio Moritz Grosse-Wentrup B. Bischl FAtt AI4CE 31 135 0 08 Jul 2020
Variational Representations and Neural Network Estimation of Rényi Divergences Jeremiah Birrell P. Dupuis M. Katsoulakis Luc Rey-Bellet Jie Wang 16 31 0 07 Jul 2020
Disentangled Graph Collaborative Filtering Xiang Wang Hongye Jin An Zhang Xiangnan He Tong Xu Tat-Seng Chua 26 533 0 03 Jul 2020
Multi-Task Variational Information Bottleneck Weizhu Qian Bowei Chen Yichao Zhang Guanghui Wen Franck Gechter 21 11 0 01 Jul 2020
SCE: Scalable Network Embedding from Sparsest Cut Shengzhong Zhang Zengfeng Huang Haicang Zhou Ziang Zhou SSL BDL 27 18 0 30 Jun 2020
Telescoping Density-Ratio Estimation Benjamin Rhodes Kai Xu Michael U. Gutmann 25 94 0 22 Jun 2020
CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information Pengyu Cheng Weituo Hao Shuyang Dai Jiachang Liu Zhe Gan Lawrence Carin VLM 8 340 0 22 Jun 2020
Contrastive Learning for Weakly Supervised Phrase Grounding Tanmay Gupta Arash Vahdat Gal Chechik Xiaodong Yang Jan Kautz Derek Hoiem ObjD SSL 34 140 0 17 Jun 2020
Focus of Attention Improves Information Transfer in Visual Features Matteo Tiezzi S. Melacci Alessandro Betti Marco Maggini Marco Gori 11 10 0 16 Jun 2020
Optimizing Variational Representations of Divergences and Accelerating their Statistical Estimation Jeremiah Birrell M. Katsoulakis Yannis Pantazis 14 22 0 15 Jun 2020
Cumulant GAN Yannis Pantazis D. Paul M. Fasoulakis Y. Stylianou M. Katsoulakis GAN 14 18 0 11 Jun 2020
A Variational Approach to Privacy and Fairness Borja Rodríguez Gálvez Ragnar Thobaben Mikael Skoglund FaML DRL 19 25 0 11 Jun 2020
On the Maximum Mutual Information Capacity of Neural Architectures Brandon Foggo Nan Yu TPM 21 3 0 10 Jun 2020
Optimal Bounds between $f$ -Divergences and Integral Probability Metrics R. Agrawal Thibaut Horel 11 38 0 10 Jun 2020
Unsupervised Graph Representation by Periphery and Hierarchical Information Maximization S. Bandyopadhyay Manasvi Aggarwal M. Murty SSL 17 6 0 08 Jun 2020
GroupIM: A Mutual Information Maximization Framework for Neural Group Recommendation Aravind Sankar Yanhong Wu Yuhang Wu Wei Zhang Hao Yang Hari Sundaram AI4TS 14 88 0 05 Jun 2020
Improving Disentangled Text Representation Learning with Information-Theoretic Guidance Pengyu Cheng Martin Renqiang Min Dinghan Shen Christopher Malon Yizhe Zhang Yitong Li Lawrence Carin DRL 6 88 0 01 Jun 2020
Generating Diverse and Consistent QA pairs from Contexts with Information-Maximizing Hierarchical Conditional VAEs Dong Bok Lee Seanie Lee Woo Tae Jeong Donghwan Kim Sung Ju Hwang 24 71 0 28 May 2020
C-MI-GAN : Estimation of Conditional Mutual Information using MinMax formulation A. Mondal A. Bhattacharya Sudipto Mukherjee A. Prathosh Sreeram Kannan Himanshu Asnani 16 15 0 17 May 2020
Geodesics in fibered latent spaces: A geometric approach to learning correspondences between conditions Tariq Daouda Reda Chhaibi Prudencio Tossou A. Villani 11 2 0 16 May 2020
On the Information Plane of Autoencoders Nicolás I. Tapia P. Estévez 17 19 0 15 May 2020
Renormalized Mutual Information for Artificial Scientific Discovery Leopoldo Sarra A. Aiello F. Marquardt 6 4 0 04 May 2020
The Information Bottleneck Problem and Its Applications in Machine Learning Ziv Goldfeld Yury Polyanskiy 23 129 0 30 Apr 2020
Have you forgotten? A method to assess if machine learning models have forgotten data Xiao Liu Sotirios A. Tsaftaris FedML OOD MU 19 26 0 21 Apr 2020
Learning Discrete Structured Representations by Adversarially Maximizing Mutual Information K. Stratos Sam Wiseman SSL DRL 11 7 0 08 Apr 2020
Unpacking Information Bottlenecks: Unifying Information-Theoretic Objectives in Deep Learning Andreas Kirsch Clare Lyle Y. Gal 27 16 0 27 Mar 2020
Pix2Shape: Towards Unsupervised Learning of 3D Scenes from Images using a View-based Representation Sai Rajeswar Fahim Mannan Florian Golemo Jérôme Parent-Lévesque David Vazquez Derek Nowrouzezahrai Aaron Courville 3DV 42 11 0 23 Mar 2020
On Information Plane Analyses of Neural Network Classifiers -- A Review Bernhard C. Geiger 32 50 0 21 Mar 2020
Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation Moab Arar Y. Ginger Dov Danon Ilya Leizerson Amit H. Bermano Daniel Cohen-Or 11 118 0 18 Mar 2020