Conditional Mutual Information Neural Estimator

v1v2 (latest)

Conditional Mutual Information Neural Estimator

6 November 2019

Sina Molavipour

Mikael Skoglund

ArXiv (abs)PDF HTML

Papers citing "Conditional Mutual Information Neural Estimator"

19 / 19 papers shown

Title
An Information Theoretic Approach to Interaction-Grounded Learning Xiaoyan Hu Farzan Farnia Ho-fung Leung VLM 77 2 0 10 Jan 2024
Disentanglement and Generalization Under Correlation Shifts Christina M. Funke Paul Vicol Kuan-Chieh Wang Matthias Kümmerer R. Zemel Matthias Bethge OOD 110 7 0 29 Dec 2021
Towards quantifying information flows: relative entropy in deep neural networks and the renormalization group J. Erdmenger Kevin T. Grosvenor R. Jefferson 82 17 0 14 Jul 2021
Reinforce Security: A Model-Free Approach Towards Secure Wiretap Coding Rick Fritschek Rafael F. Schaefer Gerhard Wunder AAML 40 4 0 01 Jun 2021
Neural Estimators for Conditional Mutual Information Using Nearest Neighbors Sampling Sina Molavipour Germán Bassi Mikael Skoglund 53 8 0 12 Jun 2020
Capacity of Continuous Channels with Memory via Directed Information Neural Estimator Ziv Aharoni Dor Tsur Ziv Goldfeld Haim Permuter 61 21 0 09 Mar 2020
CCMI : Classifier based Conditional Mutual Information Estimation Sudipto Mukherjee Himanshu Asnani Sreeram Kannan VLM 127 81 0 05 Jun 2019
Deep Learning for Channel Coding via Neural Mutual Information Estimation Rick Fritschek Rafael F. Schaefer Gerhard Wunder 85 46 0 07 Mar 2019
Formal Limitations on the Measurement of Mutual Information David A. McAllester K. Stratos SSL 95 277 0 10 Nov 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 405 2,677 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 360 10,386 0 10 Jul 2018
Entropy and mutual information in models of deep neural networks Marylou Gabrié Andre Manoel Clément Luneau Jean Barbier N. Macris Florent Krzakala Lenka Zdeborová 85 179 0 24 May 2018
Physical Layer Communications System Design Over-the-Air Using Adversarial Networks Tim O'Shea Tamoghna Roy Nathan E. West Benjamin C. Hilburn GAN 58 109 0 08 Mar 2018
Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information Jakob Runge 164 171 0 05 Sep 2017
Deep Learning-Based Communication Over the Air Sebastian Dörner Sebastian Cammerer J. Hoydis S. Brink 95 720 0 11 Jul 2017
An Introduction to Deep Learning for the Physical Layer Tim O'Shea J. Hoydis AI4CE 188 2,207 0 02 Feb 2017
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization Sebastian Nowozin Botond Cseke Ryota Tomioka GAN 170 1,658 0 02 Jun 2016
Demystifying Fixed k-Nearest Neighbor Information Estimators Weihao Gao Sewoong Oh Pramod Viswanath 93 138 0 11 Apr 2016
Estimating divergence functionals and the likelihood ratio by convex risk minimization X. Nguyen Martin J. Wainwright Michael I. Jordan 240 807 0 04 Sep 2008