v1v2v3v4 (latest)

Formal Limitations on the Measurement of Mutual Information

10 November 2018

Papers citing "Formal Limitations on the Measurement of Mutual Information"

50 / 180 papers shown

Title
Multimodal Molecular Pretraining via Modality Blending Qiying Yu Yudi Zhang Yuyan Ni Shi Feng Yanyan Lan Hao Zhou Jingjing Liu 72 13 0 12 Jul 2023
Information decomposition in complex systems via machine learning Kieran A. Murphy Danielle Bassett 106 10 0 10 Jul 2023
Beyond Normal: On the Evaluation of Mutual Information Estimators Paweł Czyż Frederic Grabowski Julia E. Vogt N. Beerenwinkel Alexander Marx 109 35 0 19 Jun 2023
On the Effectiveness of Hybrid Mutual Information Estimation Marco Federici David Ruhe Patrick Forré 82 6 0 01 Jun 2023
Statistically Efficient Bayesian Sequential Experiment Design via Reinforcement Learning with Cross-Entropy Estimators Tom Blau Iadine Chadès Amir Dezfouli Daniel M. Steinberg Edwin V. Bonilla 77 1 0 29 May 2023
Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual Information Kun Zhao Bohao Yang Chenghua Lin Wenge Rong Aline Villavicencio Xiaohui Cui DRL 67 4 0 26 May 2023
Information Bottleneck Analysis of Deep Neural Networks via Lossy Compression I. Butakov Alexander Tolmachev S. Malanchuk A. Neopryatnaya Alexey Frolov K. Andreev 116 7 0 13 May 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory: A Review Ravid Shwartz-Ziv Yann LeCun SSL 125 75 0 19 Apr 2023
Reinforcement Learning with Exogenous States and Rewards George Trimponias Thomas G. Dietterich OffRL 65 2 0 22 Mar 2023
An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization Ravid Shwartz-Ziv Randall Balestriero Kenji Kawaguchi Tim G. J. Rudner Yann LeCun 70 23 0 01 Mar 2023
InfoNCE Loss Provably Learns Cluster-Preserving Representations Advait Parulekar Liam Collins Karthikeyan Shanmugam Aryan Mokhtari Sanjay Shakkottai SSL 117 25 0 15 Feb 2023
Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation Ziwei Fan Zhiwei Liu Hao Peng Philip S Yu 82 16 0 28 Jan 2023
DiME: Maximizing Mutual Information by a Difference of Matrix-Based Entropies Oscar Skean J. Hoyos-Osorio A. Brockmeier L. S. Giraldo 80 13 0 19 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 105 9 0 27 Dec 2022
Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels Kangyu Weng Aohua Cheng Ziyang Zhang Pei Sun Yang Tian 113 2 0 04 Dec 2022
Interpretability with full complexity by constraining feature information Kieran A. Murphy Danielle Bassett FAtt 98 5 0 30 Nov 2022
Mutual Information Learned Regressor: an Information-theoretic Viewpoint of Training Regression Systems Jirong Yi Q. Zhang Zhengbo Chen Qiaoan Liu Weizhuo Shao Yusen He Yao Wang SSL 62 0 0 23 Nov 2022
Diffeomorphic Information Neural Estimation Bao Duong T. Nguyen 57 6 0 20 Nov 2022
Generalized Balancing Weights via Deep Neural Networks Yoshiaki Kitazawa BDL CML 64 1 0 14 Nov 2022
Characterizing information loss in a chaotic double pendulum with the Information Bottleneck Kieran A. Murphy Danielle Bassett 36 0 0 25 Oct 2022
Greedy Modality Selection via Approximate Submodular Maximization Runxiang Cheng Gargi Balasubramaniam Yifei He Yao-Hung Hubert Tsai Han Zhao 54 1 0 22 Oct 2022
Function-space regularized Rényi divergences Jeremiah Birrell Yannis Pantazis P. Dupuis Markos A. Katsoulakis Luc Rey-Bellet 101 7 0 10 Oct 2022
Decomposed Mutual Information Optimization for Generalized Context in Meta-Reinforcement Learning Yao Mu Yuzheng Zhuang Fei Ni Bin Wang Jianyu Chen Jianye Hao Ping Luo 36 2 0 09 Oct 2022
Robustness of Unsupervised Representation Learning without Labels Aleksandar Petrov Marta Z. Kwiatkowska OffRL 90 2 0 08 Oct 2022
Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps Kuilin Chen Chi-Guhn Lee SSL 85 3 0 07 Oct 2022
Mutual Information Learned Classifiers: an Information-theoretic Viewpoint of Training Deep Learning Classification Systems Jirong Yi Q. Zhang Zhenji Chen Qiaoan Liu Weizhuo Shao SSL FedML 71 3 0 21 Sep 2022
Dataset Inference for Self-Supervised Models Adam Dziedzic Haonan Duan Muhammad Ahmad Kaleem Nikita Dhawan Jonas Guan Yannis Cattan Franziska Boenisch Nicolas Papernot 123 28 0 16 Sep 2022
Self-Supervised Learning with an Information Maximization Criterion Serdar Ozsoy Shadi S. Hamdan Sercan O. Arik Deniz Yuret A. Erdogan SSL 67 39 0 16 Sep 2022
Information Theoretic Measures of Causal Influences during Transient Neural Events K. Shao N. Logothetis M. Besserve CML 74 4 0 15 Sep 2022
MICO: Selective Search with Mutual Information Co-training Zhanyu Wang Xiao Zhang Hyokun Yun C. Teo Trishul Chilimbi VLM 46 1 0 09 Sep 2022
OOD-Probe: A Neural Interpretation of Out-of-Domain Generalization Zining Zhu Soroosh Shahtalebi Frank Rudzicz 95 5 0 25 Aug 2022
RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence Kyungmin Lee Jinwoo Shin SSL DRL 99 10 0 12 Aug 2022
Cancer Subtyping by Improved Transcriptomic Features Using Vector Quantized Variational Autoencoder Zheng Chen Ziwei Yang Lingwei Zhu Guang Shi Kun Yue Takashi Matsubara Shigehiko Kanaya M. Altaf-Ul-Amin DRL 102 5 0 20 Jul 2022
k-Sliced Mutual Information: A Quantitative Study of Scalability with Dimension Ziv Goldfeld Kristjan Greenewald Theshani Nuradha Galen Reeves 73 0 0 17 Jun 2022
Crosslinguistic word order variation reflects evolutionary pressures of dependency and information locality Michael Hahn Yang Xu 49 18 0 09 Jun 2022
Active Inference for Robotic Manipulation Tim Schneider Boris Belousov Hany Abdulsamad Jan Peters 51 4 0 01 Jun 2022
Smart Channel State Information Pre-processing for Joint Authentication and Secret Key Distillation M. Srinivasan Sotiris Skaperas A. Chorti Mahdi Shakiba-Herfeh M. K. Shehzad P. Sehier 36 1 0 01 Jun 2022
Data-Driven Estimation of Capacity Upper Bounds Christian Hager E. Agrell 63 2 0 13 May 2022
Learning Disentangled Textual Representations via Statistical Measures of Similarity Pierre Colombo Guillaume Staerman Nathan Noiry Pablo Piantanida FaML DRL 197 22 0 07 May 2022
Physical Layer Security for 6G Systems why it is needed and how to make it happen A. Chorti 23 0 0 03 May 2022
Neural Estimation of the Rate-Distortion Function With Applications to Operational Source Coding Eric Lei Hamed Hassani Shirin Saeedi Bidokhti 58 20 0 04 Apr 2022
One Network Doesn't Rule Them All: Moving Beyond Handcrafted Architectures in Self-Supervised Learning Sharath Girish Debadeepta Dey Neel Joshi Vibhav Vineet S. Shah C. C. T. Mendes Abhinav Shrivastava Yale Song SSL 73 2 0 15 Mar 2022
Rethinking Minimal Sufficient Representation in Contrastive Learning Haoqing Wang Xun Guo Zhiwei Deng Yan Lu SSL 78 76 0 14 Mar 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 163 23 0 14 Feb 2022
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Eric Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 66 72 0 12 Jan 2022
CLIP-Lite: Information Efficient Visual Representation Learning with Language Supervision A. Shrivastava Ramprasaath R. Selvaraju Nikhil Naik Vicente Ordonez VLM CLIP 64 6 0 14 Dec 2021
MIO : Mutual Information Optimization using Self-Supervised Binary Contrastive Learning Siladittya Manna Umapada Pal Saumik Bhattacharya SSL 123 1 0 24 Nov 2021
Density Ratio Estimation via Infinitesimal Classification Kristy Choi Chenlin Meng Yang Song Stefano Ermon 80 42 0 22 Nov 2021
A Reverse Jensen Inequality Result with Application to Mutual Information Estimation Gerhard Wunder Benedikt Groß Rick Fritschek Rafael F. Schaefer 31 10 0 12 Nov 2021
Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods Desi R. Ivanova Adam Foster Steven Kleinegesse Michael U. Gutmann Tom Rainforth OffRL 132 48 0 03 Nov 2021