v1v2v3v4 (latest)

Formal Limitations on the Measurement of Mutual Information

10 November 2018

Papers citing "Formal Limitations on the Measurement of Mutual Information"

50 / 180 papers shown

Title
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence Alexander Semenenko I. Butakov Alexey Frolov Ivan Oseledets 68 0 0 04 Jun 2025
PFMBench: Protein Foundation Model Benchmark Zhangyang Gao Hao Wang Cheng Tan Chenrui Xu Mengdi Liu Bozhen Hu Linlin Chao Xiaoming Zhang Stan Z. Li 19 0 0 01 Jun 2025
Invariant Representations via Wasserstein Correlation Maximization Keenan Eikenberry Lizuo Liu Yoonsang Lee OOD 72 0 0 16 May 2025
A Tutorial on Discriminative Clustering and Mutual Information Louis Ohl Pierre-Alexandre Mattei F. Precioso 116 0 0 07 May 2025
Toward Efficient Exploration by Large Language Model Agents Dilip Arumugam Thomas L. Griffiths LLMAG 217 4 0 29 Apr 2025
Robust Classification with Noisy Labels Based on Posterior Maximization Nicola Novello Andrea M. Tonello NoLa 93 0 0 09 Apr 2025
Fundamental Limits of Perfect Concept Erasure Somnath Basu Roy Chowdhury Avinava Dubey Ahmad Beirami Rahul Kidambi Nicholas Monath Amr Ahmed Snigdha Chaturvedi 107 1 0 25 Mar 2025
Fair Text Classification via Transferable Representations Thibaud Leteno Michael Perrot Charlotte Laclau Antoine Gourru Christophe Gravier FaML 117 0 0 10 Mar 2025
INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators Alberto Foresti Giulio Franzese Pietro Michiardi 142 0 0 26 Feb 2025
A Neural Difference-of-Entropies Estimator for Mutual Information Haoran Ni Martin Lotz SSL DRL 140 0 0 18 Feb 2025
InfoBridge: Mutual Information estimation via Bridge Matching Sergei Kholkin Ivan Butakov Evgeny Burnaev Nikita Gushchin Alexander Korotin DiffM FedML 155 0 0 03 Feb 2025
Learning Robust and Privacy-Preserving Representations via Information Theory Binghui Zhang Sayedeh Leila Noorbakhsh Yun Dong Yuan Hong Binghui Wang 157 0 0 15 Dec 2024
A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets Kyungeun Lee Wonjong Rhee 75 5 0 14 Oct 2024
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax I. Butakov Alexander Sememenko Alexander Tolmachev Andrey Gladkov Marina Munkhoeva Alexey Frolov 159 1 0 09 Oct 2024
Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex Alex Mulrooney Austin J. Brockmeier 88 0 0 08 Oct 2024
Bounds on Lp errors in density ratio estimation via f-divergence loss functions Yoshiaki Kitazawa 106 1 0 02 Oct 2024
Learning Representations for Independence Testing Nathaniel Xu Feng Liu Danica J. Sutherland BDL 103 0 0 10 Sep 2024
Estimating the Completeness of Discrete Speech Units Sung-Lin Yeh Hao Tang 105 2 0 09 Sep 2024
Approximating mutual information of high-dimensional variables using learned representations Gokul Gowri Xiao-Kang Lun Allon M. Klein Peng Yin 69 7 0 03 Sep 2024
Slicing Mutual Information Generalization Bounds for Neural Networks Kimia Nadjahi Kristjan Greenewald Rickard Brüel-Gabrielsson Justin Solomon 99 4 0 06 Jun 2024
Predictability Analysis of Regression Problems via Conditional Entropy Estimations Yu-Hsueh Fang Chia-Yen Lee 62 1 0 06 Jun 2024
Information Theoretic Text-to-Image Alignment Chao Wang Giulio Franzese A. Finamore Massimo Gallo Pietro Michiardi 176 0 0 31 May 2024
Mutual Information Analysis in Multimodal Learning Systems Hadi Hadizadeh S. F. Yeganli Bahador Rashidi Ivan V. Bajić 29 2 0 21 May 2024
TimeX++: Learning Time-Series Explanations with Information Bottleneck Zichuan Liu Tianchun Wang Jimeng Shi Xu Zheng Zhuomin Chen Lei Song Wenqian Dong J. Obeysekera Farhad Shirani Dongsheng Luo AI4TS 86 11 0 15 May 2024
Compressive Feature Selection for Remote Visual Multi-Task Inference Saeed Ranjbar Alvar Ivan V. Bajić 53 0 0 15 May 2024
Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding Eric Lei Hamed Hassani Shirin Saeedi Bidokhti 76 3 0 12 Mar 2024
Learning to Maximize Mutual Information for Chain-of-Thought Distillation Xin Chen Hanxian Huang Yanjun Gao Yi Wang Jishen Zhao Ke Ding 100 15 0 05 Mar 2024
Mutual Information Estimation via Normalizing Flows I. Butakov Alexander Tolmachev S. Malanchuk A. Neopryatnaya Alexey Frolov 93 8 0 04 Mar 2024
Limits to classification performance by relating Kullback-Leibler divergence to Cohen's Kappa L. Crow S. J. Watts 18 0 0 03 Mar 2024
Nonlinear Bayesian optimal experimental design using logarithmic Sobolev inequalities Fengyi Li Ayoub Belhadji Youssef Marzouk 60 2 0 23 Feb 2024
$f$ -MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning Yiwei Lu Guojun Zhang Sun Sun Hongyu Guo Yaoliang Yu VLM 50 6 0 15 Feb 2024
TREET: TRansfer Entropy Estimation via Transformers Omer Luxembourg Dor Tsur Haim Permuter 68 1 0 10 Feb 2024
REMEDI: Corrective Transformations for Improved Neural Entropy Estimation Viktor Nilsson Anirban Samaddar Sandeep Madireddy Pierre Nyquist 54 2 0 08 Feb 2024
BECLR: Batch Enhanced Contrastive Few-Shot Learning Stylianos Poulakakis-Daktylidis Hadi Jamali Rad 91 5 0 04 Feb 2024
A Probabilistic Model behind Self-Supervised Learning Alice Bizeul Bernhard Schölkopf Carl Allen SSL 75 2 0 02 Feb 2024
Fundamental Limitation of Semantic Communications: Neural Estimation for Rate-Distortion Dongxu Li Jianhao Huang Chuan Huang Xiaoqi Qin Han Zhang Ping Zhang 68 9 0 02 Jan 2024
Equivariant Flow Matching with Hybrid Probability Transport Yuxuan Song Jingjing Gong Minkai Xu Ziyao Cao Yanyan Lan Stefano Ermon Hao Zhou Wei-Ying Ma DiffM 84 57 0 12 Dec 2023
Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction Zilin Du Haoxin Li Xu Guo Boyang Li 91 1 0 05 Dec 2023
Quantifying the redundancy between prosody and text Lukas Wolf Tiago Pimentel Evelina Fedorenko Ryan Cotterell Alex Warstadt Ethan Gotlieb Wilcox Tamar I. Regev 83 11 0 28 Nov 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 154 0 0 08 Nov 2023
A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification Pierre Colombo Nathan Noiry Guillaume Staerman Pablo Piantanida FaML DRL 78 1 0 21 Oct 2023
On the Properties and Estimation of Pointwise Mutual Information Profiles Paweł Czyż Frederic Grabowski Julia E. Vogt N. Beerenwinkel Alexander Marx 89 3 0 16 Oct 2023
MINDE: Mutual Information Neural Diffusion Estimation Giulio Franzese Mustapha Bounoua Pietro Michiardi DiffM 80 8 0 13 Oct 2023
Measuring Information in Text Explanations Zining Zhu Frank Rudzicz FAtt 66 0 0 06 Oct 2023
Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck Marco Federici Patrick Forré Ryota Tomioka Bastiaan S. Veeling 53 6 0 13 Sep 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning Kyungeun Lee Jaeill Kim Suhyun Kang Wonjong Rhee SSL 82 2 0 30 Aug 2023
MoCLIM: Towards Accurate Cancer Subtyping via Multi-Omics Contrastive Learning with Omics-Inference Modeling Ziwei Yang Zhengjun Chen Yasuko Matsubara Yasushi Sakurai 61 2 0 17 Aug 2023
A Distance Correlation-Based Approach to Characterize the Effectiveness of Recurrent Neural Networks for Time Series Forecasting Christopher Salazar A. Banerjee AI4TS 91 3 0 28 Jul 2023
Safety Performance of Neural Networks in the Presence of Covariate Shift Chih-Hong Cheng Harald Ruess K. Theodorou 65 1 0 24 Jul 2023
The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning Borja Rodríguez Gálvez Arno Blaas P. Rodríguez Adam Goliñski Xavier Suau Jason Ramapuram Dan Busbridge Luca Zappella 82 7 0 20 Jul 2023