Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
1811.04251
Cited By
v1
v2
v3
v4 (latest)
Formal Limitations on the Measurement of Mutual Information
10 November 2018
David A. McAllester
K. Stratos
SSL
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Formal Limitations on the Measurement of Mutual Information"
50 / 180 papers shown
Title
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence
Alexander Semenenko
I. Butakov
Alexey Frolov
Ivan Oseledets
68
0
0
04 Jun 2025
PFMBench: Protein Foundation Model Benchmark
Zhangyang Gao
Hao Wang
Cheng Tan
Chenrui Xu
Mengdi Liu
Bozhen Hu
Linlin Chao
Xiaoming Zhang
Stan Z. Li
21
0
0
01 Jun 2025
Invariant Representations via Wasserstein Correlation Maximization
Keenan Eikenberry
Lizuo Liu
Yoonsang Lee
OOD
72
0
0
16 May 2025
A Tutorial on Discriminative Clustering and Mutual Information
Louis Ohl
Pierre-Alexandre Mattei
F. Precioso
116
0
0
07 May 2025
Toward Efficient Exploration by Large Language Model Agents
Dilip Arumugam
Thomas L. Griffiths
LLMAG
217
4
0
29 Apr 2025
Robust Classification with Noisy Labels Based on Posterior Maximization
Nicola Novello
Andrea M. Tonello
NoLa
93
0
0
09 Apr 2025
Fundamental Limits of Perfect Concept Erasure
Somnath Basu Roy Chowdhury
Avinava Dubey
Ahmad Beirami
Rahul Kidambi
Nicholas Monath
Amr Ahmed
Snigdha Chaturvedi
107
1
0
25 Mar 2025
Fair Text Classification via Transferable Representations
Thibaud Leteno
Michael Perrot
Charlotte Laclau
Antoine Gourru
Christophe Gravier
FaML
117
0
0
10 Mar 2025
INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators
Alberto Foresti
Giulio Franzese
Pietro Michiardi
142
0
0
26 Feb 2025
A Neural Difference-of-Entropies Estimator for Mutual Information
Haoran Ni
Martin Lotz
SSL
DRL
142
0
0
18 Feb 2025
InfoBridge: Mutual Information estimation via Bridge Matching
Sergei Kholkin
Ivan Butakov
Evgeny Burnaev
Nikita Gushchin
Alexander Korotin
DiffM
FedML
155
0
0
03 Feb 2025
Learning Robust and Privacy-Preserving Representations via Information Theory
Binghui Zhang
Sayedeh Leila Noorbakhsh
Yun Dong
Yuan Hong
Binghui Wang
157
0
0
15 Dec 2024
A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets
Kyungeun Lee
Wonjong Rhee
75
5
0
14 Oct 2024
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax
I. Butakov
Alexander Sememenko
Alexander Tolmachev
Andrey Gladkov
Marina Munkhoeva
Alexey Frolov
159
1
0
09 Oct 2024
Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex
Alex Mulrooney
Austin J. Brockmeier
88
0
0
08 Oct 2024
Bounds on Lp errors in density ratio estimation via f-divergence loss functions
Yoshiaki Kitazawa
106
1
0
02 Oct 2024
Learning Representations for Independence Testing
Nathaniel Xu
Feng Liu
Danica J. Sutherland
BDL
103
0
0
10 Sep 2024
Estimating the Completeness of Discrete Speech Units
Sung-Lin Yeh
Hao Tang
105
2
0
09 Sep 2024
Approximating mutual information of high-dimensional variables using learned representations
Gokul Gowri
Xiao-Kang Lun
Allon M. Klein
Peng Yin
69
7
0
03 Sep 2024
Slicing Mutual Information Generalization Bounds for Neural Networks
Kimia Nadjahi
Kristjan Greenewald
Rickard Brüel-Gabrielsson
Justin Solomon
99
4
0
06 Jun 2024
Predictability Analysis of Regression Problems via Conditional Entropy Estimations
Yu-Hsueh Fang
Chia-Yen Lee
62
1
0
06 Jun 2024
Information Theoretic Text-to-Image Alignment
Chao Wang
Giulio Franzese
A. Finamore
Massimo Gallo
Pietro Michiardi
176
0
0
31 May 2024
Mutual Information Analysis in Multimodal Learning Systems
Hadi Hadizadeh
S. F. Yeganli
Bahador Rashidi
Ivan V. Bajić
29
2
0
21 May 2024
TimeX++: Learning Time-Series Explanations with Information Bottleneck
Zichuan Liu
Tianchun Wang
Jimeng Shi
Xu Zheng
Zhuomin Chen
Lei Song
Wenqian Dong
J. Obeysekera
Farhad Shirani
Dongsheng Luo
AI4TS
86
11
0
15 May 2024
Compressive Feature Selection for Remote Visual Multi-Task Inference
Saeed Ranjbar Alvar
Ivan V. Bajić
53
0
0
15 May 2024
Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
Eric Lei
Hamed Hassani
Shirin Saeedi Bidokhti
76
3
0
12 Mar 2024
Learning to Maximize Mutual Information for Chain-of-Thought Distillation
Xin Chen
Hanxian Huang
Yanjun Gao
Yi Wang
Jishen Zhao
Ke Ding
100
15
0
05 Mar 2024
Mutual Information Estimation via Normalizing Flows
I. Butakov
Alexander Tolmachev
S. Malanchuk
A. Neopryatnaya
Alexey Frolov
93
8
0
04 Mar 2024
Limits to classification performance by relating Kullback-Leibler divergence to Cohen's Kappa
L. Crow
S. J. Watts
18
0
0
03 Mar 2024
Nonlinear Bayesian optimal experimental design using logarithmic Sobolev inequalities
Fengyi Li
Ayoub Belhadji
Youssef Marzouk
60
2
0
23 Feb 2024
f
f
f
-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning
Yiwei Lu
Guojun Zhang
Sun Sun
Hongyu Guo
Yaoliang Yu
VLM
50
6
0
15 Feb 2024
TREET: TRansfer Entropy Estimation via Transformers
Omer Luxembourg
Dor Tsur
Haim Permuter
68
1
0
10 Feb 2024
REMEDI: Corrective Transformations for Improved Neural Entropy Estimation
Viktor Nilsson
Anirban Samaddar
Sandeep Madireddy
Pierre Nyquist
54
2
0
08 Feb 2024
BECLR: Batch Enhanced Contrastive Few-Shot Learning
Stylianos Poulakakis-Daktylidis
Hadi Jamali Rad
91
5
0
04 Feb 2024
A Probabilistic Model behind Self-Supervised Learning
Alice Bizeul
Bernhard Schölkopf
Carl Allen
SSL
75
2
0
02 Feb 2024
Fundamental Limitation of Semantic Communications: Neural Estimation for Rate-Distortion
Dongxu Li
Jianhao Huang
Chuan Huang
Xiaoqi Qin
Han Zhang
Ping Zhang
68
9
0
02 Jan 2024
Equivariant Flow Matching with Hybrid Probability Transport
Yuxuan Song
Jingjing Gong
Minkai Xu
Ziyao Cao
Yanyan Lan
Stefano Ermon
Hao Zhou
Wei-Ying Ma
DiffM
84
57
0
12 Dec 2023
Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction
Zilin Du
Haoxin Li
Xu Guo
Boyang Li
91
1
0
05 Dec 2023
Quantifying the redundancy between prosody and text
Lukas Wolf
Tiago Pimentel
Evelina Fedorenko
Ryan Cotterell
Alex Warstadt
Ethan Gotlieb Wilcox
Tamar I. Regev
83
11
0
28 Nov 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
Huayi Tang
Yong Liu
154
0
0
08 Nov 2023
A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification
Pierre Colombo
Nathan Noiry
Guillaume Staerman
Pablo Piantanida
FaML
DRL
78
1
0
21 Oct 2023
On the Properties and Estimation of Pointwise Mutual Information Profiles
Paweł Czyż
Frederic Grabowski
Julia E. Vogt
N. Beerenwinkel
Alexander Marx
89
3
0
16 Oct 2023
MINDE: Mutual Information Neural Diffusion Estimation
Giulio Franzese
Mustapha Bounoua
Pietro Michiardi
DiffM
80
8
0
13 Oct 2023
Measuring Information in Text Explanations
Zining Zhu
Frank Rudzicz
FAtt
68
0
0
06 Oct 2023
Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck
Marco Federici
Patrick Forré
Ryota Tomioka
Bastiaan S. Veeling
53
6
0
13 Sep 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning
Kyungeun Lee
Jaeill Kim
Suhyun Kang
Wonjong Rhee
SSL
82
2
0
30 Aug 2023
MoCLIM: Towards Accurate Cancer Subtyping via Multi-Omics Contrastive Learning with Omics-Inference Modeling
Ziwei Yang
Zhengjun Chen
Yasuko Matsubara
Yasushi Sakurai
61
2
0
17 Aug 2023
A Distance Correlation-Based Approach to Characterize the Effectiveness of Recurrent Neural Networks for Time Series Forecasting
Christopher Salazar
A. Banerjee
AI4TS
91
3
0
28 Jul 2023
Safety Performance of Neural Networks in the Presence of Covariate Shift
Chih-Hong Cheng
Harald Ruess
K. Theodorou
65
1
0
24 Jul 2023
The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning
Borja Rodríguez Gálvez
Arno Blaas
P. Rodríguez
Adam Goliñski
Xavier Suau
Jason Ramapuram
Dan Busbridge
Luca Zappella
82
7
0
20 Jul 2023
1
2
3
4
Next