ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1811.04251
  4. Cited By
Formal Limitations on the Measurement of Mutual Information
v1v2v3v4 (latest)

Formal Limitations on the Measurement of Mutual Information

10 November 2018
David A. McAllester
K. Stratos
    SSL
ArXiv (abs)PDFHTML

Papers citing "Formal Limitations on the Measurement of Mutual Information"

50 / 180 papers shown
Title
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence
Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependence
Alexander Semenenko
I. Butakov
Alexey Frolov
Ivan Oseledets
68
0
0
04 Jun 2025
PFMBench: Protein Foundation Model Benchmark
PFMBench: Protein Foundation Model Benchmark
Zhangyang Gao
Hao Wang
Cheng Tan
Chenrui Xu
Mengdi Liu
Bozhen Hu
Linlin Chao
Xiaoming Zhang
Stan Z. Li
21
0
0
01 Jun 2025
Invariant Representations via Wasserstein Correlation Maximization
Invariant Representations via Wasserstein Correlation Maximization
Keenan Eikenberry
Lizuo Liu
Yoonsang Lee
OOD
72
0
0
16 May 2025
A Tutorial on Discriminative Clustering and Mutual Information
A Tutorial on Discriminative Clustering and Mutual Information
Louis Ohl
Pierre-Alexandre Mattei
F. Precioso
116
0
0
07 May 2025
Toward Efficient Exploration by Large Language Model Agents
Toward Efficient Exploration by Large Language Model Agents
Dilip Arumugam
Thomas L. Griffiths
LLMAG
217
4
0
29 Apr 2025
Robust Classification with Noisy Labels Based on Posterior Maximization
Robust Classification with Noisy Labels Based on Posterior Maximization
Nicola Novello
Andrea M. Tonello
NoLa
93
0
0
09 Apr 2025
Fundamental Limits of Perfect Concept Erasure
Fundamental Limits of Perfect Concept Erasure
Somnath Basu Roy Chowdhury
Avinava Dubey
Ahmad Beirami
Rahul Kidambi
Nicholas Monath
Amr Ahmed
Snigdha Chaturvedi
107
1
0
25 Mar 2025
Fair Text Classification via Transferable Representations
Thibaud Leteno
Michael Perrot
Charlotte Laclau
Antoine Gourru
Christophe Gravier
FaML
117
0
0
10 Mar 2025
INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators
INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators
Alberto Foresti
Giulio Franzese
Pietro Michiardi
142
0
0
26 Feb 2025
A Neural Difference-of-Entropies Estimator for Mutual Information
A Neural Difference-of-Entropies Estimator for Mutual Information
Haoran Ni
Martin Lotz
SSLDRL
142
0
0
18 Feb 2025
InfoBridge: Mutual Information estimation via Bridge Matching
InfoBridge: Mutual Information estimation via Bridge Matching
Sergei Kholkin
Ivan Butakov
Evgeny Burnaev
Nikita Gushchin
Alexander Korotin
DiffMFedML
155
0
0
03 Feb 2025
Learning Robust and Privacy-Preserving Representations via Information
  Theory
Learning Robust and Privacy-Preserving Representations via Information Theory
Binghui Zhang
Sayedeh Leila Noorbakhsh
Yun Dong
Yuan Hong
Binghui Wang
157
0
0
15 Dec 2024
A Benchmark Suite for Evaluating Neural Mutual Information Estimators on
  Unstructured Datasets
A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets
Kyungeun Lee
Wonjong Rhee
75
5
0
14 Oct 2024
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax
I. Butakov
Alexander Sememenko
Alexander Tolmachev
Andrey Gladkov
Marina Munkhoeva
Alexey Frolov
159
1
0
09 Oct 2024
Contrastive Learning to Fine-Tune Feature Extraction Models for the
  Visual Cortex
Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex
Alex Mulrooney
Austin J. Brockmeier
88
0
0
08 Oct 2024
Bounds on Lp errors in density ratio estimation via f-divergence loss functions
Bounds on Lp errors in density ratio estimation via f-divergence loss functions
Yoshiaki Kitazawa
106
1
0
02 Oct 2024
Learning Representations for Independence Testing
Learning Representations for Independence Testing
Nathaniel Xu
Feng Liu
Danica J. Sutherland
BDL
103
0
0
10 Sep 2024
Estimating the Completeness of Discrete Speech Units
Estimating the Completeness of Discrete Speech Units
Sung-Lin Yeh
Hao Tang
105
2
0
09 Sep 2024
Approximating mutual information of high-dimensional variables using
  learned representations
Approximating mutual information of high-dimensional variables using learned representations
Gokul Gowri
Xiao-Kang Lun
Allon M. Klein
Peng Yin
69
7
0
03 Sep 2024
Slicing Mutual Information Generalization Bounds for Neural Networks
Slicing Mutual Information Generalization Bounds for Neural Networks
Kimia Nadjahi
Kristjan Greenewald
Rickard Brüel-Gabrielsson
Justin Solomon
99
4
0
06 Jun 2024
Predictability Analysis of Regression Problems via Conditional Entropy
  Estimations
Predictability Analysis of Regression Problems via Conditional Entropy Estimations
Yu-Hsueh Fang
Chia-Yen Lee
62
1
0
06 Jun 2024
Information Theoretic Text-to-Image Alignment
Information Theoretic Text-to-Image Alignment
Chao Wang
Giulio Franzese
A. Finamore
Massimo Gallo
Pietro Michiardi
176
0
0
31 May 2024
Mutual Information Analysis in Multimodal Learning Systems
Mutual Information Analysis in Multimodal Learning Systems
Hadi Hadizadeh
S. F. Yeganli
Bahador Rashidi
Ivan V. Bajić
29
2
0
21 May 2024
TimeX++: Learning Time-Series Explanations with Information Bottleneck
TimeX++: Learning Time-Series Explanations with Information Bottleneck
Zichuan Liu
Tianchun Wang
Jimeng Shi
Xu Zheng
Zhuomin Chen
Lei Song
Wenqian Dong
J. Obeysekera
Farhad Shirani
Dongsheng Luo
AI4TS
86
11
0
15 May 2024
Compressive Feature Selection for Remote Visual Multi-Task Inference
Compressive Feature Selection for Remote Visual Multi-Task Inference
Saeed Ranjbar Alvar
Ivan V. Bajić
53
0
0
15 May 2024
Approaching Rate-Distortion Limits in Neural Compression with Lattice
  Transform Coding
Approaching Rate-Distortion Limits in Neural Compression with Lattice Transform Coding
Eric Lei
Hamed Hassani
Shirin Saeedi Bidokhti
76
3
0
12 Mar 2024
Learning to Maximize Mutual Information for Chain-of-Thought
  Distillation
Learning to Maximize Mutual Information for Chain-of-Thought Distillation
Xin Chen
Hanxian Huang
Yanjun Gao
Yi Wang
Jishen Zhao
Ke Ding
100
15
0
05 Mar 2024
Mutual Information Estimation via Normalizing Flows
Mutual Information Estimation via Normalizing Flows
I. Butakov
Alexander Tolmachev
S. Malanchuk
A. Neopryatnaya
Alexey Frolov
93
8
0
04 Mar 2024
Limits to classification performance by relating Kullback-Leibler
  divergence to Cohen's Kappa
Limits to classification performance by relating Kullback-Leibler divergence to Cohen's Kappa
L. Crow
S. J. Watts
18
0
0
03 Mar 2024
Nonlinear Bayesian optimal experimental design using logarithmic Sobolev
  inequalities
Nonlinear Bayesian optimal experimental design using logarithmic Sobolev inequalities
Fengyi Li
Ayoub Belhadji
Youssef Marzouk
60
2
0
23 Feb 2024
$f$-MICL: Understanding and Generalizing InfoNCE-based Contrastive
  Learning
fff-MICL: Understanding and Generalizing InfoNCE-based Contrastive Learning
Yiwei Lu
Guojun Zhang
Sun Sun
Hongyu Guo
Yaoliang Yu
VLM
50
6
0
15 Feb 2024
TREET: TRansfer Entropy Estimation via Transformers
TREET: TRansfer Entropy Estimation via Transformers
Omer Luxembourg
Dor Tsur
Haim Permuter
68
1
0
10 Feb 2024
REMEDI: Corrective Transformations for Improved Neural Entropy
  Estimation
REMEDI: Corrective Transformations for Improved Neural Entropy Estimation
Viktor Nilsson
Anirban Samaddar
Sandeep Madireddy
Pierre Nyquist
54
2
0
08 Feb 2024
BECLR: Batch Enhanced Contrastive Few-Shot Learning
BECLR: Batch Enhanced Contrastive Few-Shot Learning
Stylianos Poulakakis-Daktylidis
Hadi Jamali Rad
91
5
0
04 Feb 2024
A Probabilistic Model behind Self-Supervised Learning
A Probabilistic Model behind Self-Supervised Learning
Alice Bizeul
Bernhard Schölkopf
Carl Allen
SSL
75
2
0
02 Feb 2024
Fundamental Limitation of Semantic Communications: Neural Estimation for
  Rate-Distortion
Fundamental Limitation of Semantic Communications: Neural Estimation for Rate-Distortion
Dongxu Li
Jianhao Huang
Chuan Huang
Xiaoqi Qin
Han Zhang
Ping Zhang
68
9
0
02 Jan 2024
Equivariant Flow Matching with Hybrid Probability Transport
Equivariant Flow Matching with Hybrid Probability Transport
Yuxuan Song
Jingjing Gong
Minkai Xu
Ziyao Cao
Yanyan Lan
Stefano Ermon
Hao Zhou
Wei-Ying Ma
DiffM
84
57
0
12 Dec 2023
Training on Synthetic Data Beats Real Data in Multimodal Relation
  Extraction
Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction
Zilin Du
Haoxin Li
Xu Guo
Boyang Li
91
1
0
05 Dec 2023
Quantifying the redundancy between prosody and text
Quantifying the redundancy between prosody and text
Lukas Wolf
Tiago Pimentel
Evelina Fedorenko
Ryan Cotterell
Alex Warstadt
Ethan Gotlieb Wilcox
Tamar I. Regev
83
11
0
28 Nov 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
Huayi Tang
Yong Liu
154
0
0
08 Nov 2023
A Novel Information-Theoretic Objective to Disentangle Representations
  for Fair Classification
A Novel Information-Theoretic Objective to Disentangle Representations for Fair Classification
Pierre Colombo
Nathan Noiry
Guillaume Staerman
Pablo Piantanida
FaMLDRL
78
1
0
21 Oct 2023
On the Properties and Estimation of Pointwise Mutual Information
  Profiles
On the Properties and Estimation of Pointwise Mutual Information Profiles
Paweł Czyż
Frederic Grabowski
Julia E. Vogt
N. Beerenwinkel
Alexander Marx
89
3
0
16 Oct 2023
MINDE: Mutual Information Neural Diffusion Estimation
MINDE: Mutual Information Neural Diffusion Estimation
Giulio Franzese
Mustapha Bounoua
Pietro Michiardi
DiffM
80
8
0
13 Oct 2023
Measuring Information in Text Explanations
Measuring Information in Text Explanations
Zining Zhu
Frank Rudzicz
FAtt
68
0
0
06 Oct 2023
Latent Representation and Simulation of Markov Processes via Time-Lagged
  Information Bottleneck
Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck
Marco Federici
Patrick Forré
Ryota Tomioka
Bastiaan S. Veeling
53
6
0
13 Sep 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive
  Learning
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning
Kyungeun Lee
Jaeill Kim
Suhyun Kang
Wonjong Rhee
SSL
82
2
0
30 Aug 2023
MoCLIM: Towards Accurate Cancer Subtyping via Multi-Omics Contrastive
  Learning with Omics-Inference Modeling
MoCLIM: Towards Accurate Cancer Subtyping via Multi-Omics Contrastive Learning with Omics-Inference Modeling
Ziwei Yang
Zhengjun Chen
Yasuko Matsubara
Yasushi Sakurai
61
2
0
17 Aug 2023
A Distance Correlation-Based Approach to Characterize the Effectiveness
  of Recurrent Neural Networks for Time Series Forecasting
A Distance Correlation-Based Approach to Characterize the Effectiveness of Recurrent Neural Networks for Time Series Forecasting
Christopher Salazar
A. Banerjee
AI4TS
91
3
0
28 Jul 2023
Safety Performance of Neural Networks in the Presence of Covariate Shift
Safety Performance of Neural Networks in the Presence of Covariate Shift
Chih-Hong Cheng
Harald Ruess
K. Theodorou
65
1
0
24 Jul 2023
The Role of Entropy and Reconstruction in Multi-View Self-Supervised
  Learning
The Role of Entropy and Reconstruction in Multi-View Self-Supervised Learning
Borja Rodríguez Gálvez
Arno Blaas
P. Rodríguez
Adam Goliñski
Xavier Suau
Jason Ramapuram
Dan Busbridge
Luca Zappella
82
7
0
20 Jul 2023
1234
Next