Formal Limitations on the Measurement of Mutual Information

10 November 2018

Papers citing "Formal Limitations on the Measurement of Mutual Information"

50 / 69 papers shown

Title
A Tutorial on Discriminative Clustering and Mutual Information Louis Ohl Pierre-Alexandre Mattei F. Precioso 32 0 0 07 May 2025
Toward Efficient Exploration by Large Language Model Agents Dilip Arumugam Thomas L. Griffiths LLMAG 94 1 0 29 Apr 2025
Fair Text Classification via Transferable Representations Thibaud Leteno Michael Perrot Charlotte Laclau Antoine Gourru Christophe Gravier FaML 88 0 0 10 Mar 2025
INFO-SEDD: Continuous Time Markov Chains as Scalable Information Metrics Estimators Alberto Foresti Giulio Franzese Pietro Michiardi 82 0 0 26 Feb 2025
A Neural Difference-of-Entropies Estimator for Mutual Information Haoran Ni Martin Lotz SSL DRL 91 0 0 18 Feb 2025
Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMax I. Butakov Alexander Sememenko Alexander Tolmachev Andrey Gladkov Marina Munkhoeva Alexey Frolov 37 0 0 09 Oct 2024
Bounds on Lp errors in density ratio estimation via f-divergence loss functions Yoshiaki Kitazawa 21 0 0 02 Oct 2024
Learning Deep Kernels for Non-Parametric Independence Testing Nathaniel Xu Feng Liu Danica J. Sutherland BDL 34 0 0 10 Sep 2024
Information Theoretic Text-to-Image Alignment Chao Wang Giulio Franzese A. Finamore Massimo Gallo Pietro Michiardi 75 0 0 31 May 2024
Learning to Maximize Mutual Information for Chain-of-Thought Distillation Xin Chen Hanxian Huang Yanjun Gao Yi Wang Jishen Zhao Ke Ding 35 12 0 05 Mar 2024
Nonlinear Bayesian optimal experimental design using logarithmic Sobolev inequalities Fengyi Li Ayoub Belhadji Youssef Marzouk 30 1 0 23 Feb 2024
TREET: TRansfer Entropy Estimation via Transformers Omer Luxembourg Dor Tsur Haim Permuter 27 1 0 10 Feb 2024
Training on Synthetic Data Beats Real Data in Multimodal Relation Extraction Zilin Du Haoxin Li Xu Guo Boyang Li 35 1 0 05 Dec 2023
Quantifying the redundancy between prosody and text Lukas Wolf Tiago Pimentel Evelina Fedorenko Ryan Cotterell Alex Warstadt Ethan Gotlieb Wilcox Tamar I. Regev 33 10 0 28 Nov 2023
Information-Theoretic Generalization Bounds for Transductive Learning and its Applications Huayi Tang Yong Liu 62 1 0 08 Nov 2023
Safety Performance of Neural Networks in the Presence of Covariate Shift Chih-Hong Cheng Harald Ruess K. Theodorou 30 1 0 24 Jul 2023
Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation Ziwei Fan Zhiwei Liu Hao Peng Philip S Yu 29 15 0 28 Jan 2023
GEDI: GEnerative and DIscriminative Training for Self-Supervised Learning Emanuele Sansone Robin Manhaeve SSL 20 9 0 27 Dec 2022
Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels Kangyu Weng Aohua Cheng Ziyang Zhang Pei Sun Yang Tian 53 2 0 04 Dec 2022
Interpretability with full complexity by constraining feature information Kieran A. Murphy Danielle Bassett FAtt 35 5 0 30 Nov 2022
Mutual Information Learned Regressor: an Information-theoretic Viewpoint of Training Regression Systems Jirong Yi Q. Zhang Zhengbo Chen Qiaoan Liu Weizhuo Shao Yusen He Yao Wang SSL 28 0 0 23 Nov 2022
Characterizing information loss in a chaotic double pendulum with the Information Bottleneck Kieran A. Murphy Danielle Bassett 13 0 0 25 Oct 2022
Greedy Modality Selection via Approximate Submodular Maximization Runxiang Cheng Gargi Balasubramaniam Yifei He Yao-Hung Hubert Tsai Han Zhao 21 1 0 22 Oct 2022
Unsupervised Few-shot Learning via Deep Laplacian Eigenmaps Kuilin Chen Chi-Guhn Lee SSL 40 3 0 07 Oct 2022
Mutual Information Learned Classifiers: an Information-theoretic Viewpoint of Training Deep Learning Classification Systems Jirong Yi Q. Zhang Zhenji Chen Qiaoan Liu Weizhuo Shao SSL FedML 34 3 0 21 Sep 2022
Dataset Inference for Self-Supervised Models Adam Dziedzic Haonan Duan Muhammad Ahmad Kaleem Nikita Dhawan Jonas Guan Yannis Cattan Franziska Boenisch Nicolas Papernot 32 26 0 16 Sep 2022
RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence Kyungmin Lee Jinwoo Shin SSL DRL 34 10 0 12 Aug 2022
Crosslinguistic word order variation reflects evolutionary pressures of dependency and information locality Michael Hahn Yang Xu 11 18 0 09 Jun 2022
Data-Driven Estimation of Capacity Upper Bounds Christian Hager E. Agrell 33 2 0 13 May 2022
Learning Disentangled Textual Representations via Statistical Measures of Similarity Pierre Colombo Guillaume Staerman Nathan Noiry Pablo Piantanida FaML DRL 38 22 0 07 May 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 25 21 0 14 Feb 2022
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 13 68 0 12 Jan 2022
CLIP-Lite: Information Efficient Visual Representation Learning with Language Supervision A. Shrivastava Ramprasaath R. Selvaraju Nikhil Naik Vicente Ordonez VLM CLIP 30 6 0 14 Dec 2021
MIO : Mutual Information Optimization using Self-Supervised Binary Contrastive Learning Siladittya Manna Umapada Pal Saumik Bhattacharya SSL 35 1 0 24 Nov 2021
Implicit Deep Adaptive Design: Policy-Based Experimental Design without Likelihoods Desi R. Ivanova Adam Foster Steven Kleinegesse Michael U. Gutmann Tom Rainforth OffRL 21 46 0 03 Nov 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp G. Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 207 102 0 21 Oct 2021
The Information Geometry of Unsupervised Reinforcement Learning Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine SSL OffRL 61 31 0 06 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 41 19 0 06 Oct 2021
A Bayesian Framework for Information-Theoretic Probing Tiago Pimentel Ryan Cotterell 28 24 0 08 Sep 2021
X-GOAL: Multiplex Heterogeneous Graph Prototypical Contrastive Learning Baoyu Jing Shengyu Feng Yuejia Xiang Xi Chen Yu Chen Hanghang Tong 41 27 0 08 Sep 2021
Improving Multimodal fusion via Mutual Dependency Maximisation Pierre Colombo E. Chapuis Matthieu Labeau Chloé Clavel 15 30 0 31 Aug 2021
M2IOSR: Maximal Mutual Information Open Set Recognition Xin Sun Henghui Ding Chi Zhang Guosheng Lin K. Ling 23 17 0 05 Aug 2021
Clustering by Maximizing Mutual Information Across Views Kien Do T. Tran Svetha Venkatesh VLM SSL 11 37 0 24 Jul 2021
AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense Duhun Hwang Eunjung Lee Wonjong Rhee AAML 167 14 0 14 Jul 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 24 29 0 25 Jun 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 26 38 0 14 Jun 2021
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping Runshi Liu Pengda Qin Yuhong Li Weigao Wen Dong Li Kefeng Deng Qiang Wu AI4TS 15 0 0 13 Jun 2021
Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs Mohammad Malekzadeh Anastasia Borovykh Deniz Gündüz MIACV 19 42 0 25 May 2021
Tensor networks and efficient descriptions of classical data Sirui Lu Márton Kanász-Nagy I. Kukuljan J. I. Cirac 24 24 0 11 Mar 2021
Of Moments and Matching: A Game-Theoretic Framework for Closing the Imitation Gap Gokul Swamy Sanjiban Choudhury J. Andrew Bagnell Steven Wu 22 73 0 04 Mar 2021