v1v2v3v4 (latest)

Formal Limitations on the Measurement of Mutual Information

10 November 2018

Papers citing "Formal Limitations on the Measurement of Mutual Information"

50 / 180 papers shown

Title
Review-Based Domain Disentanglement without Duplicate Users or Contexts for Cross-Domain Recommendation Yoonhyuk Choi Jiho Choi Taewook Ko HyungHo Byun Qiongxiong Ma 53 16 0 25 Oct 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp Günter Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 314 104 0 21 Oct 2021
Quantifying the Task-Specific Information in Text-Based Classifications Zining Zhu Aparna Balagopalan Marzyeh Ghassemi Frank Rudzicz 76 4 0 17 Oct 2021
The Information Geometry of Unsupervised Reinforcement Learning Benjamin Eysenbach Ruslan Salakhutdinov Sergey Levine SSL OffRL 118 35 0 06 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 84 22 0 06 Oct 2021
Generalization Bounds For Meta-Learning: An Information-Theoretic Analysis Qi Chen Changjian Shui M. Marchand 99 44 0 29 Sep 2021
A Bayesian Framework for Information-Theoretic Probing Tiago Pimentel Ryan Cotterell 79 25 0 08 Sep 2021
X-GOAL: Multiplex Heterogeneous Graph Prototypical Contrastive Learning Baoyu Jing Shengyu Feng Yuejia Xiang Xi Chen Yu Chen Hanghang Tong 204 28 0 08 Sep 2021
Improving Multimodal fusion via Mutual Dependency Maximisation Pierre Colombo E. Chapuis Matthieu Labeau Chloé Clavel 180 31 0 31 Aug 2021
M2IOSR: Maximal Mutual Information Open Set Recognition Xin Sun Henghui Ding Fangqiu Yi Guosheng Lin K. Ling 81 17 0 05 Aug 2021
Active Learning in Gaussian Process State Space Model H. Yu Dingling Yao Christoph Zimmer Marc Toussaint D. Nguyen-Tuong GP 49 4 0 30 Jul 2021
Clustering by Maximizing Mutual Information Across Views Kien Do T. Tran Svetha Venkatesh VLM SSL 60 37 0 24 Jul 2021
AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense Duhun Hwang Eunjung Lee Wonjong Rhee AAML 221 16 0 14 Jul 2021
Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE Junya Chen Zhe Gan Xuan Li Qing Guo Liqun Chen ... Belinda Zeng Wenlian Lu Fan Li Lawrence Carin Chenyang Tao 96 28 0 02 Jul 2021
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization Qing Guo Junya Chen Dong Wang Yuewei Yang Xinwei Deng Lawrence Carin Fan Li Jing-Zheng Huang Chenyang Tao 93 21 0 02 Jul 2021
Leveraging Hidden Structure in Self-Supervised Learning Emanuele Sansone SSL 32 0 0 30 Jun 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 75 30 0 25 Jun 2021
Lossy Compression for Lossless Prediction Yann Dubois Benjamin Bloem-Reddy Karen Ullrich Chris J. Maddison 145 62 0 21 Jun 2021
Neural Network Classifier as Mutual Information Evaluator Zhenyue Qin Dongwoo Kim Tom Gedeon 32 2 0 19 Jun 2021
A Probabilistic Representation of DNNs: Bridging Mutual Information and Generalization Xinjie Lan Kenneth Barner 48 1 0 18 Jun 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 77 39 0 14 Jun 2021
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping Runshi Liu Pengda Qin Yuhong Li Weigao Wen Dong Li Kefeng Deng Qiang Wu AI4TS 56 1 0 13 Jun 2021
CLCC: Contrastive Learning for Color Constancy Yi-Chen Lo Chia-Che Chang Hsuan-Chao Chiu Yu-Hao Huang Chia-Ping Chen Yu-Lin Chang Kevin Jou 78 50 0 09 Jun 2021
TVDIM: Enhancing Image Self-Supervised Pretraining via Noisy Text Data Pengda Qin Yuhong Li Kefeng Deng Qiang Wu 30 1 0 03 Jun 2021
Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs Mohammad Malekzadeh Anastasia Borovykh Deniz Gündüz MIACV 87 42 0 25 May 2021
Deep Data Density Estimation through Donsker-Varadhan Representation Seonho Park P. Pardalos BDL 22 6 0 14 Apr 2021
Finding Concept-specific Biases in Form--Meaning Associations Tiago Pimentel Brian Roark S. Wichmann Ryan Cotterell Damián E. Blasi 49 6 0 13 Apr 2021
Self-supervised Representation Learning with Relative Predictive Coding Yao-Hung Hubert Tsai Martin Q. Ma Muqiao Yang Han Zhao Louis-Philippe Morency Ruslan Salakhutdinov SSL AI4TS 101 38 0 21 Mar 2021
A Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models Jiaxin Zhang Sirui Bi Guannan Zhang 63 9 0 14 Mar 2021
Tensor networks and efficient descriptions of classical data Sirui Lu Márton Kanász-Nagy I. Kukuljan J. I. Cirac 49 26 0 11 Mar 2021
Continual Density Ratio Estimation in an Online Setting Yu Chen Song Liu Tom Diethe Peter A. Flach 34 1 0 09 Mar 2021
Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularization Jizong Peng M. Pedersoli Christian Desrosiers SSL 82 21 0 08 Mar 2021
Of Moments and Matching: A Game-Theoretic Framework for Closing the Imitation Gap Gokul Swamy Sanjiban Choudhury J. Andrew Bagnell Steven Wu 79 79 0 04 Mar 2021
MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approach Yves-Laurent Kom Samo 40 8 0 25 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 132 46 0 13 Feb 2021
Shape or Texture: Understanding Discriminative Features in CNNs Md. Amirul Islam M. Kowal Patrick Esser Sen Jia Bjorn Ommer Konstantinos G. Derpanis Neil D. B. Bruce 91 77 0 27 Jan 2021
Neural Joint Entropy Estimation Yuval Shalev Amichai Painsky I. Ben-Gal 90 8 0 21 Dec 2020
Wasserstein Contrastive Representation Distillation Liqun Chen Dong Wang Zhe Gan Jingjing Liu Ricardo Henao Lawrence Carin 89 96 0 15 Dec 2020
Disentangling Label Distribution for Long-tailed Visual Recognition Youngkyu Hong Seungju Han Kwanghee Choi Seokjun Seo Beomsu Kim Buru Chang 89 238 0 01 Dec 2020
Reducing the Variance of Variational Estimates of Mutual Information by Limiting the Critic's Hypothesis Space to RKHS P. A. Sreekar Ujjwal Tiwari A. Namboodiri 39 2 0 17 Nov 2020
Combating the Instability of Mutual Information-based Losses via Regularization Kwanghee Choi Siyeong Lee AAML 62 4 0 16 Nov 2020
Bottleneck Problems: Information and Estimation-Theoretic View S. Asoodeh Flavio du Pin Calmon 37 18 0 12 Nov 2020
Image Clustering using an Augmented Generative Adversarial Network and Information Maximization Foivos Ntelemis Yaochu Jin S. Thomas GAN 81 13 0 08 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 81 177 0 05 Nov 2020
No MCMC for me: Amortized sampling for fast and stable training of energy-based models Will Grathwohl Jacob Kelly Milad Hashemi Mohammad Norouzi Kevin Swersky David Duvenaud 120 72 0 08 Oct 2020
Representation Learning for Sequence Data with Deep Autoencoding Predictive Components Junwen Bai Weiran Wang Yingbo Zhou Caiming Xiong SSL AI4TS 75 12 0 07 Oct 2020
DEMI: Discriminative Estimator of Mutual Information Ruizhi Liao Daniel Moyer Polina Golland W. Wells DRL 74 5 0 05 Oct 2020
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 122 43 0 27 Sep 2020
Evaluating representations by the complexity of learning low-loss predictors William F. Whitney M. Song David Brandfonbrener Jaan Altosaar Kyunghyun Cho 83 24 0 15 Sep 2020
Active Contrastive Learning of Audio-Visual Video Representations Shuang Ma Zhaoyang Zeng Daniel J. McDuff Yale Song VLM SSL 60 8 0 31 Aug 2020