ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1811.04251
  4. Cited By
Formal Limitations on the Measurement of Mutual Information
v1v2v3v4 (latest)

Formal Limitations on the Measurement of Mutual Information

10 November 2018
David A. McAllester
K. Stratos
    SSL
ArXiv (abs)PDFHTML

Papers citing "Formal Limitations on the Measurement of Mutual Information"

50 / 180 papers shown
Title
Review-Based Domain Disentanglement without Duplicate Users or Contexts
  for Cross-Domain Recommendation
Review-Based Domain Disentanglement without Duplicate Users or Contexts for Cross-Domain Recommendation
Yoonhyuk Choi
Jiho Choi
Taewook Ko
HyungHo Byun
Qiongxiong Ma
53
16
0
25 Oct 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP
Andreas Fürst
Elisabeth Rumetshofer
Johannes Lehner
Viet-Hung Tran
Fei Tang
...
David P. Kreil
Michael K Kopp
Günter Klambauer
Angela Bitto-Nemling
Sepp Hochreiter
VLMCLIP
314
104
0
21 Oct 2021
Quantifying the Task-Specific Information in Text-Based Classifications
Quantifying the Task-Specific Information in Text-Based Classifications
Zining Zhu
Aparna Balagopalan
Marzyeh Ghassemi
Frank Rudzicz
76
4
0
17 Oct 2021
The Information Geometry of Unsupervised Reinforcement Learning
The Information Geometry of Unsupervised Reinforcement Learning
Benjamin Eysenbach
Ruslan Salakhutdinov
Sergey Levine
SSLOffRL
118
35
0
06 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses
On the Surrogate Gap between Contrastive and Supervised Losses
Han Bao
Yoshihiro Nagano
Kento Nozawa
SSLUQCV
84
22
0
06 Oct 2021
Generalization Bounds For Meta-Learning: An Information-Theoretic
  Analysis
Generalization Bounds For Meta-Learning: An Information-Theoretic Analysis
Qi Chen
Changjian Shui
M. Marchand
99
44
0
29 Sep 2021
A Bayesian Framework for Information-Theoretic Probing
A Bayesian Framework for Information-Theoretic Probing
Tiago Pimentel
Ryan Cotterell
79
25
0
08 Sep 2021
X-GOAL: Multiplex Heterogeneous Graph Prototypical Contrastive Learning
X-GOAL: Multiplex Heterogeneous Graph Prototypical Contrastive Learning
Baoyu Jing
Shengyu Feng
Yuejia Xiang
Xi Chen
Yu Chen
Hanghang Tong
204
28
0
08 Sep 2021
Improving Multimodal fusion via Mutual Dependency Maximisation
Improving Multimodal fusion via Mutual Dependency Maximisation
Pierre Colombo
E. Chapuis
Matthieu Labeau
Chloé Clavel
180
31
0
31 Aug 2021
M2IOSR: Maximal Mutual Information Open Set Recognition
M2IOSR: Maximal Mutual Information Open Set Recognition
Xin Sun
Henghui Ding
Fangqiu Yi
Guosheng Lin
K. Ling
81
17
0
05 Aug 2021
Active Learning in Gaussian Process State Space Model
Active Learning in Gaussian Process State Space Model
H. Yu
Dingling Yao
Christoph Zimmer
Marc Toussaint
D. Nguyen-Tuong
GP
49
4
0
30 Jul 2021
Clustering by Maximizing Mutual Information Across Views
Clustering by Maximizing Mutual Information Across Views
Kien Do
T. Tran
Svetha Venkatesh
VLMSSL
60
37
0
24 Jul 2021
AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense
AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense
Duhun Hwang
Eunjung Lee
Wonjong Rhee
AAML
221
16
0
14 Jul 2021
Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive
  Learners With FlatNCE
Simpler, Faster, Stronger: Breaking The log-K Curse On Contrastive Learners With FlatNCE
Junya Chen
Zhe Gan
Xuan Li
Qing Guo
Liqun Chen
...
Belinda Zeng
Wenlian Lu
Fan Li
Lawrence Carin
Chenyang Tao
96
28
0
02 Jul 2021
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre
  Optimization
Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimization
Qing Guo
Junya Chen
Dong Wang
Yuewei Yang
Xinwei Deng
Lawrence Carin
Fan Li
Jing-Zheng Huang
Chenyang Tao
93
21
0
02 Jul 2021
Leveraging Hidden Structure in Self-Supervised Learning
Leveraging Hidden Structure in Self-Supervised Learning
Emanuele Sansone
SSL
32
0
0
30 Jun 2021
Decomposed Mutual Information Estimation for Contrastive Representation
  Learning
Decomposed Mutual Information Estimation for Contrastive Representation Learning
Alessandro Sordoni
Nouha Dziri
Hannes Schulz
Geoffrey J. Gordon
Philip Bachman
Rémi Tachet des Combes
SSL
75
30
0
25 Jun 2021
Lossy Compression for Lossless Prediction
Lossy Compression for Lossless Prediction
Yann Dubois
Benjamin Bloem-Reddy
Karen Ullrich
Chris J. Maddison
145
62
0
21 Jun 2021
Neural Network Classifier as Mutual Information Evaluator
Neural Network Classifier as Mutual Information Evaluator
Zhenyue Qin
Dongwoo Kim
Tom Gedeon
32
2
0
19 Jun 2021
A Probabilistic Representation of DNNs: Bridging Mutual Information and
  Generalization
A Probabilistic Representation of DNNs: Bridging Mutual Information and Generalization
Xinjie Lan
Kenneth Barner
48
1
0
18 Jun 2021
Which Mutual-Information Representation Learning Objectives are
  Sufficient for Control?
Which Mutual-Information Representation Learning Objectives are Sufficient for Control?
Kate Rakelly
Abhishek Gupta
Carlos Florensa
Sergey Levine
SSL
77
39
0
14 Jun 2021
InfoBehavior: Self-supervised Representation Learning for Ultra-long
  Behavior Sequence via Hierarchical Grouping
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping
Runshi Liu
Pengda Qin
Yuhong Li
Weigao Wen
Dong Li
Kefeng Deng
Qiang Wu
AI4TS
56
1
0
13 Jun 2021
CLCC: Contrastive Learning for Color Constancy
CLCC: Contrastive Learning for Color Constancy
Yi-Chen Lo
Chia-Che Chang
Hsuan-Chao Chiu
Yu-Hao Huang
Chia-Ping Chen
Yu-Lin Chang
Kevin Jou
78
50
0
09 Jun 2021
TVDIM: Enhancing Image Self-Supervised Pretraining via Noisy Text Data
TVDIM: Enhancing Image Self-Supervised Pretraining via Noisy Text Data
Pengda Qin
Yuhong Li
Kefeng Deng
Qiang Wu
30
1
0
03 Jun 2021
Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be
  Secretly Coded into the Classifiers' Outputs
Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs
Mohammad Malekzadeh
Anastasia Borovykh
Deniz Gündüz
MIACV
87
42
0
25 May 2021
Deep Data Density Estimation through Donsker-Varadhan Representation
Deep Data Density Estimation through Donsker-Varadhan Representation
Seonho Park
P. Pardalos
BDL
22
6
0
14 Apr 2021
Finding Concept-specific Biases in Form--Meaning Associations
Finding Concept-specific Biases in Form--Meaning Associations
Tiago Pimentel
Brian Roark
S. Wichmann
Ryan Cotterell
Damián E. Blasi
49
6
0
13 Apr 2021
Self-supervised Representation Learning with Relative Predictive Coding
Self-supervised Representation Learning with Relative Predictive Coding
Yao-Hung Hubert Tsai
Martin Q. Ma
Muqiao Yang
Han Zhao
Louis-Philippe Morency
Ruslan Salakhutdinov
SSLAI4TS
101
38
0
21 Mar 2021
A Scalable Gradient-Free Method for Bayesian Experimental Design with
  Implicit Models
A Scalable Gradient-Free Method for Bayesian Experimental Design with Implicit Models
Jiaxin Zhang
Sirui Bi
Guannan Zhang
63
9
0
14 Mar 2021
Tensor networks and efficient descriptions of classical data
Tensor networks and efficient descriptions of classical data
Sirui Lu
Márton Kanász-Nagy
I. Kukuljan
J. I. Cirac
49
26
0
11 Mar 2021
Continual Density Ratio Estimation in an Online Setting
Continual Density Ratio Estimation in an Online Setting
Yu Chen
Song Liu
Tom Diethe
Peter A. Flach
34
1
0
09 Mar 2021
Boosting Semi-supervised Image Segmentation with Global and Local Mutual
  Information Regularization
Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularization
Jizong Peng
M. Pedersoli
Christian Desrosiers
SSL
82
21
0
08 Mar 2021
Of Moments and Matching: A Game-Theoretic Framework for Closing the
  Imitation Gap
Of Moments and Matching: A Game-Theoretic Framework for Closing the Imitation Gap
Gokul Swamy
Sanjiban Choudhury
J. Andrew Bagnell
Steven Wu
79
79
0
04 Mar 2021
MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy
  Copula Approach
MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approach
Yves-Laurent Kom Samo
40
8
0
25 Feb 2021
Understanding Negative Samples in Instance Discriminative
  Self-supervised Representation Learning
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning
Kento Nozawa
Issei Sato
SSL
132
46
0
13 Feb 2021
Shape or Texture: Understanding Discriminative Features in CNNs
Shape or Texture: Understanding Discriminative Features in CNNs
Md. Amirul Islam
M. Kowal
Patrick Esser
Sen Jia
Bjorn Ommer
Konstantinos G. Derpanis
Neil D. B. Bruce
91
77
0
27 Jan 2021
Neural Joint Entropy Estimation
Neural Joint Entropy Estimation
Yuval Shalev
Amichai Painsky
I. Ben-Gal
90
8
0
21 Dec 2020
Wasserstein Contrastive Representation Distillation
Wasserstein Contrastive Representation Distillation
Liqun Chen
Dong Wang
Zhe Gan
Jingjing Liu
Ricardo Henao
Lawrence Carin
89
96
0
15 Dec 2020
Disentangling Label Distribution for Long-tailed Visual Recognition
Disentangling Label Distribution for Long-tailed Visual Recognition
Youngkyu Hong
Seungju Han
Kwanghee Choi
Seokjun Seo
Beomsu Kim
Buru Chang
89
238
0
01 Dec 2020
Reducing the Variance of Variational Estimates of Mutual Information by
  Limiting the Critic's Hypothesis Space to RKHS
Reducing the Variance of Variational Estimates of Mutual Information by Limiting the Critic's Hypothesis Space to RKHS
P. A. Sreekar
Ujjwal Tiwari
A. Namboodiri
39
2
0
17 Nov 2020
Combating the Instability of Mutual Information-based Losses via
  Regularization
Combating the Instability of Mutual Information-based Losses via Regularization
Kwanghee Choi
Siyeong Lee
AAML
62
4
0
16 Nov 2020
Bottleneck Problems: Information and Estimation-Theoretic View
Bottleneck Problems: Information and Estimation-Theoretic View
S. Asoodeh
Flavio du Pin Calmon
37
18
0
12 Nov 2020
Image Clustering using an Augmented Generative Adversarial Network and
  Information Maximization
Image Clustering using an Augmented Generative Adversarial Network and Information Maximization
Foivos Ntelemis
Yaochu Jin
S. Thomas
GAN
81
13
0
08 Nov 2020
Intriguing Properties of Contrastive Losses
Intriguing Properties of Contrastive Losses
Ting Chen
Calvin Luo
Lala Li
81
177
0
05 Nov 2020
No MCMC for me: Amortized sampling for fast and stable training of
  energy-based models
No MCMC for me: Amortized sampling for fast and stable training of energy-based models
Will Grathwohl
Jacob Kelly
Milad Hashemi
Mohammad Norouzi
Kevin Swersky
David Duvenaud
120
72
0
08 Oct 2020
Representation Learning for Sequence Data with Deep Autoencoding
  Predictive Components
Representation Learning for Sequence Data with Deep Autoencoding Predictive Components
Junwen Bai
Weiran Wang
Yingbo Zhou
Caiming Xiong
SSLAI4TS
75
12
0
07 Oct 2020
DEMI: Discriminative Estimator of Mutual Information
DEMI: Discriminative Estimator of Mutual Information
Ruizhi Liao
Daniel Moyer
Polina Golland
W. Wells
DRL
74
5
0
05 Oct 2020
Learning Optimal Representations with the Decodable Information
  Bottleneck
Learning Optimal Representations with the Decodable Information Bottleneck
Yann Dubois
Douwe Kiela
D. Schwab
Ramakrishna Vedantam
122
43
0
27 Sep 2020
Evaluating representations by the complexity of learning low-loss
  predictors
Evaluating representations by the complexity of learning low-loss predictors
William F. Whitney
M. Song
David Brandfonbrener
Jaan Altosaar
Kyunghyun Cho
83
24
0
15 Sep 2020
Active Contrastive Learning of Audio-Visual Video Representations
Active Contrastive Learning of Audio-Visual Video Representations
Shuang Ma
Zhaoyang Zeng
Daniel J. McDuff
Yale Song
VLMSSL
60
8
0
31 Aug 2020
Previous
1234
Next