Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 633 papers shown

Title
Self-supervised Learning from a Multi-view Perspective Yao-Hung Hubert Tsai Yue Wu Ruslan Salakhutdinov Louis-Philippe Morency SSL 25 30 0 10 Jun 2020
Multi-view Contrastive Learning for Online Knowledge Distillation Chuanguang Yang Zhulin An Yongjun Xu 24 23 0 07 Jun 2020
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations John Giorgi Osvald Nitski Bo Wang Gary D. Bader SSL 39 490 0 05 Jun 2020
Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID Yixiao Ge Feng Zhu Dapeng Chen Rui Zhao Hongsheng Li VLM 33 556 0 04 Jun 2020
TIPRDC: Task-Independent Privacy-Respecting Data Crowdsourcing Framework for Deep Learning with Anonymized Intermediate Representations Ang Li Yixiao Duan Huanrui Yang Yiran Chen Jianlei Yang 21 50 0 23 May 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 39 1,308 0 20 May 2020
Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems Chang Zhou Jianxin Ma Jianwei Zhang Jingren Zhou Hongxia Yang 31 142 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 87 956 0 11 May 2020
Mutual Information Gradient Estimation for Representation Learning Liangjiang Wen Yiji Zhou Lirong He Mingyuan Zhou Zenglin Xu DRL SSL 33 27 0 03 May 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training Linjie Li Yen-Chun Chen Yu Cheng Zhe Gan Licheng Yu Jingjing Liu MLLM VLM OffRL AI4TS 57 494 0 01 May 2020
Alleviating the Incompatibility between Cross Entropy Loss and Episode Training for Few-shot Skin Disease Classification Wei-wei Zhu Haofu Liao Wenbin Li Weijian Li Jiebo Luo 49 17 0 21 Apr 2020
CURL: Contrastive Unsupervised Representations for Reinforcement Learning A. Srinivas Michael Laskin Pieter Abbeel SSL DRL OffRL 49 1,063 0 08 Apr 2020
Discriminator Contrastive Divergence: Semi-Amortized Generative Modeling by Exploring Energy of the Discriminator Yuxuan Song Qiwei Ye Minkai Xu Tie-Yan Liu 25 8 0 05 Apr 2020
Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds Yongming Rao Jiwen Lu Jie Zhou 3DPC 33 131 0 29 Mar 2020
A Survey of Deep Learning for Scientific Discovery M. Raghu Erica Schmidt OOD AI4CE 47 120 0 26 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 246 1,454 0 18 Mar 2020
Watching the World Go By: Representation Learning from Unlabeled Videos Daniel Gordon Kiana Ehsani Dieter Fox Ali Farhadi SSL AI4TS 29 87 0 18 Mar 2020
Mutual Information Maximization for Effective Lip Reading Xingyuan Zhao Shuang Yang Shiguang Shan Xilin Chen 24 58 0 13 Mar 2020
DHOG: Deep Hierarchical Object Grouping L. N. Darlow Amos Storkey 13 7 0 13 Mar 2020
Un-Mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning Zhiqiang Shen Zechun Liu Zhuang Liu Marios Savvides Trevor Darrell Eric P. Xing OCL SSL 32 103 0 11 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 281 3,381 0 09 Mar 2020
Predictive Coding for Locally-Linear Control Rui Shu Tung D. Nguyen Yinlam Chow Tu Pham Khoat Than Mohammad Ghavamzadeh Stefano Ermon Hung Bui OffRL BDL 42 24 0 02 Mar 2020
Out-of-Distribution Generalization via Risk Extrapolation (REx) David M. Krueger Ethan Caballero J. Jacobsen Amy Zhang Jonathan Binas Dinghuai Zhang Rémi Le Priol Aaron Courville OOD 215 908 0 02 Mar 2020
Automatic Shortcut Removal for Self-Supervised Representation Learning Matthias Minderer Olivier Bachem N. Houlsby Michael Tschannen SSL 15 73 0 20 Feb 2020
Convergence of End-to-End Training in Deep Unsupervised Contrastive Learning Zixin Wen SSL 21 2 0 17 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 78 18,362 0 13 Feb 2020
The Conditional Entropy Bottleneck Ian S. Fischer OOD 29 116 0 13 Feb 2020
Subclass Distillation Rafael Müller Simon Kornblith Geoffrey E. Hinton 34 33 0 10 Feb 2020
Graph Representation Learning via Graphical Mutual Information Maximization Zhen Peng Wenbing Huang Minnan Luo Q. Zheng Yu Rong Tingyang Xu Junzhou Huang SSL 49 568 0 04 Feb 2020
Multi-task self-supervised learning for Robust Speech Recognition Mirco Ravanelli Jianyuan Zhong Santiago Pascual P. Swietojanski João Monteiro J. Trmal Yoshua Bengio SSL 189 288 0 25 Jan 2020
Learning Representations by Maximizing Mutual Information in Variational Autoencoders Ali Lotfi-Rezaabad S. Vishwanath DRL SSL 22 39 0 21 Dec 2019
Predictive Coding for Boosting Deep Reinforcement Learning with Sparse Rewards Xingyu Lu Stas Tiomkin Pieter Abbeel OffRL 39 4 0 21 Dec 2019
Locality and compositionality in zero-shot learning Tristan Sylvain Linda Petrini R. Devon Hjelm 24 56 0 20 Dec 2019
ClusterFit: Improving Generalization of Visual Representations Xueting Yan Ishan Misra Abhinav Gupta Deepti Ghadiyaram D. Mahajan SSL VLM 27 132 0 06 Dec 2019
Self-Supervised Learning of Video-Induced Visual Invariances Michael Tschannen Josip Djolonga Marvin Ritter Aravindh Mahendran Xiaohua Zhai N. Houlsby Sylvain Gelly Mario Lucic SSL 18 61 0 05 Dec 2019
Deep Verifier Networks: Verification of Deep Discriminative Models with Deep Generative Models Tong Che Xiaofeng Liu Site Li Yubin Ge Ruixiang Zhang Caiming Xiong Yoshua Bengio 38 52 0 18 Nov 2019
Unsupervised Attributed Multiplex Network Embedding Chanyoung Park Donghyun Kim Jiawei Han Hwanjo Yu 35 249 0 15 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 50 11,882 0 13 Nov 2019
Contrastive Multi-document Question Generation W. Cho Yizhe Zhang Sudha Rao Asli Celikyilmaz Chenyan Xiong Jianfeng Gao Mengdi Wang Bill Dolan SyDa 27 28 0 08 Nov 2019
Conditional Mutual Information Neural Estimator Sina Molavipour Germán Bassi Mikael Skoglund 24 14 0 06 Nov 2019
Adversarial Fisher Vectors for Unsupervised Representation Learning Shuangfei Zhai Walter A. Talbott Carlos Guestrin J. Susskind GAN 22 9 0 29 Oct 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 49 1,034 0 23 Oct 2019
Bridging the Gap Between $f$ -GANs and Wasserstein GANs Jiaming Song Stefano Ermon 25 40 0 22 Oct 2019
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 226 166 0 18 Oct 2019
Understanding the Limitations of Variational Mutual Information Estimators Jiaming Song Stefano Ermon SSL DRL 16 202 0 14 Oct 2019
When Does Self-supervision Improve Few-shot Learning? Jong-Chyi Su Subhransu Maji B. Hariharan 31 168 0 08 Oct 2019
High Mutual Information in Representation Learning with Symmetric Variational Inference M. Livne Kevin Swersky David J. Fleet SSL DRL 36 0 0 04 Oct 2019
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Xiaohua Zhai J. Puigcerver Alexander Kolesnikov P. Ruyssen C. Riquelme ... Michael Tschannen Marcin Michalski Olivier Bousquet Sylvain Gelly N. Houlsby SSL 30 426 0 01 Oct 2019
How to Write Summaries with Patterns? Learning towards Abstractive Summarization through Prototype Editing Shen Gao Preslav Nakov Piji Li Zhangming Chan Dongyan Zhao Rui Yan 24 30 0 19 Sep 2019
BottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principle Peter West Ari Holtzman Jan Buys Yejin Choi SSL 24 58 0 16 Sep 2019