On Mutual Information Maximization for Representation Learning

31 July 2019

Michael Tschannen

Josip Djolonga

Paul Kishan Rubenstein

Papers citing "On Mutual Information Maximization for Representation Learning"

50 / 152 papers shown

Title
Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive Lirong Wu Haitao Lin Zhangyang Gao Cheng Tan Stan.Z.Li SSL 30 241 0 16 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 42 12 0 08 May 2021
Dual Contrastive Loss and Attention for GANs Ning Yu Guilin Liu Aysegül Dündar Andrew Tao Bryan Catanzaro Larry S. Davis Mario Fritz GAN 34 60 0 31 Mar 2021
Explaining Representation by Mutual Information Li Gu SSL FAtt 37 0 0 28 Mar 2021
Unsupervised Two-Stage Anomaly Detection Yunfei Liu Chaoqun Zhuang Feng Lu 39 29 0 22 Mar 2021
Tensor networks and efficient descriptions of classical data Sirui Lu Márton Kanász-Nagy I. Kukuljan J. I. Cirac 24 24 0 11 Mar 2021
CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network Lili Pan Peijun Tang Zhiyong Chen Zenglin Xu GAN DRL 18 6 0 05 Mar 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 96 91 0 25 Feb 2021
Self-Supervised Learning of Graph Neural Networks: A Unified Review Yaochen Xie Zhao Xu Jingtun Zhang Zhengyang Wang Shuiwang Ji SSL 41 325 0 22 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 209 0 17 Feb 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 22 43 0 13 Feb 2021
Disentangled Recurrent Wasserstein Autoencoder Jun Han Martin Renqiang Min Ligong Han Erran L. Li Xuan Zhang CoGe SyDa DRL 29 33 0 19 Jan 2021
Addressing Feature Suppression in Unsupervised Visual Representations Tianhong Li Lijie Fan Yuan. Yuan Hao He Yonglong Tian Rogerio Feris Piotr Indyk Dina Katabi SSL 35 15 0 17 Dec 2020
A case for new neural network smoothness constraints Mihaela Rosca T. Weber Arthur Gretton S. Mohamed AAML 35 48 0 14 Dec 2020
Contrastive Learning for Label-Efficient Semantic Segmentation Xiangyu Zhao Raviteja Vemulapalli Philip Mansfield Boqing Gong Bradley Green Lior Shapira Ying Nian Wu SSL SSeg 36 174 0 13 Dec 2020
Unsupervised Adversarially-Robust Representation Learning on Graphs Jiarong Xu Yang Yang Junru Chen Chunping Wang Xin Jiang Jiangang Lu Yizhou Sun SSL AAML OOD 38 36 0 04 Dec 2020
Unsupervised Video Representation Learning by Bidirectional Feature Prediction Nadine Behrmann Juergen Gall M. Noroozi SSL MDE 32 29 0 11 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 36 174 0 05 Nov 2020
Specialization in Hierarchical Learning Systems Heinke Hihn Daniel A. Braun 29 16 0 03 Nov 2020
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 34 1,076 0 27 Oct 2020
Iterative Graph Self-Distillation Hanlin Zhang Shuai Lin Weiyang Liu Pan Zhou Jian Tang Xiaodan Liang Eric Xing SSL 59 33 0 23 Oct 2020
Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustness Long Zhao Ting Liu Xi Peng Dimitris N. Metaxas OOD AAML 27 165 0 15 Oct 2020
Contrastive Representation Learning: A Framework and Review Phúc H. Lê Khắc Graham Healy Alan F. Smeaton SSL AI4TS 184 687 0 10 Oct 2020
Representation Learning for Sequence Data with Deep Autoencoding Predictive Components Junwen Bai Weiran Wang Yingbo Zhou Caiming Xiong SSL AI4TS 27 12 0 07 Oct 2020
EqCo: Equivalent Rules for Self-supervised Contrastive Learning Benjin Zhu Junqiang Huang Zeming Li Xiangyu Zhang Jian Sun SSL 22 13 0 05 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 53 628 0 02 Oct 2020
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 28 43 0 27 Sep 2020
Interest-Behaviour Multiplicative Network for Resource-limited Recommendation Qianliang Wu Tong Zhang Zhen Cui Jian Yang 21 1 0 24 Sep 2020
Contrastive and Generative Graph Convolutional Networks for Graph-based Semi-Supervised Learning Sheng Wan Shirui Pan Jian Yang Chen Gong SSL 22 137 0 15 Sep 2020
Ramifications of Approximate Posterior Inference for Bayesian Deep Learning in Adversarial and Out-of-Distribution Settings John Mitros A. Pakrashi Brian Mac Namee UQCV 26 2 0 03 Sep 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 35 163 0 24 Aug 2020
Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination Xudong Wang Ziwei Liu Stella X. Yu SSL 20 76 0 09 Aug 2020
Autoregressive Unsupervised Image Segmentation Yassine Ouali C´eline Hudelot Myriam Tami SSL 35 86 0 16 Jul 2020
GraphCL: Contrastive Self-Supervised Learning of Graph Representations H. Hafidi Mounir Ghogho P. Ciblat A. Swami SSL 28 53 0 15 Jul 2020
Efficient Empowerment Estimation for Unsupervised Stabilization Ruihan Zhao Kevin Lu Pieter Abbeel Stas Tiomkin 32 8 0 14 Jul 2020
Graph Clustering with Graph Neural Networks Anton Tsitsulin John Palowitch Bryan Perozzi Emmanuel Müller GNN AI4CE 34 259 0 30 Jun 2020
Contrastive learning of global and local features for medical image segmentation with limited annotations K. Chaitanya Ertunc Erdil Neerav Karani E. Konukoglu SSL 30 550 0 18 Jun 2020
Contrastive Learning for Weakly Supervised Phrase Grounding Tanmay Gupta Arash Vahdat Gal Chechik Xiaodong Yang Jan Kautz Derek Hoiem ObjD SSL 42 140 0 17 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 52 1,587 0 15 Jun 2020
Contrastive Multi-View Representation Learning on Graphs Kaveh Hassani Amir Hosein Khas Ahmadi SSL 31 1,275 0 10 Jun 2020
Self-supervised Learning from a Multi-view Perspective Yao-Hung Hubert Tsai Yue Wu Ruslan Salakhutdinov Louis-Philippe Morency SSL 25 30 0 10 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 39 1,308 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 87 956 0 11 May 2020
Mutual Information Gradient Estimation for Representation Learning Liangjiang Wen Yiji Zhou Lirong He Mingyuan Zhou Zenglin Xu DRL SSL 33 27 0 03 May 2020
CURL: Contrastive Unsupervised Representations for Reinforcement Learning A. Srinivas Michael Laskin Pieter Abbeel SSL DRL OffRL 49 1,061 0 08 Apr 2020
Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds Yongming Rao Jiwen Lu Jie Zhou 3DPC 33 131 0 29 Mar 2020
Unpacking Information Bottlenecks: Unifying Information-Theoretic Objectives in Deep Learning Andreas Kirsch Clare Lyle Y. Gal 27 16 0 27 Mar 2020
A unifying mutual information view of metric learning: cross-entropy vs. pairwise losses Malik Boudiaf Jérôme Rony Imtiaz Masud Ziko Eric Granger M. Pedersoli Pablo Piantanida Ismail Ben Ayed SSL 23 158 0 19 Mar 2020
DHOG: Deep Hierarchical Object Grouping L. N. Darlow Amos Storkey 13 7 0 13 Mar 2020
Automatic Shortcut Removal for Self-Supervised Representation Learning Matthias Minderer Olivier Bachem N. Houlsby Michael Tschannen SSL 15 73 0 20 Feb 2020