On Mutual Information Maximization for Representation Learning

31 July 2019

Michael Tschannen

Josip Djolonga

Paul Kishan Rubenstein

Papers citing "On Mutual Information Maximization for Representation Learning"

50 / 152 papers shown

Title
Graph Contrastive Learning with Cross-view Reconstruction Qianlong Wen Z. Ouyang Chunhui Zhang Y. Qian Yanfang Ye Chuxu Zhang SSL 27 6 0 16 Sep 2022
Improving Self-Supervised Learning by Characterizing Idealized Representations Yann Dubois Tatsunori Hashimoto Stefano Ermon Percy Liang SSL 83 41 0 13 Sep 2022
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey Yanbei Chen Massimiliano Mancini Xiatian Zhu Zeynep Akata 45 114 0 24 Aug 2022
Forget-me-not! Contrastive Critics for Mitigating Posterior Collapse Sachit Menon David M. Blei Carl Vondrick DRL 22 6 0 19 Jul 2022
Open-world Semantic Segmentation via Contrasting and Clustering Vision-Language Embedding Quan Liu Youpeng Wen Jianhua Han Chunjing Xu Hang Xu Xiaodan Liang VLM 26 67 0 18 Jul 2022
Factorizing Knowledge in Neural Networks Xingyi Yang Jingwen Ye Xinchao Wang MoMe 47 121 0 04 Jul 2022
Automated Cancer Subtyping via Vector Quantization Mutual Information Maximization Zheng Chen Lingwei Zhu Ziwei Yang Takashi Matsubara 24 7 0 22 Jun 2022
Contrastive Learning as Goal-Conditioned Reinforcement Learning Benjamin Eysenbach Tianjun Zhang Ruslan Salakhutdinov Sergey Levine SSL OffRL 37 141 0 15 Jun 2022
I'm Me, We're Us, and I'm Us: Tri-directional Contrastive Learning on Hypergraphs Dongjin Lee Kijung Shin 38 37 0 09 Jun 2022
Embrace the Gap: VAEs Perform Independent Mechanism Analysis Patrik Reizinger Luigi Gresele Jack Brady Julius von Kügelgen Dominik Zietlow Bernhard Schölkopf Georg Martius Wieland Brendel M. Besserve DRL 35 19 0 06 Jun 2022
Hyperspherical Consistency Regularization Cheng Tan Zhangyang Gao Lirong Wu Siyuan Li Stan Z. Li 36 25 0 02 Jun 2022
Contrasting quadratic assignments for set-based representation learning A. Moskalev Ivan Sosnovik Volker Fischer A. Smeulders SSL 32 9 0 31 May 2022
Contrastive Representation Learning for 3D Protein Structures Pedro Hermosilla Timo Ropinski 3DV 51 51 0 31 May 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 24 4 0 18 Apr 2022
Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning Mayee F. Chen Daniel Y. Fu A. Narayan Michael Zhang Zhao Song Kayvon Fatahalian Christopher Ré SSL 32 48 0 15 Apr 2022
A Unified Contrastive Energy-based Model for Understanding the Generative Ability of Adversarial Training Yifei Wang Yisen Wang Jiansheng Yang Zhouchen Lin AAML 29 13 0 25 Mar 2022
Neural Graph Matching for Pre-training Graph Neural Networks Yupeng Hou Binbin Hu Wayne Xin Zhao Qing Cui Jun Zhou Jianzhong Wen 20 8 0 03 Mar 2022
Audio Self-supervised Learning: A Survey Shuo Liu Adria Mallol-Ragolta Emilia Parada-Cabeleiro Kun Qian Xingshuo Jing Alexander Kathan Bin Hu Bjoern W. Schuller SSL 42 106 0 02 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 27 109 0 28 Feb 2022
Graph Auto-Encoder Via Neighborhood Wasserstein Reconstruction Mingyue Tang Carl Yang Pan Li GNN AI4CE 46 55 0 18 Feb 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 25 21 0 14 Feb 2022
Conditional Contrastive Learning with Kernel Yao-Hung Hubert Tsai Tianqi Li Martin Q. Ma Han Zhao Kun Zhang Louis-Philippe Morency Ruslan Salakhutdinov 27 25 0 11 Feb 2022
CIC: Contrastive Intrinsic Control for Unsupervised Skill Discovery Michael Laskin Hao Liu Xue Bin Peng Denis Yarats Aravind Rajeswaran Pieter Abbeel SSL 78 66 0 01 Feb 2022
Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet? Nenad Tomašev Ioana Bica Brian McWilliams Lars Buesing Razvan Pascanu Charles Blundell Jovana Mitrović SSL 90 81 0 13 Jan 2022
Semantic Feature Extraction for Generalized Zero-shot Learning Junhan Kim Kyuhong Shim B. Shim VLM 27 30 0 29 Dec 2021
Computationally Efficient Approximations for Matrix-based Renyi's Entropy Tieliang Gong Yuxin Dong Shujian Yu B. Dong 67 2 0 27 Dec 2021
How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness? Xinhsuai Dong Anh Tuan Luu Min Lin Shuicheng Yan Hanwang Zhang SILM AAML 20 55 0 22 Dec 2021
RvS: What is Essential for Offline RL via Supervised Learning? Scott Emmons Benjamin Eysenbach Ilya Kostrikov Sergey Levine OffRL 31 170 0 20 Dec 2021
Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applications Karin Stacke Jonas Unger Claes Lundström Gabriel Eilertsen OOD SSL 26 25 0 10 Dec 2021
Unsupervised Representation Learning via Neural Activation Coding Yookoon Park Sangho Lee Gunhee Kim David M. Blei SSL 26 8 0 07 Dec 2021
Encoding Causal Macrovariables Benedikt Höltgen CML 19 3 0 29 Nov 2021
Dual Prototypical Contrastive Learning for Few-shot Semantic Segmentation Hyeongjun Kwon Somi Jeong Sunok Kim Kwanghoon Sohn VLM 32 10 0 09 Nov 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 107 0 01 Nov 2021
MUSE: Feature Self-Distillation with Mutual Information and Self-Information Yunpeng Gong Ye Yu Gaurav Mittal Greg Mori Mei Chen SSL 32 2 0 25 Oct 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp Günter Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 209 102 0 21 Oct 2021
Pre-training Molecular Graph Representation with 3D Geometry Shengchao Liu Hanchen Wang Weiyang Liu Joan Lasenby Hongyu Guo Jian Tang 126 304 0 07 Oct 2021
KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier Linyang Li Demin Song Ruotian Ma Xipeng Qiu Xuanjing Huang 29 21 0 06 Oct 2021
On the Surrogate Gap between Contrastive and Supervised Losses Han Bao Yoshihiro Nagano Kento Nozawa SSL UQCV 41 19 0 06 Oct 2021
Adaptive Multi-layer Contrastive Graph Neural Networks S. Shi Pengfei Xie Xu Luo Kai Qiao Linyuan Wang Jian Chen B. Yan OOD 24 5 0 29 Sep 2021
RGB-D Saliency Detection via Cascaded Mutual Information Minimization Jing Zhang Deng-Ping Fan Yuchao Dai Xin Yu Yiran Zhong Nick Barnes Ling Shao 49 97 0 15 Sep 2021
Learning cortical representations through perturbed and adversarial dreaming Nicolas Deperrois Mihai A. Petrovici Walter Senn Jakob Jordan GAN CLL 58 21 0 09 Sep 2021
ProtoInfoMax: Prototypical Networks with Mutual Information Maximization for Out-of-Domain Detection Iftitahu Ni'mah Meng Fang Vlado Menkovski Mykola Pechenizkiy 35 5 0 27 Aug 2021
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation Xin Wang Yasheng Wang Fei Mi Pingyi Zhou Yao Wan Xiao Liu Li Li Hao Wu Jin Liu Xin Jiang 39 113 0 10 Aug 2021
Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization Rui Qian Yuxi Li Huabin Liu John See Shuangrui Ding Xian Liu Dian Li Weiyao Lin 35 42 0 04 Aug 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 24 30 0 25 Jun 2021
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 29 49 0 18 Jun 2021
Prototypical Graph Contrastive Learning Shuai Lin Pan Zhou Zi-Yuan Hu Shuojia Wang Ruihui Zhao Yefeng Zheng Liang Lin Eric Xing Xiaodan Liang 24 86 0 17 Jun 2021
MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graph Mengying Sun Jing Xing Huijun Wang Bin Chen Jiayu Zhou 24 115 0 05 Jun 2021
Category Contrast for Unsupervised Domain Adaptation in Visual Tasks Jiaxing Huang Dayan Guan Aoran Xiao Shijian Lu Ling Shao CML 37 128 0 05 Jun 2021
TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learning Lu Wang Xiaofu Chang Shuang Li Yunfei Chu Hui Li Wei Zhang Xiaofeng He Le Song Jingren Zhou Hongxia Yang 24 52 0 17 May 2021