Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 634 papers shown

Title
Object discovery and representation networks Olivier J. Hénaff Skanda Koppula Evan Shelhamer Daniel Zoran Andrew Jaegle Andrew Zisserman João Carreira Relja Arandjelović 44 87 0 16 Mar 2022
MetAug: Contrastive Learning via Meta Feature Augmentation Jiangmeng Li Jingyao Wang Changwen Zheng Fuchun Sun Hui Xiong 37 23 0 10 Mar 2022
Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective Quan Cui Bingchen Zhao Zhao-Min Chen Borui Zhao Renjie Song Jiajun Liang Boyan Zhou Osamu Yoshie 24 18 0 08 Mar 2022
Audio Self-supervised Learning: A Survey Shuo Liu Adria Mallol-Ragolta Emilia Parada-Cabeleiro Kun Qian Xingshuo Jing Alexander Kathan Bin Hu Bjoern W. Schuller SSL 45 106 0 02 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 29 109 0 28 Feb 2022
Efficient Attribute Unlearning: Towards Selective Removal of Input Attributes from Feature Representations Tao Guo Song Guo Jiewei Zhang Wenchao Xu Junxiao Wang MU 32 18 0 27 Feb 2022
Vision-Language Pre-Training with Triple Contrastive Learning Jinyu Yang Jiali Duan Son N. Tran Yi Xu Sampath Chanda Liqun Chen Belinda Zeng Trishul Chilimbi Junzhou Huang VLM 46 289 0 21 Feb 2022
Task-Agnostic Graph Explanations Yaochen Xie S. Katariya Xianfeng Tang E-Wen Huang Nikhil S. Rao Karthik Subbian Shuiwang Ji 51 25 0 16 Feb 2022
A Differential Entropy Estimator for Training Neural Networks Georg Pichler Pierre Colombo Malik Boudiaf Günther Koliander Pablo Piantanida 25 21 0 14 Feb 2022
Conditional Contrastive Learning with Kernel Yao-Hung Hubert Tsai Tianqi Li Martin Q. Ma Han Zhao Kun Zhang Louis-Philippe Morency Ruslan Salakhutdinov 27 25 0 11 Feb 2022
Multimodal Audio-Visual Information Fusion using Canonical-Correlated Graph Neural Network for Energy-Efficient Speech Enhancement L. A. Passos João Paulo Papa Javier Del Ser Amir Hussain Ahsan Adeel 27 35 0 09 Feb 2022
Learning Representation from Neural Fisher Kernel with Low-rank Approximation Ruixiang Zhang Shuangfei Zhai Etai Littwin J. Susskind SSL 36 3 0 04 Feb 2022
Efficient Embedding of Semantic Similarity in Control Policies via Entangled Bisimulation Martín Bertrán Walter A. Talbott Nitish Srivastava J. Susskind 47 3 0 28 Jan 2022
Informative Pseudo-Labeling for Graph Neural Networks with Few Labels Yayong Li Jie Yin Ling-Hao Chen 27 33 0 20 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Eric Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 16 68 0 12 Jan 2022
Sound and Visual Representation Learning with Multiple Pretraining Tasks A. Vasudevan Dengxin Dai Luc Van Gool SSL 38 6 0 04 Jan 2022
Representation Learning via Consistent Assignment of Views to Clusters T. Silva Adín Ramirez Rivera SSL 19 8 0 31 Dec 2021
Disentanglement and Generalization Under Correlation Shifts Christina M. Funke Paul Vicol Kuan-Chieh Jackson Wang Matthias Kümmerer R. Zemel Matthias Bethge OOD 39 7 0 29 Dec 2021
Computationally Efficient Approximations for Matrix-based Renyi's Entropy Tieliang Gong Yuxin Dong Shujian Yu B. Dong 72 2 0 27 Dec 2021
How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness? Xinhsuai Dong Anh Tuan Luu Min Lin Shuicheng Yan Hanwang Zhang SILM AAML 25 55 0 22 Dec 2021
Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentation K. Chaitanya Ertunc Erdil Neerav Karani E. Konukoglu SSL 22 121 0 17 Dec 2021
Semantic-Based Few-Shot Learning by Interactive Psychometric Testing Lu Yin Vlado Menkovski Yulong Pei Mykola Pechenizkiy 27 1 0 16 Dec 2021
CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising Jianjie Luo Yehao Li Yingwei Pan Ting Yao Hongyang Chao Tao Mei VLM 18 41 0 14 Dec 2021
CLIP-Lite: Information Efficient Visual Representation Learning with Language Supervision A. Shrivastava Ramprasaath R. Selvaraju Nikhil Naik Vicente Ordonez VLM CLIP 30 6 0 14 Dec 2021
Multi-Modal Mutual Information Maximization: A Novel Approach for Unsupervised Deep Cross-Modal Hashing Tuan Hoang Thanh-Toan Do Tam V. Nguyen Ngai-man Cheung 22 26 0 13 Dec 2021
Semi-Supervised Contrastive Learning for Remote Sensing: Identifying Ancient Urbanization in the South Central Andes Jiachen Xu Junlin Guo James Zimmer-Dauphinee Quan Liu Yuxuan Shi Zuhayr Asad D. Mitchell Wilkes Parker VanValkenburgh Steven A. Wernke Yuankai Huo SSL 24 2 0 13 Dec 2021
Self-Supervised Modality-Aware Multiple Granularity Pre-Training for RGB-Infrared Person Re-Identification Lin Wan Qianyan Jing Zongyuan Sun Chuan Zhang Zhihang Li Yehansen Chen SSL 17 5 0 12 Dec 2021
A Unified Framework for Multi-distribution Density Ratio Estimation Lantao Yu Yujia Jin Stefano Ermon 21 4 0 07 Dec 2021
Joint Learning of Localized Representations from Medical Images and Reports Philipp Muller Georgios Kaissis Cong Zou Daniel Munich 140 81 0 06 Dec 2021
Representation Learning for Conversational Data using Discourse Mutual Information Maximization Bishal Santra Sumegh Roychowdhury Aishik Mandal Vasu Gurram Atharva Naik Manish Gupta Pawan Goyal SSL 27 4 0 04 Dec 2021
GANORCON: Are Generative Models Useful for Few-shot Segmentation? Oindrila Saha Zezhou Cheng Subhransu Maji 47 17 0 01 Dec 2021
CLAWS: Contrastive Learning with hard Attention and Weak Supervision Jansel Herrera-Gerena Ramakrishnan Sundareswaran John Just Matthew J. Darr Ali Jannesari SSL 43 2 0 01 Dec 2021
Molecular Contrastive Learning with Chemical Element Knowledge Graph Yin Fang Qiang Zhang Haihong Yang Xiang Zhuang Shumin Deng Wen Zhang Minghai Qin Zhuo Chen Xiaohui Fan Huajun Chen 15 109 0 01 Dec 2021
MC-SSL0.0: Towards Multi-Concept Self-Supervised Learning Sara Atito Muhammad Awais Ammarah Farooq Zhenhua Feng J. Kittler 19 17 0 30 Nov 2021
A Practical Contrastive Learning Framework for Single-Image Super-Resolution Gang Wu Junjun Jiang Xianming Liu 49 50 0 27 Nov 2021
Data Invariants to Understand Unsupervised Out-of-Distribution Detection Lars Doorenbos Raphael Sznitman Pablo Márquez-Neila OODD 27 6 0 26 Nov 2021
Causality-inspired Single-source Domain Generalization for Medical Image Segmentation Cheng Ouyang Chen Chen Surui Li Zeju Li C. Qin Wenjia Bai Daniel Rueckert OOD 37 156 0 24 Nov 2021
Towards Graph Self-Supervised Learning with Contrastive Adjusted Zooming Yizhen Zheng Ming Jin Shirui Pan Yuan-Fang Li Hao Peng Ming Li Zhao‐Rui Li SSL 38 24 0 20 Nov 2021
Discovering and Explaining the Representation Bottleneck of DNNs Huiqi Deng Qihan Ren Hao Zhang Quanshi Zhang 42 59 0 11 Nov 2021
Dual Prototypical Contrastive Learning for Few-shot Semantic Segmentation Hyeongjun Kwon Somi Jeong Sunok Kim Kwanghoon Sohn VLM 37 10 0 09 Nov 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 23 108 0 01 Nov 2021
Barlow Graph Auto-Encoder for Unsupervised Network Embedding R. A. Khan M. Kleinsteuber SSL 25 3 0 29 Oct 2021
Self-Supervised Learning Disentangled Group Representation as Feature Tan Wang Zhongqi Yue Jianqiang Huang Qianru Sun Hanwang Zhang OOD 36 67 0 28 Oct 2021
Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning Aakash Kaku Sahana Upadhya N. Razavian SSL 21 29 0 27 Oct 2021
Contrastive Learning for Neural Topic Model Thong Nguyen A. Luu 31 56 0 25 Oct 2021
CLLD: Contrastive Learning with Label Distance for Text Classification Jinhe Lan Qingyuan Zhan Chenhao Jiang Kunping Yuan Desheng Wang VLM 34 2 0 25 Oct 2021
MUSE: Feature Self-Distillation with Mutual Information and Self-Information Yunpeng Gong Ye Yu Gaurav Mittal Greg Mori Mei Chen SSL 32 2 0 25 Oct 2021
Learning Speaker Representation with Semi-supervised Learning approach for Speaker Profiling Shangeth Rajaa Pham Van Tung Chng Eng Siong 43 5 0 24 Oct 2021
Contrastively Disentangled Sequential Variational Autoencoder M. Kiener Weiran Wang Michael Gerndt CoGe DRL 34 40 0 22 Oct 2021