Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 634 papers shown

Title
Towards quantifying information flows: relative entropy in deep neural networks and the renormalization group J. Erdmenger Kevin T. Grosvenor R. Jefferson 57 17 0 14 Jul 2021
AID-Purifier: A Light Auxiliary Network for Boosting Adversarial Defense Duhun Hwang Eunjung Lee Wonjong Rhee AAML 167 15 0 14 Jul 2021
Hierarchical Self-Supervised Learning for Medical Image Segmentation Based on Multi-Domain Data Aggregation Hao Zheng Jun Han Hongxiao Wang Lin Yang Zhuo Zhao Chaoli Wang Danny Chen 29 23 0 10 Jul 2021
Joint Embedding of Structural and Functional Brain Networks with Graph Neural Networks for Mental Illness Diagnosis Yanqiao Zhu Hejie Cui Lifang He Lichao Sun Carl Yang 28 38 0 07 Jul 2021
SelfCF: A Simple Framework for Self-supervised Collaborative Filtering Xin Zhou Aixin Sun Yong Liu Jie Zhang Chunyan Miao SSL 36 77 0 07 Jul 2021
Self-Contrastive Learning with Hard Negative Sampling for Self-supervised Point Cloud Learning Bianli Du Xiang Gao Wei Hu Xin Li 3DPC SSL 20 81 0 05 Jul 2021
SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption Dara Bahri Heinrich Jiang Yi Tay Donald Metzler SSL 26 164 0 29 Jun 2021
Time-Series Representation Learning via Temporal and Contextual Contrasting Emadeldeen Eldele Mohamed Ragab Zhenghua Chen Min-man Wu C. Kwoh Xiaoli Li Cuntai Guan AI4TS 42 492 0 26 Jun 2021
Improving Sequential Recommendation Consistency with Self-Supervised Imitation Xu Yuan Hongshen Chen Yonghao Song Xiaofang Zhao Zhuoye Ding Zhen He Bo Long 21 22 0 26 Jun 2021
Decomposed Mutual Information Estimation for Contrastive Representation Learning Alessandro Sordoni Nouha Dziri Hannes Schulz Geoffrey J. Gordon Philip Bachman Rémi Tachet des Combes SSL 24 30 0 25 Jun 2021
Mutual-Information Based Few-Shot Classification Malik Boudiaf Imtiaz Masud Ziko Jérôme Rony Jose Dolz Ismail Ben Ayed Pablo Piantanida VLM 32 2 0 23 Jun 2021
Unsupervised Object-Level Representation Learning from Scene Images Jiahao Xie Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy SSL OCL 38 73 0 22 Jun 2021
Can contrastive learning avoid shortcut solutions? Joshua Robinson Li Sun Ke Yu Kayhan Batmanghelich Stefanie Jegelka S. Sra SSL 24 143 0 21 Jun 2021
Interventional Video Grounding with Dual Contrastive Learning Guoshun Nan Rui Qiao Yao Xiao Jun Liu Sicong Leng H. Zhang Wei Lu 31 144 0 21 Jun 2021
Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting Martine Toering Ioannis Gatopoulos M. Stol Vincent Tao Hu SSL 40 11 0 18 Jun 2021
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 40 209 0 17 Jun 2021
Prototypical Graph Contrastive Learning Shuai Lin Pan Zhou Zi-Yuan Hu Shuojia Wang Ruihui Zhao Yefeng Zheng Liang Lin Eric Xing Xiaodan Liang 29 86 0 17 Jun 2021
Unsupervised Path Representation Learning with Curriculum Negative Sampling Sean Bin Yang Chenjuan Guo Jilin Hu Jiangtao Tang Bin Yang SSL 24 48 0 17 Jun 2021
Frustratingly Easy Transferability Estimation Long-Kai Huang Ying Wei Yu Rong Qiang Yang Junzhou Huang 43 57 0 17 Jun 2021
Multi-Level Transfer Learning from Near-Field to Far-Field Speaker Verification Li Zhang Qing Wang Kong Aik Lee Lei Xie Haizhou Li 30 13 0 17 Jun 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 68 2,751 0 15 Jun 2021
Which Mutual-Information Representation Learning Objectives are Sufficient for Control? Kate Rakelly Abhishek Gupta Carlos Florensa Sergey Levine SSL 26 39 0 14 Jun 2021
InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping Runshi Liu Pengda Qin Yuhong Li Weigao Wen Dong Li Kefeng Deng Qiang Wu AI4TS 15 0 0 13 Jun 2021
Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification Xiao Zhang Yixiao Ge Yu Qiao Hongsheng Li 32 96 0 11 Jun 2021
MST: Masked Self-Supervised Transformer for Visual Representation Zhaowen Li Zhiyang Chen Fan Yang Wei Li Yousong Zhu ... Rui Deng Liwei Wu Rui Zhao Ming Tang Jinqiao Wang ViT 45 163 0 10 Jun 2021
Fairness-Aware Node Representation Learning Öykü Deniz Köse Yanning Shen 32 22 0 09 Jun 2021
Image2Point: 3D Point-Cloud Understanding with 2D Image Pretrained Models Chenfeng Xu Shijia Yang Tomer Galanti Bichen Wu Xiangyu Yue Bohan Zhai Wei Zhan Peter Vajda Kurt Keutzer Masayoshi Tomizuka 3DPC 39 53 0 08 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 24 302 0 08 Jun 2021
PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learning Tao Yu Cuiling Lan Wenjun Zeng Mingxiao Feng Zhizheng Zhang Zhibo Chen OffRL 25 46 0 08 Jun 2021
Efficient Training of Visual Transformers with Small Datasets Yahui Liu E. Sangineto Wei Bi N. Sebe Bruno Lepri Marco De Nadai ViT 36 167 0 07 Jun 2021
Incremental False Negative Detection for Contrastive Learning Tsai-Shien Chen Wei-Chih Hung Hung-Yu Tseng Shao-Yi Chien Ming-Hsuan Yang SSL CLL 18 61 0 07 Jun 2021
Large-scale Unsupervised Semantic Segmentation Shangqi Gao Zhong-Yu Li Ming-Hsuan Yang Mingg-Ming Cheng Junwei Han Philip Torr UQCV 48 84 0 06 Jun 2021
Category Contrast for Unsupervised Domain Adaptation in Visual Tasks Jiaxing Huang Dayan Guan Aoran Xiao Shijian Lu Ling Shao CML 40 128 0 05 Jun 2021
CLEVE: Contrastive Pre-training for Event Extraction Ziqi Wang Xiaozhi Wang Xu Han Yankai Lin Lei Hou Zhiyuan Liu Peng Li Juan-Zi Li Jie Zhou 37 116 0 30 May 2021
The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy Optimization Taiki Miyagawa Akinori F. Ebihara 25 3 0 28 May 2021
Contrastive Fine-tuning Improves Robustness for Neural Rankers Xiaofei Ma Cicero Nogueira dos Santos Andrew O. Arnold 26 20 0 27 May 2021
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan Rumei Li Sirui Wang Fuzheng Zhang Wei Wu Weiran Xu SSL 52 546 0 25 May 2021
Voxel-level Siamese Representation Learning for Abdominal Multi-Organ Segmentation Chae-Eun Lee Minyoung Chung Y. Shin DRL 45 9 0 17 May 2021
Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentation Chenyu You Ruihan Zhao Lawrence H. Staib James S. Duncan SSL 43 106 0 14 May 2021
Maximizing Mutual Information Across Feature and Topology Views for Learning Graph Representations Xiaolong Fan Maoguo Gong Yue Wu Hao Li SSL 33 4 0 14 May 2021
Video Corpus Moment Retrieval with Contrastive Learning Hao Zhang Aixin Sun Wei Jing Guoshun Nan Liangli Zhen Qiufeng Wang Rick Siow Mong Goh 44 81 0 13 May 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 86 906 0 11 May 2021
Gradient-based Bayesian Experimental Design for Implicit Models using Mutual Information Lower Bounds Steven Kleinegesse Michael U. Gutmann FedML 38 25 0 10 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 42 12 0 08 May 2021
A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representations Pierre Colombo Chloé Clavel Pablo Piantanida AAML DRL 26 50 0 06 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 140 188 0 02 May 2021
A Good Image Generator Is What You Need for High-Resolution Video Synthesis Yu Tian Jian Ren Menglei Chai Kyle Olszewski Xi Peng Dimitris N. Metaxas Sergey Tulyakov VGen 65 183 0 30 Apr 2021
Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification Yichao Yan Jie Qin Jiaxin Chen Li Liu Fan Zhu Ying Tai Ling Shao 25 130 0 30 Apr 2021
A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning Christoph Feichtenhofer Haoqi Fan Bo Xiong Ross B. Girshick Kaiming He SSL AI4TS 39 257 0 29 Apr 2021
Shot Contrastive Self-Supervised Learning for Scene Boundary Detection Shixing Chen Xiaohan Nie David D. Fan Dongqing Zhang Vimal Bhat Raffay Hamid SSL 27 62 0 28 Apr 2021