Learning deep representations by mutual information estimation and maximization

20 August 2018

R. Devon Hjelm

A. Fedorov

Samuel Lavoie-Marchildon

Papers citing "Learning deep representations by mutual information estimation and maximization"

50 / 634 papers shown

Title
Node Embedding using Mutual Information and Self-Supervision based Bi-level Aggregation Kashob Kumar Roy Amit Roy A. Rahman M. A. Amin A. Ali SSL 26 10 0 27 Apr 2021
Pri3D: Can 3D Priors Help 2D Representation Learning? Ji Hou Saining Xie Benjamin Graham Angela Dai Matthias Nießner SSL 3DPC MDE 85 80 0 22 Apr 2021
3KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentations Bryan Gopal Ryan Han Gautham Raghupathi A. Ng G. Tison Pranav Rajpurkar MedIm 13 57 0 21 Apr 2021
Distill on the Go: Online knowledge distillation in self-supervised learning Prashant Shivaram Bhat Elahe Arani Bahram Zonooz SSL 22 28 0 20 Apr 2021
Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation Rui Cheng Bichen Wu Peizhao Zhang Peter Vajda Joseph E. Gonzalez CLIP VLM 21 31 0 18 Apr 2021
Contrastive Learning with Stronger Augmentations Tianlin Li Guo-Jun Qi CLL 22 221 0 15 Apr 2021
SiT: Self-supervised vIsion Transformer Sara Atito Ali Ahmed Muhammad Awais J. Kittler ViT 39 139 0 08 Apr 2021
Contrastive Syn-to-Real Generalization Wuyang Chen Zhiding Yu Shalini De Mello Sifei Liu J. Álvarez Zhangyang Wang Anima Anandkumar 23 46 0 06 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 75 1,819 0 05 Apr 2021
The Spatially-Correlative Loss for Various Image Translation Tasks Chuanxia Zheng Tat-Jen Cham Jianfei Cai 32 116 0 02 Apr 2021
A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification Jong-Chyi Su Zezhou Cheng Subhransu Maji 23 57 0 01 Apr 2021
Composable Augmentation Encoding for Video Representation Learning Chen Sun Arsha Nagrani Yonglong Tian Cordelia Schmid SSL AI4TS 37 17 0 01 Apr 2021
Contrastive Learning of Single-Cell Phenotypic Representations for Treatment Classification A. Perakis A. Gorji Samriddhi Jain K. Chaitanya Simone Rizza E. Konukoglu SSL 23 33 0 30 Mar 2021
Broaden Your Views for Self-Supervised Video Learning Adrià Recasens Pauline Luc Jean-Baptiste Alayrac Luyu Wang Ross Hemsley ... Florent Altché M. Valko Jean-Bastien Grill Aaron van den Oord Andrew Zisserman SSL AI4TS 33 127 0 30 Mar 2021
Complementary Relation Contrastive Distillation Jinguo Zhu Shixiang Tang Dapeng Chen Shijie Yu Yakun Liu A. Yang M. Rong Xiaohua Wang 27 77 0 29 Mar 2021
Explaining Representation by Mutual Information Li Gu SSL FAtt 37 0 0 28 Mar 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 43 46 0 25 Mar 2021
Learning Graph Representation by Aggregating Subgraphs via Mutual Information Maximization Chenguang Wang Ziwen Liu SSL 36 17 0 24 Mar 2021
Characterizing and Improving the Robustness of Self-Supervised Learning through Background Augmentations Chaitanya K. Ryali D. Schwab Ari S. Morcos SSL 42 9 0 23 Mar 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 48 105 0 23 Mar 2021
Cluster Contrast for Unsupervised Person Re-Identification Zuozhuo Dai Guangyuan Wang Weihao Yuan Xiaoli Liu Siyu Zhu P. Tan 30 212 0 22 Mar 2021
Efficient Visual Pretraining with Contrastive Detection Olivier J. Hénaff Skanda Koppula Jean-Baptiste Alayrac Aaron van den Oord Oriol Vinyals João Carreira VLM SSL 38 162 0 19 Mar 2021
Adversarial and Contrastive Variational Autoencoder for Sequential Recommendation Zhe Xie Chengxuan Liu Yichi Zhang Hongtao Lu Dong Wang Yue Ding BDL DRL 36 91 0 19 Mar 2021
Contrastive Learning of Musical Representations Janne Spijkervet J. Burgoyne 38 111 0 17 Mar 2021
Tensor networks and efficient descriptions of classical data Sirui Lu Márton Kanász-Nagy I. Kukuljan J. I. Cirac 29 24 0 11 Mar 2021
Multi-Pretext Attention Network for Few-shot Learning with Self-supervision Hainan Li Renshuai Tao Jun Li Haotong Qin Yifu Ding Shuo Wang Xianglong Liu SSL 27 8 0 10 Mar 2021
FSCE: Few-Shot Object Detection via Contrastive Proposal Encoding Bo Sun Banghuai Li Shengcai Cai Ye Yuan Chi Zhang 45 370 0 10 Mar 2021
Deeply Unsupervised Patch Re-Identification for Pre-training Object Detectors Jian Ding Enze Xie Hang Xu Chenhan Jiang Zhenguo Li Ping Luo Guisong Xia 28 16 0 08 Mar 2021
Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularization Jizong Peng M. Pedersoli Christian Desrosiers SSL 27 21 0 08 Mar 2021
Multimodal Representation Learning via Maximization of Local Mutual Information Ruizhi Liao Daniel Moyer Miriam Cha Keegan Quigley Seth Berkowitz Steven Horng Polina Golland W. Wells SSL 21 41 0 08 Mar 2021
CoDeGAN: Contrastive Disentanglement for Generative Adversarial Network Lili Pan Peijun Tang Zhiyong Chen Zenglin Xu GAN DRL 18 6 0 05 Mar 2021
Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis Jiaye Teng Weiran Huang Haowei He SSL 29 11 0 05 Mar 2021
Self-Supervised Multi-View Learning via Auto-Encoding 3D Transformations Xiang Gao Wei Hu Guo-Jun Qi 37 6 0 01 Mar 2021
Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning Yixin Liu Zhao Li Shirui Pan Chen Gong Chuan Zhou George Karypis 49 290 0 27 Feb 2021
Towards Robust Graph Contrastive Learning Nikola Jovanović Zhao Meng Lukas Faber Roger Wattenhofer SSL 26 33 0 25 Feb 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 96 91 0 25 Feb 2021
Self-Supervised Learning of Graph Neural Networks: A Unified Review Yaochen Xie Zhao Xu Jingtun Zhang Zhengyang Wang Shuiwang Ji SSL 41 326 0 22 Feb 2021
MedAug: Contrastive learning leveraging patient metadata improves representations for chest X-ray interpretation Yen Nhi Truong Vu Richard Wang N. Balachandar Can Liu A. Ng Pranav Rajpurkar 21 82 0 21 Feb 2021
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration Zhiqiang Shen Zechun Liu Jie Qin Lei Huang Kwang-Ting Cheng Marios Savvides UQCV SSL MQ 248 22 0 17 Feb 2021
Contrastive Learning Inverts the Data Generating Process Roland S. Zimmermann Yash Sharma Steffen Schneider Matthias Bethge Wieland Brendel SSL 238 211 0 17 Feb 2021
HDMI: High-order Deep Multiplex Infomax Baoyu Jing Chanyoung Park Hanghang Tong 98 164 0 15 Feb 2021
Large-Scale Representation Learning on Graphs via Bootstrapping S. Thakoor Corentin Tallec M. G. Azar Mehdi Azabou Eva L. Dyer Rémi Munos Petar Velivcković Michal Valko SSL 29 218 0 12 Feb 2021
Quantifying and Mitigating Privacy Risks of Contrastive Learning Xinlei He Yang Zhang 21 51 0 08 Feb 2021
Calibrating and Improving Graph Contrastive Learning Kaili Ma Haochen Yang Han Yang Yongqiang Chen James Cheng 52 6 0 27 Jan 2021
ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning Sangho Lee Jiwan Chung Youngjae Yu Gunhee Kim Thomas Breuel Gal Chechik Yale Song 71 45 0 26 Jan 2021
A Review on Deep Learning in UAV Remote Sensing L. Osco J. M. Junior A. P. Ramos L. Jorge S. Fatholahi J. Silva E. Matsubara H. Pistori W. Gonçalves Jonathan Li AI4Cl 39 342 0 22 Jan 2021
Knowledge-Preserving Incremental Social Event Detection via Heterogeneous GNNs Dongyuan Li Hao Peng Jia Wu Yingtong Dou Jianxin Li Philip S. Yu 27 90 0 21 Jan 2021
SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism Qingyun Sun Jianxin Li Hao Peng Jia Wu Yuanxing Ning Phillip S. Yu Lifang He 26 162 0 20 Jan 2021
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised Learning Zeming Li Songtao Liu Jian Sun 51 16 0 19 Jan 2021
Disentangled Recurrent Wasserstein Autoencoder Jun Han Martin Renqiang Min Ligong Han Erran L. Li Xuan Zhang CoGe SyDa DRL 32 33 0 19 Jan 2021