Improved Baselines with Momentum Contrastive Learning

9 March 2020

Papers citing "Improved Baselines with Momentum Contrastive Learning"

50 / 2,109 papers shown

Title
Geography-Aware Self-Supervised Learning Kumar Ayush Burak Uzkent Chenlin Meng Kumar Tanmay Marshall Burke David B. Lobell Stefano Ermon SSL 122 235 0 19 Nov 2020
Heterogeneous Contrastive Learning: Encoding Spatial Information for Compact Visual Representations Xinyue Huo Lingxi Xie Longhui Wei Xiaopeng Zhang Hao Li Zijie Yang Wen-gang Zhou Houqiang Li Qi Tian SSL 71 13 0 19 Nov 2020
FROST: Faster and more Robust One-shot Semi-supervised Training Helena E. Liu L. Smith BDL OffRL 58 1 0 18 Nov 2020
Online Exemplar Fine-Tuning for Image-to-Image Translation Taewon Kang Soohyun Kim Sunwoo Kim Seungryong Kim 46 3 0 18 Nov 2020
Dense Contrastive Learning for Self-Supervised Visual Pre-Training Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li SSL 101 689 0 18 Nov 2020
UP-DETR: Unsupervised Pre-training for Object Detection with Transformers Zhigang Dai Bolun Cai Yugeng Lin Junying Chen ViT 87 24 0 18 Nov 2020
Can Semantic Labels Assist Self-Supervised Visual Representation Learning? Longhui Wei Lingxi Xie Jianzhong He Jianlong Chang Xiaopeng Zhang Wen-gang Zhou Houqiang Li Qi Tian SSL 57 25 0 17 Nov 2020
AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries Q. Hu Tianlin Li Wei Hu Guo-Jun Qi SSL 78 153 0 17 Nov 2020
Unsupervised Contrastive Learning of Sound Event Representations Eduardo Fonseca Diego Ortego Kevin McGuinness Noel E. O'Connor Xavier Serra SSL 72 66 0 15 Nov 2020
Learning a Geometric Representation for Data-Efficient Depth Estimation via Gradient Field and Contrastive Loss D. Shim H. J. Kim SSL MDE 64 1 0 06 Nov 2020
Center-wise Local Image Mixture For Contrastive Representation Learning Hao Li Xiaopeng Zhang H. Xiong 76 8 0 05 Nov 2020
IDE-Net: Interactive Driving Event and Pattern Extraction from Human Data Xiaosong Jia Liting Sun Masayoshi Tomizuka Wei Zhan 83 27 0 04 Nov 2020
Learning Visual Representations for Transfer Learning by Suppressing Texture Shlok Kumar Mishra Anshul B. Shah Ankan Bansal Janit Anjaria Jonghyun Choi Abhinav Shrivastava Abhishek Sharma David Jacobs SSL 113 11 0 03 Nov 2020
Distilling Knowledge by Mimicking Features G. Wang Yifan Ge Jianxin Wu 102 38 0 03 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 154 1,411 0 31 Oct 2020
Pretext-Contrastive Learning: Toward Good Practices in Self-supervised Video Representation Leaning L. Tao Xueting Wang T. Yamasaki VLM SSL 104 14 0 29 Oct 2020
CompRess: Self-Supervised Learning by Compressing Representations Soroush Abbasi Koohpayegani Ajinkya Tejankar Hamed Pirsiavash SSL 82 92 0 28 Oct 2020
Contrastive Unsupervised Learning for Audio Fingerprinting Zhesong Yu Xingjian Du Bilei Zhu Zejun Ma 73 9 0 26 Oct 2020
CLOUD: Contrastive Learning of Unsupervised Dynamics Jianren Wang Yujie Lu Hang Zhao 93 5 0 23 Oct 2020
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 309 115 0 20 Oct 2020
CLAR: Contrastive Learning of Auditory Representations Haider Al-Tahan Y. Mohsenzadeh SSL 193 56 0 19 Oct 2020
Improving Transformation Invariance in Contrastive Representation Learning Adam Foster Rattana Pukdee Tom Rainforth 109 23 0 19 Oct 2020
Federated Unsupervised Representation Learning Fengda Zhang Kun Kuang Zhaoyang You Tao Shen Jun Xiao Yin Zhang Chao-Xiang Wu Yueting Zhuang Xiaolin Li FedML 89 137 0 18 Oct 2020
i-Mix: A Domain-Agnostic Strategy for Contrastive Representation Learning Kibok Lee Yian Zhu Kihyuk Sohn Chun-Liang Li Jinwoo Shin Honglak Lee SSL 86 26 0 17 Oct 2020
What Can You Learn from Your Muscles? Learning Visual Representation from Human Interactions Kiana Ehsani Daniel Gordon T. Nguyen Roozbeh Mottaghi Ali Farhadi 3DH SSL 55 2 0 16 Oct 2020
For self-supervised learning, Rationality implies generalization, provably Yamini Bansal Gal Kaplun Boaz Barak OOD SSL 117 22 0 16 Oct 2020
On the surprising similarities between supervised and self-supervised models Robert Geirhos Kantharaju Narayanappa Benjamin Mitzkus Matthias Bethge Felix Wichmann Wieland Brendel OOD SSL DRL 142 48 0 16 Oct 2020
Representation Learning via Invariant Causal Mechanisms Jovana Mitrović Brian McWilliams Jacob Walker Lars Buesing Charles Blundell CML OOD SSL 80 251 0 15 Oct 2020
Masked Contrastive Representation Learning for Reinforcement Learning Jinhua Zhu Yingce Xia Lijun Wu Jiajun Deng Wen-gang Zhou Tao Qin Houqiang Li SSL OffRL 110 60 0 15 Oct 2020
Viewmaker Networks: Learning Views for Unsupervised Representation Learning Alex Tamkin Mike Wu Noah D. Goodman SSL 131 64 0 14 Oct 2020
Are all negatives created equal in contrastive instance discrimination? Tiffany Cai Jonathan Frankle D. Schwab Ari S. Morcos SSL 78 83 0 13 Oct 2020
MixCo: Mix-up Contrastive Learning for Visual Representation Sungnyun Kim Gihun Lee Sangmin Bae Seyoung Yun SSL 167 81 0 13 Oct 2020
Contrast and Classify: Training Robust VQA Models Yash Kant A. Moudgil Dhruv Batra Devi Parikh Harsh Agrawal 55 5 0 13 Oct 2020
MoCo-CXR: MoCo Pretraining Improves Representation and Transferability of Chest X-ray Models Hari Sowrirajan Jingbo Yang A. Ng Pranav Rajpurkar 115 86 0 11 Oct 2020
Contrastive Learning with Hard Negative Samples Joshua Robinson Ching-Yao Chuang S. Sra Stefanie Jegelka SSL 161 789 0 09 Oct 2020
Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Data Colin Wei Kendrick Shen Yining Chen Tengyu Ma SSL 117 232 0 07 Oct 2020
Unsupervised Representation Learning by InvariancePropagation Feng Wang Huaping Liu Di Guo F. Sun SSL 90 32 0 07 Oct 2020
Representation learning from videos in-the-wild: An object-centric approach Rob Romijnders Aravindh Mahendran Michael Tschannen Josip Djolonga Marvin Ritter N. Houlsby Mario Lucic OCL SSL 70 8 0 06 Oct 2020
Do Explicit Alignments Robustly Improve Multilingual Encoders? Shijie Wu Mark Dredze 54 7 0 06 Oct 2020
Shot in the Dark: Few-Shot Learning with No Base-Class Labels Z. Chen Subhransu Maji Erik Learned-Miller SSL VLM 53 20 0 06 Oct 2020
CO2: Consistent Contrast for Unsupervised Visual Representation Learning Chen Wei Huiyu Wang Wei Shen Alan Yuille SSL 85 63 0 05 Oct 2020
A Simple Framework for Uncertainty in Contrastive Learning Mike Wu Noah D. Goodman UQCV 96 19 0 05 Oct 2020
Conditional Negative Sampling for Contrastive Learning of Visual Representations Mike Wu Milan Mossé Chengxu Zhuang Daniel L. K. Yamins Noah D. Goodman SSL 108 79 0 05 Oct 2020
EqCo: Equivalent Rules for Self-supervised Contrastive Learning Benjin Zhu Junqiang Huang Zeming Li Xiangyu Zhang Jian Sun SSL 79 13 0 05 Oct 2020
Integrating Categorical Semantics into Unsupervised Domain Translation Samuel Lavoie-Marchildon Faruk Ahmed Aaron Courville 75 6 0 03 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 144 647 0 02 Oct 2020
Contrastive Learning of Medical Visual Representations from Paired Images and Text Yuhao Zhang Hang Jiang Yasuhide Miura Christopher D. Manning C. Langlotz MedIm 195 774 0 02 Oct 2020
Understanding Self-supervised Learning with Dual Deep Networks Yuandong Tian Lantao Yu Xinlei Chen Surya Ganguli SSL 86 80 0 01 Oct 2020
Joint Contrastive Learning with Infinite Possibilities Qi Cai Yu Wang Yingwei Pan Ting Yao Tao Mei VLM 69 60 0 30 Sep 2020
Beneficial Perturbations Network for Defending Adversarial Examples Shixian Wen A. Rios Laurent Itti AAML 30 1 0 27 Sep 2020