Towards Domain-Agnostic Contrastive Learning

9 November 2020

Papers citing "Towards Domain-Agnostic Contrastive Learning"

50 / 60 papers shown

Title
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition Felix Wu Kwangyoun Kim Jing Pan Kyu Jeong Han Kilian Q. Weinberger Yoav Artzi 27 71 0 14 Sep 2021
MixCo: Mix-up Contrastive Learning for Visual Representation Sungnyun Kim Gihun Lee Sangmin Bae Seyoung Yun SSL 116 80 0 13 Oct 2020
SeqMix: Augmenting Active Sequence Labeling via Sequence Mixup Rongzhi Zhang Yue Yu Chao Zhang VLM 26 94 0 05 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 74 634 0 02 Oct 2020
Joint Contrastive Learning with Infinite Possibilities Qi Cai Yu Wang Yingwei Pan Ting Yao Tao Mei VLM 32 60 0 30 Sep 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 66 5,677 0 20 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 75 4,032 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 222 6,718 0 13 Jun 2020
Interpolation-based semi-supervised learning for object detection Jisoo Jeong Vikas Verma Minsung Hyun Arno Solin Nojun Kwak 54 73 0 03 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 53 1,313 0 20 May 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere Tongzhou Wang Phillip Isola SSL 67 1,808 0 20 May 2020
Adversarial Vertex Mixup: Toward Better Adversarially Robust Generalization Saehyung Lee Hyungyu Lee Sungroh Yoon AAML 174 113 0 05 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 124 18,523 0 13 Feb 2020
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 56 1,448 0 04 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 71 11,959 0 13 Nov 2019
Mixup-breakdown: a consistency training method for improving generalization of speech separation models Max W. Y. Lam Jun Wang Dan Su Dong Yu 45 22 0 28 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 214 6,420 0 26 Sep 2019
Mixup Inference: Better Exploiting Mixup to Defend Adversarial Attacks Tianyu Pang Kun Xu Jun Zhu AAML 35 104 0 25 Sep 2019
Improving Robustness of Deep Learning Based Knee MRI Segmentation: Mixup and Adversarial Domain Adaptation E. Panfilov A. Tiulpin S. Klein M. Nieminen S. Saarakkala OOD 37 78 0 12 Aug 2019
InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization Fan-Yun Sun Jordan Hoffmann Vikas Verma Jian Tang SSL 119 852 0 31 Jul 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 322 24,160 0 26 Jul 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 78 542 0 04 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 148 8,386 0 19 Jun 2019
Interpolated Adversarial Training: Achieving Robust Neural Networks without Sacrificing Too Much Accuracy Alex Lamb Vikas Verma Kenji Kawaguchi Alexander Matyasko Savya Khosla Arno Solin Yoshua Bengio AAML 30 99 0 16 Jun 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 112 2,385 0 13 Jun 2019
Selfie: Self-supervised Pretraining for Image Embedding Trieu H. Trinh Minh-Thang Luong Quoc V. Le SSL 34 112 0 07 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 134 1,463 0 03 Jun 2019
Strategies for Pre-training Graph Neural Networks Weihua Hu Bowen Liu Joseph Gomes Marinka Zitnik Percy Liang Vijay S. Pande J. Leskovec SSL AI4CE 58 1,377 0 29 May 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 77 1,422 0 22 May 2019
Augmenting Data with Mixup for Sentence Classification: An Empirical Study Hongyu Guo Yongyi Mao Richong Zhang 37 235 0 22 May 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 545 4,735 0 13 May 2019
MixMatch: A Holistic Approach to Semi-Supervised Learning David Berthelot Nicholas Carlini Ian Goodfellow Nicolas Papernot Avital Oliver Colin Raffel 110 3,009 0 06 May 2019
Unsupervised Embedding Learning via Invariant and Spreading Instance Feature Mang Ye Xu-Yao Zhang PongChi Yuen Shih-Fu Chang SSL 40 580 0 06 Apr 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 57 444 0 29 Mar 2019
Interpolation Consistency Training for Semi-Supervised Learning Vikas Verma Kenji Kawaguchi Alex Lamb Arno Solin Arno Solin Yoshua Bengio David Lopez-Paz 80 763 0 09 Mar 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 629 93,936 0 11 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 104 7,554 0 01 Oct 2018
Deep Graph Infomax Petar Velickovic W. Fedus William L. Hamilton Pietro Lio Yoshua Bengio R. Devon Hjelm GNN 85 2,359 0 27 Sep 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 190 2,649 0 20 Aug 2018
Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizer David Berthelot Colin Raffel Aurko Roy Ian Goodfellow 32 262 0 19 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 175 10,152 0 10 Jul 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 121 3,437 0 05 May 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 147 3,272 0 21 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 58 11,520 0 15 Feb 2018
Between-class Learning for Image Classification Yuji Tokozume Yoshitaka Ushiku Tatsuya Harada SSL 46 205 0 28 Nov 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 212 9,687 0 25 Oct 2017
Generalization in Deep Learning Kenji Kawaguchi L. Kaelbling Yoshua Bengio ODL 53 459 0 16 Oct 2017
Large Batch Training of Convolutional Networks Yang You Igor Gitman Boris Ginsburg ODL 69 842 0 13 Aug 2017
Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs M. Simonovsky N. Komodakis GNN 95 1,223 0 10 Apr 2017
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction Richard Y. Zhang Phillip Isola Alexei A. Efros SSL DRL 42 667 0 29 Nov 2016