BatchSampler: Sampling Mini-Batches for Contrastive Learning in Vision, Language, and Graphs

6 June 2023

Yuxiao Dong

ArXiv (abs)PDF HTML Github (18★)

Papers citing "BatchSampler: Sampling Mini-Batches for Contrastive Learning in Vision, Language, and Graphs"

43 / 43 papers shown

Title
Hard Negative Sampling Strategies for Contrastive Representation Learning Afrina Tabassum Muntasir Wahed Hoda Eldardiry Ismini Lourentzou SSL 98 25 0 02 Jun 2022
Debiased Contrastive Learning of Unsupervised Sentence Representations Kun Zhou Beichen Zhang Wayne Xin Zhao Ji-Rong Wen SSL 99 102 0 02 May 2022
InfoGCL: Information-Aware Graph Contrastive Learning Dongkuan Xu Wei Cheng Dongsheng Luo Haifeng Chen Xiang Zhang 63 200 0 28 Oct 2021
Weakly Supervised Contrastive Learning Mingkai Zheng Fei Wang Shan You Chao Qian Changshui Zhang Xiaogang Wang Chang Xu SSL 83 125 0 10 Oct 2021
An Empirical Study of Graph Contrastive Learning Yanqiao Zhu Yichen Xu Qiang Liu Shu Wu 97 172 0 02 Sep 2021
Graph Contrastive Learning Automated Yuning You Tianlong Chen Yang Shen Zhangyang Wang 81 479 0 10 Jun 2021
Enabling On-Device Self-Supervised Contrastive Learning With Selective Data Contrast Yawen Wu Zhepeng Wang Dewen Zeng Yiyu Shi Jingtong Hu SSL 69 28 0 07 Jun 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 284 3,432 0 18 Apr 2021
Solving Inefficiency of Self-supervised Representation Learning Guangrun Wang Keze Wang Guangcong Wang Philip Torr Liang Lin SSL 74 58 0 18 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 166 1,873 0 05 Apr 2021
Recognizing Predictive Substructures with Subgraph Information Bottleneck Junchi Yu Tingyang Xu Yu Rong Yatao Bian Junzhou Huang Ran He 66 45 0 20 Mar 2021
COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng Chenyan Xiong Payal Bajaj Saurabh Tiwary Paul N. Bennett Jiawei Han Xia Song 182 205 0 16 Feb 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 80 323 0 31 Dec 2020
Boosting Contrastive Self-Supervised Learning with False Negative Cancellation T. Huynh Simon Kornblith Matthew R. Walter Michael Maire M. Khademi SSL 79 170 0 23 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 141 1,403 0 31 Oct 2020
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 93 1,116 0 27 Oct 2020
Graph Information Bottleneck for Subgraph Recognition Junchi Yu Tingyang Xu Yu Rong Yatao Bian Junzhou Huang Ran He 55 157 0 12 Oct 2020
Contrastive Learning with Hard Negative Samples Joshua Robinson Ching-Yao Chuang S. Sra Stefanie Jegelka SSL 153 788 0 09 Oct 2020
Conditional Negative Sampling for Contrastive Learning of Visual Representations Mike Wu Milan Mossé Chengxu Zhuang Daniel L. K. Yamins Noah D. Goodman SSL 108 79 0 05 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 140 647 0 02 Oct 2020
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval Lee Xiong Chenyan Xiong Ye Li Kwok-Fung Tang Jialin Liu Paul N. Bennett Junaid Ahmed Arnold Overwijk 141 1,236 0 01 Jul 2020
Debiased Contrastive Learning Ching-Yao Chuang Joshua Robinson Yen-Chen Lin Antonio Torralba Stefanie Jegelka SSL 97 567 0 01 Jul 2020
GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training J. Qiu Qibin Chen Yuxiao Dong Jing Zhang Hongxia Yang Ming Ding Kuansan Wang Jie Tang SSL 242 960 0 17 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 288 4,103 0 17 Jun 2020
Contrastive Multi-View Representation Learning on Graphs Kaveh Hassani Amir Hosein Khas Ahmadi SSL 242 1,305 0 10 Jun 2020
Dense Passage Retrieval for Open-Domain Question Answering Vladimir Karpukhin Barlas Oğuz Sewon Min Patrick Lewis Ledell Yu Wu Sergey Edunov Danqi Chen Wen-tau Yih RALM 212 3,799 0 10 Apr 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 398 18,913 0 13 Feb 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 216 12,146 0 13 Nov 2019
InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization Fan-Yun Sun Jordan Hoffmann Vikas Verma Jian Tang SSL 173 866 0 31 Jul 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 703 24,572 0 26 Jul 2019
Large Batch Optimization for Deep Learning: Training BERT in 76 minutes Yang You Jing Li Sashank J. Reddi Jonathan Hseu Sanjiv Kumar Srinadh Bhojanapalli Xiaodan Song J. Demmel Kurt Keutzer Cho-Jui Hsieh ODL 274 998 0 01 Apr 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,324 0 11 Oct 2018
How Powerful are Graph Neural Networks? Keyulu Xu Weihua Hu J. Leskovec Stefanie Jegelka GNN 266 7,710 0 01 Oct 2018
Deep Graph Infomax Petar Velickovic W. Fedus William L. Hamilton Pietro Lio Yoshua Bengio R. Devon Hjelm GNN 132 2,401 0 27 Sep 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 356 10,369 0 10 Jul 2018
Hierarchical Graph Representation Learning with Differentiable Pooling Rex Ying Jiaxuan You Christopher Morris Xiang Ren William L. Hamilton J. Leskovec GNN 322 2,157 0 22 Jun 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 185 3,472 0 05 May 2018
graph2vec: Learning Distributed Representations of Graphs A. Narayanan Mahinthan Chandramohan R. Venkatesan Lihui Chen Yang Liu Shantanu Jaiswal GNN 79 746 0 17 Jul 2017
Billion-scale similarity search with GPUs Jeff Johnson Matthijs Douze Hervé Jégou 273 3,746 0 28 Feb 2017
node2vec: Scalable Feature Learning for Networks Aditya Grover J. Leskovec 198 10,934 0 03 Jul 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,641 0 10 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 2.1K 150,433 0 22 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.7K 39,637 0 01 Sep 2014