Shuffle & Divide: Contrastive Learning for Long Text

19 April 2023

Joonseok Lee

Papers citing "Shuffle & Divide: Contrastive Learning for Long Text"

22 / 22 papers shown

Title
SelfMatch: Combining Contrastive Self-Supervision and Consistency for Semi-Supervised Learning Byoungjip Kim Jinho Choo Yeong-Dae Kwon Seongho Joe Seungjai Min Youngjune Gwon SSL 67 51 0 16 Jan 2021
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 829 42,332 0 28 May 2020
SCAN: Learning to Classify Images without Labels Wouter Van Gansbeke Simon Vandenhende Stamatios Georgoulis Marc Proesmans Luc Van Gool VLM SSL 111 540 0 25 May 2020
Neural Topic Modeling with Bidirectional Adversarial Training Rui Wang Xuemeng Hu Deyu Zhou Yulan He Yuxuan Xiong Chencheng Ye Haiyang Xu AAML OOD BDL 114 90 0 26 Apr 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 375 18,778 0 13 Feb 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 207 12,085 0 13 Nov 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 371 6,463 0 26 Sep 2019
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks Nils Reimers Iryna Gurevych 1.3K 12,295 0 27 Aug 2019
On Mutual Information Maximization for Representation Learning Michael Tschannen Josip Djolonga Paul Kishan Rubenstein Sylvain Gelly Mario Lucic SSL 179 500 0 31 Jul 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 195 1,476 0 03 Jun 2019
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks Jason W. Wei Kai Zou 112 1,962 0 31 Jan 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,114 0 11 Oct 2018
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 332 2,670 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 351 10,349 0 10 Jul 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 261 3,297 0 21 Mar 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 224 11,565 0 15 Feb 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 725 132,199 0 12 Jun 2017
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 174 5 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 149 3,532 0 28 Mar 2016
Semi-supervised Sequence Learning Andrew M. Dai Quoc V. Le SSL 130 1,234 0 04 Nov 2015
Unsupervised Visual Representation Learning by Context Prediction Carl Doersch Abhinav Gupta Alexei A. Efros DRL SSL 169 2,789 0 19 May 2015
Integrating Document Clustering and Topic Modeling P. Xie Eric Xing 52 200 0 26 Sep 2013