DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations

5 June 2020

Papers citing "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations"

42 / 242 papers shown

Title
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast Liang Wang Wei-Ye Zhao Jingming Liu 34 14 0 01 Sep 2021
Contrastive Self-supervised Sequential Recommendation with Robust Augmentation Zhiwei Liu Yong-Guang Chen Jia Li Philip S. Yu Julian McAuley Caiming Xiong 20 164 0 14 Aug 2021
Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval Luyu Gao Jamie Callan RALM 175 329 0 12 Aug 2021
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation Xin Wang Yasheng Wang Fei Mi Pingyi Zhou Yao Wan Xiao Liu Li Li Hao Wu Jin Liu Xin Jiang 39 111 0 10 Aug 2021
Improved Text Classification via Contrastive Adversarial Training Lin Pan Chung-Wei Hang Avirup Sil Saloni Potdar AAML 26 86 0 21 Jul 2021
Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks Zhao Meng Yihan Dong Mrinmaya Sachan Roger Wattenhofer AAML 66 10 0 15 Jul 2021
Contrastive Learning for Robust Android Malware Familial Classification Yueming Wu Shihan Dou Deqing Zou Wei Yang Weizhong Qiang Hai Jin AAML 16 13 0 08 Jul 2021
Investigating the Role of Negatives in Contrastive Representation Learning Jordan T. Ash Surbhi Goel A. Krishnamurthy Dipendra Kumar Misra SSL 29 49 0 18 Jun 2021
Bi-Granularity Contrastive Learning for Post-Training in Few-Shot Scene Ruikun Luo Guanhuan Huang Xiaojun Quan CLL 8 10 0 04 Jun 2021
Self-Guided Contrastive Learning for BERT Sentence Representations Taeuk Kim Kang Min Yoo Sang-goo Lee SSL 39 202 0 03 Jun 2021
Lightweight Cross-Lingual Sentence Representation Learning Zhuoyuan Mao Prakhar Gupta Pei Wang Chenhui Chu Martin Jaggi Sadao Kurohashi VLM 22 8 0 28 May 2021
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer Yuanmeng Yan Rumei Li Sirui Wang Fuzheng Zhang Wei Wu Weiran Xu SSL 52 546 0 25 May 2021
Contrastive Attraction and Contrastive Repulsion for Representation Learning Huangjie Zheng Xu Chen Jiangchao Yao Hongxia Yang Chunyuan Li Ya Zhang Hao Zhang Ivor Tsang Jingren Zhou Mingyuan Zhou SSL 42 12 0 08 May 2021
Data-Efficient Language-Supervised Zero-Shot Learning with Self-Distillation Rui Cheng Bichen Wu Peizhao Zhang Peter Vajda Joseph E. Gonzalez CLIP VLM 21 31 0 18 Apr 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 42 3,260 0 18 Apr 2021
Contrastive Out-of-Distribution Detection for Pretrained Transformers Wenxuan Zhou Fangyu Liu Muhao Chen 11 98 0 18 Apr 2021
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders Fangyu Liu Ivan Vulić Anna Korhonen Nigel Collier VLM OffRL 27 117 0 16 Apr 2021
Are Classes Clusters? Kees Varekamp 11 2 0 16 Apr 2021
Generating Datasets with Pretrained Language Models Timo Schick Hinrich Schütze 13 234 0 15 Apr 2021
TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning Kexin Wang Nils Reimers Iryna Gurevych 11 177 0 14 Apr 2021
The Surprising Performance of Simple Baselines for Misinformation Detection Kellin Pelrine Jacob Danovitch Reihaneh Rabbany 22 63 0 14 Apr 2021
Disentangled Contrastive Learning for Learning Robust Textual Representations Xiang Chen Xin Xie Zhen Bi Hongbin Ye Shumin Deng Ningyu Zhang Huajun Chen 33 5 0 11 Apr 2021
Unsupervised Document Embedding via Contrastive Augmentation Dongsheng Luo Wei Cheng Jingchao Ni Wenchao Yu Xuchao Zhang ... Yanchi Liu Zhengzhang Chen Dongjin Song Haifeng Chen Xiang Zhang SSL 23 11 0 26 Mar 2021
Learning Graph Representation by Aggregating Subgraphs via Mutual Information Maximization Chenguang Wang Ziwen Liu SSL 36 17 0 24 Mar 2021
Supporting Clustering with Contrastive Learning Dejiao Zhang Feng Nan Xiaokai Wei Shang-Wen Li Henghui Zhu Kathleen McKeown Ramesh Nallapati Andrew O. Arnold Bing Xiang SSL 41 195 0 24 Mar 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 42 18 0 18 Mar 2021
A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier Isabelle Augenstein SSL VLM 90 90 0 25 Feb 2021
Contrastive Pre-training for Imbalanced Corporate Credit Ratings Bojing Feng Wenfang Xue SSL 6 7 0 18 Feb 2021
Quantifying and Mitigating Privacy Risks of Contrastive Learning Xinlei He Yang Zhang 21 51 0 08 Feb 2021
Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup Luyu Gao Yunyi Zhang Jiawei Han Jamie Callan 23 91 0 18 Jan 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 33 319 0 31 Dec 2020
Universal Sentence Representation Learning with Conditional Masked Language Model Ziyi Yang Yinfei Yang Daniel Cer Jax Law Eric F. Darve SSL 24 57 0 28 Dec 2020
Cross-Domain Sentiment Classification with In-Domain Contrastive Learning Tian Li Xiang Chen Shanghang Zhang Zhen Dong Kurt Keutzer 14 4 0 05 Dec 2020
Multi-Label Contrastive Learning for Abstract Visual Reasoning Mikolaj Malkiñski Jacek Mańdziuk 8 39 0 03 Dec 2020
CODER: Knowledge infused cross-lingual medical term embedding for term normalization Zheng Yuan Zhengyun Zhao Haixia Sun Jiao Li Fei Wang Sheng Yu MedIm 21 95 0 05 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 25 1,359 0 31 Oct 2020
Cross-Domain Sentiment Classification with Contrastive Learning and Mutual Information Maximization Tian Li Xiang Chen Shanghang Zhang Zhen Dong Kurt Keutzer 17 36 0 30 Oct 2020
Representation Learning for High-Dimensional Data Collection under Local Differential Privacy Alex Mansbridge G. Barbour Davide Piras Michael Murray Christopher Frye Ilya Feige David Barber 21 1 0 23 Oct 2020
Contrastive Code Representation Learning Paras Jain Ajay Jain Tianjun Zhang Pieter Abbeel Joseph E. Gonzalez Ion Stoica SSL DRL 34 149 0 09 Jul 2020
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 220 165 0 18 Oct 2019
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 201 882 0 03 May 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018