DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations

5 June 2020

Papers citing "DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations"

50 / 242 papers shown

Title
Contextual Representation Learning beyond Masked Language Modeling Zhiyi Fu Wangchunshu Zhou Jingjing Xu Hao Zhou Lei Li 28 25 0 08 Apr 2022
CoCoSoDa: Effective Contrastive Learning for Code Search Ensheng Shi Yanlin Wang Wenchao Gu Lun Du Hongyu Zhang Shi Han Dongmei Zhang Hongbin Sun 41 33 0 07 Apr 2022
Graph Enhanced Contrastive Learning for Radiology Findings Summarization Jinpeng Hu Zhuo Li Zhihong Chen Zhuguo Li Xiang Wan Tsung-Hui Chang MedIm 22 46 0 01 Apr 2022
Contrasting the landscape of contrastive and non-contrastive learning Ashwini Pokle Jinjin Tian Yuchen Li Andrej Risteski SSL 35 28 0 29 Mar 2022
Text Transformations in Contrastive Self-Supervised Learning: A Review Amrita Bhattacharjee Mansooreh Karami Huan Liu SSL 29 23 0 22 Mar 2022
Improving Word Translation via Two-Stage Contrastive Learning Yaoyiran Li Fangyu Liu Nigel Collier Anna Korhonen Ivan Vulić 44 29 0 15 Mar 2022
Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost Lihu Chen Gaël Varoquaux Fabian M. Suchanek 21 14 0 15 Mar 2022
SCD: Self-Contrastive Decorrelation for Sentence Embeddings T. Klein Moin Nabi SSL 33 25 0 15 Mar 2022
Contrastive Learning of Sociopragmatic Meaning in Social Media Chiyu Zhang Muhammad Abdul-Mageed Ganesh Jawahar 30 1 0 15 Mar 2022
Improved Universal Sentence Embeddings with Prompt-based Contrastive Learning and Energy-based Learning Yuxin Jiang Linhan Zhang Wei Wang SSL 16 46 0 14 Mar 2022
LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval Canwen Xu Daya Guo Nan Duan Julian McAuley RALM VLM 24 46 0 11 Mar 2022
Two-Level Supervised Contrastive Learning for Response Selection in Multi-Turn Dialogue Wentao Zhang Shuangyin Xu Haoran Huang 41 2 0 01 Mar 2022
Understanding Contrastive Learning Requires Incorporating Inductive Biases Nikunj Saunshi Jordan T. Ash Surbhi Goel Dipendra Kumar Misra Cyril Zhang Sanjeev Arora Sham Kakade A. Krishnamurthy SSL 27 109 0 28 Feb 2022
A Mutually Reinforced Framework for Pretrained Sentence Embeddings Junhan Yang Zheng Liu Shitao Xiao Jianxun Lian Lijun Wu Defu Lian Guangzhong Sun Xing Xie SSL 16 2 0 28 Feb 2022
Exploring the Impact of Negative Samples of Contrastive Learning: A Case Study of Sentence Embedding Rui Cao Yihao Wang Y. Liang Ling Gao Jie Zheng Jie Ren Zheng Wang 27 34 0 26 Feb 2022
SGPT: GPT Sentence Embeddings for Semantic Search Niklas Muennighoff RALM 33 176 0 17 Feb 2022
Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings Malte Ostendorff Nils Rethmeier Isabelle Augenstein Bela Gipp Georg Rehm 21 73 0 14 Feb 2022
Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning Zihan Lin Changxin Tian Yupeng Hou Wayne Xin Zhao 22 418 0 13 Feb 2022
Metadata-Induced Contrastive Learning for Zero-Shot Multi-Label Text Classification Yu Zhang Zhihong Shen Chieh-Han Wu Boya Xie Junheng Hao Yexin Wang Kuansan Wang Jiawei Han VLM 18 27 0 11 Feb 2022
Contrastive predictive coding for Anomaly Detection in Multi-variate Time Series Data Theivendiram Pranavan Terence Sim Arulmurugan Ambikapathi Savitha Ramasamy AI4TS 28 7 0 08 Feb 2022
Comparison and Combination of Sentence Embeddings Derived from Different Supervision Signals Hayato Tsukagoshi Ryohei Sasano Koichi Takeda 20 8 0 07 Feb 2022
A Simple Information-Based Approach to Unsupervised Domain-Adaptive Aspect-Based Sentiment Analysis Xiang Chen Xiaojun Wan 28 3 0 29 Jan 2022
PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings Qiyu Wu Chongyang Tao Tao Shen Can Xu Xiubo Geng Daxin Jiang SSL 27 33 0 28 Jan 2022
SSLGuard: A Watermarking Scheme for Self-supervised Learning Pre-trained Encoders Tianshuo Cong Xinlei He Yang Zhang 21 53 0 27 Jan 2022
Text and Code Embeddings by Contrastive Pre-Training Arvind Neelakantan Tao Xu Raul Puri Alec Radford Jesse Michael Han ... Tabarak Khan Toki Sherbakov Joanne Jang Peter Welinder Lilian Weng SSL AI4TS 232 422 0 24 Jan 2022
Towards Unsupervised Deep Graph Structure Learning Yixin Liu Yu Zheng Daokun Zhang Hongxu Chen Hao Peng Shirui Pan 22 185 0 17 Jan 2022
Robust Contrastive Learning against Noisy Views Ching-Yao Chuang R. Devon Hjelm Xin Wang Vibhav Vineet Neel Joshi Antonio Torralba Stefanie Jegelka Ya-heng Song NoLa 13 68 0 12 Jan 2022
A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision Ajinkya Tejankar Maziar Sanjabi Bichen Wu Saining Xie Madian Khabsa Hamed Pirsiavash Hamed Firooz VLM 29 17 0 27 Dec 2021
Supervised Graph Contrastive Pretraining for Text Classification Samujjwal Ghosh Subhadeep Maji M. Desarkar SSL 6 2 0 21 Dec 2021
Data Efficient Language-supervised Zero-shot Recognition with Optimal Transport Distillation Bichen Wu Rui Cheng Peizhao Zhang Tianren Gao Peter Vajda Joseph E. Gonzalez VLM 22 45 0 17 Dec 2021
Unsupervised Dense Information Retrieval with Contrastive Learning Gautier Izacard Mathilde Caron Lucas Hosseini Sebastian Riedel Piotr Bojanowski Armand Joulin Edouard Grave RALM 38 813 0 16 Dec 2021
DistilCSE: Effective Knowledge Distillation For Contrastive Sentence Embeddings Chaochen Gao Xing Wu Peng Wang Jue Wang Liangjun Zang Zhongyuan Wang Songlin Hu 20 3 0 10 Dec 2021
DeepQR: Neural-based Quality Ratings for Learnersourced Multiple-Choice Questions Lin Ni Qiming Bao Xiaoxuan Li Qianqian Qi Paul Denny Jim Warren Michael Witbrock Jiamo Liu AI4Ed 16 15 0 19 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 75 83 0 08 Nov 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 106 0 01 Nov 2021
Contrastive Document Representation Learning with Graph Attention Networks Peng Xu Xinchi Chen Xiaofei Ma Zhiheng Huang Bing Xiang 14 9 0 20 Oct 2021
Virtual Augmentation Supported Contrastive Learning of Sentence Representations Dejiao Zhang Wei Xiao Henghui Zhu Xiaofei Ma Andrew O. Arnold SSL 51 29 0 16 Oct 2021
Heterogeneous Graph-Based Multimodal Brain Network Learning Gen Shi Yifan Zhu Wenjin Liu Quanming Yao Xia Li 23 7 0 16 Oct 2021
Sentence-aware Contrastive Learning for Open-Domain Passage Retrieval Bohong Wu Zhuosheng Zhang Jinyuan Wang Hai Zhao VLM AI4TS 51 22 0 14 Oct 2021
Batch-Softmax Contrastive Loss for Pairwise Sentence Scoring Tasks Anton Chernyavskiy Dmitry Ilvovsky Pavel Kalinin Preslav Nakov 27 7 0 10 Oct 2021
Towards Learning (Dis)-Similarity of Source Code from Program Contrasts Yangruibo Ding Luca Buratti Saurabh Pujar Alessandro Morari Baishakhi Ray Saikat Chakraborty 21 36 0 08 Oct 2021
Exploiting Twitter as Source of Large Corpora of Weakly Similar Pairs for Semantic Sentence Embeddings Marco Di Giovanni Marco Brambilla 24 10 0 05 Oct 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 95 29 0 27 Sep 2021
DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddings Che Liu Rui Wang Jinghua Liu Jian Sun Fei Huang Luo Si 43 40 0 26 Sep 2021
Adversarial Training with Contrastive Learning in NLP Daniela N. Rim DongNyeong Heo Heeyoul Choi AAML 20 13 0 19 Sep 2021
Interest-oriented Universal User Representation via Contrastive Learning Qinghui Sun Jie Gu Bei Yang Xiaoxiao Xu Renjun Xu Shangde Gao Hong Liu Huan Xu SSL AI4TS 49 6 0 18 Sep 2021
Pairwise Supervised Contrastive Learning of Sentence Representations Dejiao Zhang Shang-Wen Li Wei Xiao Henghui Zhu Ramesh Nallapati Andrew O. Arnold Bing Xiang SSL 55 50 0 12 Sep 2021
Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning Seonghyeon Ye Jiseon Kim Alice H. Oh CLL VLM 24 21 0 10 Sep 2021
PAUSE: Positive and Annealed Unlabeled Sentence Embedding Le-le Cao Emil Larsson Vilhelm von Ehrenheim Dhiana Deva Cavalcanti Rocha Anna Martin Sonja Horn 24 5 0 07 Sep 2021
Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation Haoran Yang W. Lam Pijian Li 24 15 0 03 Sep 2021