On the Sentence Embeddings from Pre-trained Language Models

2 November 2020

Lei Li

Papers citing "On the Sentence Embeddings from Pre-trained Language Models"

32 / 82 papers shown

Title
PromptBERT: Improving BERT Sentence Embeddings with Prompts Ting Jiang Jian Jiao Shaohan Huang Zi-qiang Zhang Deqing Wang Fuzhen Zhuang Furu Wei Haizhen Huang Liangjie Zhang Qi Zhang 24 119 0 12 Jan 2022
The Curious Layperson: Fine-Grained Image Recognition without Expert Labels Subhabrata Choudhury Iro Laina Christian Rupprecht Andrea Vedaldi VLM 38 9 0 05 Nov 2021
Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations Fangyu Liu Yunlong Jiao Jordan Massiah Emine Yilmaz Serhii Havrylov SSL 95 29 0 27 Sep 2021
DialogueCSE: Dialogue-based Contrastive Learning of Sentence Embeddings Che Liu Rui Wang Jinghua Liu Jian Sun Fei Huang Luo Si 43 40 0 26 Sep 2021
Learning Kernel-Smoothed Machine Translation with Retrieved Examples Qingnan Jiang Mingxuan Wang Jun Cao Shanbo Cheng Shujian Huang Lei Li 39 33 0 21 Sep 2021
Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration Shufan Wang Laure Thompson Mohit Iyyer 180 66 0 13 Sep 2021
How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy S. Rajaee Mohammad Taher Pilehvar 79 20 0 10 Sep 2021
ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding Xing Wu Chaochen Gao Liangjun Zang Jizhong Han Zhongyuan Wang Songlin Hu SSL AILaw 39 129 0 09 Sep 2021
Smoothed Contrastive Learning for Unsupervised Sentence Embedding Xing Wu Chaochen Gao Liangjun Zang Jizhong Han Zhongyuan Wang Songlin Hu SSL AILaw 16 18 0 09 Sep 2021
Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast Liang Wang Wei-Ye Zhao Jingming Liu 34 14 0 01 Sep 2021
Sentence Bottleneck Autoencoders from Transformer Language Models Ivan Montero Nikolaos Pappas Noah A. Smith AI4CE 22 28 0 31 Aug 2021
Reinforcement Learning-powered Semantic Communication via Semantic Similarity Kun Lu Rongpeng Li Xianfu Chen Zhifeng Zhao Honggang Zhang 21 52 0 27 Aug 2021
Enhanced Seq2Seq Autoencoder via Contrastive Learning for Abstractive Text Summarization Chujie Zheng Kunpeng Zhang Harry J. Wang Ling Fan Zhe Wang 25 6 0 26 Aug 2021
SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation Xin Wang Yasheng Wang Fei Mi Pingyi Zhou Yao Wan Xiao Liu Li Li Hao Wu Jin Liu Xin Jiang 39 111 0 10 Aug 2021
Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning Chiyu Zhang Muhammad Abdul-Mageed ObjD AI4CE 13 6 0 01 Aug 2021
ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling Ashish Shenoy S. Bodapati Katrin Kirchhoff 20 15 0 15 Jun 2021
Sentence Similarity Based on Contexts Xiaofei Sun Yuxian Meng Xiang Ao Fei Wu Tianwei Zhang Jiwei Li Chun Fan 28 29 0 17 May 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 48 3,260 0 18 Apr 2021
Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence Encoders Fangyu Liu Ivan Vulić Anna Korhonen Nigel Collier VLM OffRL 27 117 0 16 Apr 2021
Generating Datasets with Pretrained Language Models Timo Schick Hinrich Schütze 13 234 0 15 Apr 2021
TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning Kexin Wang Nils Reimers Iryna Gurevych 11 177 0 14 Apr 2021
Sentence Embeddings by Ensemble Distillation Fredrik Carlsson Magnus Sahlgren 16 1 0 14 Apr 2021
Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models James Y. Huang Kuan-Hao Huang Kai-Wei Chang 14 21 0 11 Apr 2021
Whitening Sentence Representations for Better Semantics and Faster Retrieval Jianlin Su Jiarun Cao Weijie Liu Yangyiwen Ou 10 292 0 29 Mar 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 42 18 0 18 Mar 2021
Optimal Embedding Calibration for Symbolic Music Similarity Xinran Zhang Maosong Sun Jiafeng Liu Xiaobing Li 8 1 0 13 Mar 2021
Local Calibration: Metrics and Recalibration Rachel Luo Aadyot Bhatnagar Yu Bai Shengjia Zhao Huan Wang Caiming Xiong Silvio Savarese Stefano Ermon Edward Schmerling Marco Pavone 24 14 0 22 Feb 2021
How to Learn when Data Reacts to Your Model: Performative Gradient Descent Zachary Izzo Lexing Ying James Zou 87 74 0 15 Feb 2021
The Curse of Dense Low-Dimensional Information Retrieval for Large Index Sizes Nils Reimers Iryna Gurevych 21 58 0 28 Dec 2020
BERT Goes Shopping: Comparing Distributional Models for Product Representations Federico Bianchi Bingqing Yu Jacopo Tagliabue 25 15 0 17 Dec 2020
Medical Code Assignment with Gated Convolution and Note-Code Interaction Shaoxiong Ji Shirui Pan Pekka Marttinen MedIm 27 18 0 14 Oct 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018