SentEval: An Evaluation Toolkit for Universal Sentence Representations

14 March 2018

Douwe Kiela

Papers citing "SentEval: An Evaluation Toolkit for Universal Sentence Representations"

50 / 98 papers shown

Title
ChemTEB: Chemical Text Embedding Benchmark, an Overview of Embedding Models Performance & Efficiency on a Specific Domain Ali Shiraee Kasmaee Mohammad Khodadad Mohammad Arshi Saloot Nick Sherck Stephen Dokas H. Mahyar Soheila Samiee ELM 153 0 0 30 Nov 2024
GenEOL: Harnessing the Generative Power of LLMs for Training-Free Sentence Embeddings Raghuveer Thirukovalluru Bhuwan Dhingra 29 2 0 18 Oct 2024
Pixology: Probing the Linguistic and Visual Capabilities of Pixel-based Language Models Kushal Tatariya Vladimir Araujo Thomas Bauwens Miryam de Lhoneux VLM 29 0 0 15 Oct 2024
GLOV: Guided Large Language Models as Implicit Optimizers for Vision Language Models Muhammad Jehanzeb Mirza Mengjie Zhao Zhuoyuan Mao Sivan Doveh Wei Lin ... Yuki Mitsufuji Horst Possegger Rogerio Feris Leonid Karlinsky James Glass VLM 76 1 0 08 Oct 2024
The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model design Artem Snegirev Maria Tikhonova Anna Maksimova Alena Fenogenova Alexander Abramov 26 4 0 22 Aug 2024
Can't Hide Behind the API: Stealing Black-Box Commercial Embedding Models Manveer Singh Tamber Jasper Xian Jimmy Lin MLAU SILM 131 0 0 13 Jun 2024
The Scandinavian Embedding Benchmarks: Comprehensive Assessment of Multilingual and Monolingual Text Embedding K. Enevoldsen Márton Kardos Niklas Muennighoff Kristoffer Laigaard Nielbo 29 9 0 04 Jun 2024
Unveiling Key Aspects of Fine-Tuning in Sentence Embeddings: A Representation Rank Analysis Euna Jung Jaeill Kim Jungmin Ko Jinwoo Park Wonjong Rhee 40 0 0 18 May 2024
Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization Yuhang Li Xin Dong Chen Chen Jingtao Li Yuxin Wen Michael Spranger Lingjuan Lyu DiffM 28 4 0 28 Mar 2024
UNSEE: Unsupervised Non-contrastive Sentence Embeddings Ömer Veysel Çagatan SSL 19 0 0 27 Jan 2024
Some Like It Small: Czech Semantic Embedding Models for Industry Applications Jirí Bednár Jakub Náplava Petra Barancíková Ondrej Lisický 20 5 0 23 Nov 2023
BeLLM: Backward Dependency Enhanced Large Language Model for Sentence Embeddings Xianming Li Jing Li 42 10 0 09 Nov 2023
The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages Chiyu Zhang Khai Duy Doan Qisheng Liao Muhammad Abdul-Mageed 34 6 0 23 Oct 2023
IDTraffickers: An Authorship Attribution Dataset to link and connect Potential Human-Trafficking Operations on Text Escort Advertisements V. Saxena Benjamin Bashpole Gijs Van Dijck Gerasimos Spanakis 40 2 0 09 Oct 2023
CoT-BERT: Enhancing Unsupervised Sentence Representation through Chain-of-Thought Bowen Zhang Kehua Chang Chunping Li SSL 30 6 0 20 Sep 2023
Scaling Sentence Embeddings with Large Language Models Ting Jiang Shaohan Huang Zhongzhi Luan Deqing Wang Fuzhen Zhuang LRM 34 40 0 31 Jul 2023
Instruction-following Evaluation through Verbalizer Manipulation Shiyang Li Jun Yan Hai Wang Zheng Tang Xiang Ren Vijay Srinivasan Hongxia Jin 28 25 0 20 Jul 2023
Morphosyntactic probing of multilingual BERT models Judit Ács Endre Hamerlik Roy Schwartz Noah A. Smith András Kornai 27 9 0 09 Jun 2023
A Comprehensive Survey of Sentence Representations: From the BERT Epoch to the ChatGPT Era and Beyond Abhinav Ramesh Kashyap Thang-Tung Nguyen Viktor Schlegel Stefan Winkler See-Kiong Ng Soujanya Poria AI4TS 3DV SSL 29 6 0 22 May 2023
Automated Few-shot Classification with Instruction-Finetuned Language Models Rami Aly Xingjian Shi Kaixiang Lin Aston Zhang A. Wilson 19 9 0 21 May 2023
Description-Based Text Similarity Shauli Ravfogel Valentina Pyatkin Amir D. N. Cohen Avshalom Manevich Yoav Goldberg 20 5 0 21 May 2023
Prompting with Pseudo-Code Instructions Mayank Mishra Prince Kumar Riyaz Ahmad Bhat V. Rudramurthy Danish Contractor Srikanth G. Tamilselvam 35 13 0 19 May 2023
Semantic Similarity Measure of Natural Language Text through Machine Learning and a Keyword-Aware Cross-Encoder-Ranking Summarizer -- A Case Study Using UCGIS GIS&T Body of Knowledge Yuanyuan Tian Wenwen Li Sizhe Wang Zhining Gu 14 3 0 17 May 2023
DLUE: Benchmarking Document Language Understanding Ruoxi Xu Hongyu Lin Xinyan Guan Xianpei Han Yingfei Sun Le Sun ELM 16 0 0 16 May 2023
Rediscovering Hashed Random Projections for Efficient Quantization of Contextualized Sentence Embeddings Ulf A. Hamster Ji-Ung Lee Alexander Geyken Iryna Gurevych 16 0 0 13 Mar 2023
Detecting Contextomized Quotes in News Headlines by Contrastive Learning Seonyeong Song Hyeonho Song Kunwoo Park Jiyoung Han M. Cha 14 1 0 09 Feb 2023
Tsetlin Machine Embedding: Representing Words Using Logical Expressions Bimal Bhattarai Ole-Christoffer Granmo Lei Jiao Rohan Kumar Yadav Jivitesh Sharma NAI 9 12 0 02 Jan 2023
One Embedder, Any Task: Instruction-Finetuned Text Embeddings Hongjin Su Weijia Shi Jungo Kasai Yizhong Wang Yushi Hu Mari Ostendorf Wen-tau Yih Noah A. Smith Luke Zettlemoyer Tao Yu 25 278 0 19 Dec 2022
Revisiting Distance Metric Learning for Few-Shot Natural Language Classification Witold Sosnowski Anna Wróblewska Karolina Seweryn P. Gawrysiak 18 0 0 28 Nov 2022
Distance Metric Learning Loss Functions in Few-Shot Scenarios of Supervised Language Models Fine-Tuning Witold Sosnowski Karolina Seweryn Anna Wróblewska P. Gawrysiak 18 0 0 28 Nov 2022
50 Ways to Bake a Cookie: Mapping the Landscape of Procedural Texts Moran Mizrahi Dafna Shahaf DiffM 15 4 0 31 Oct 2022
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation O. Serikov Vitaly Protasov E. Voloshina V. Knyazkova Tatiana Shavrina 27 3 0 24 Oct 2022
AugCSE: Contrastive Sentence Embedding with Diverse Augmentations Zilu Tang Muhammed Yusuf Kocyigit Derry Wijaya 23 8 0 20 Oct 2022
MTEB: Massive Text Embedding Benchmark Niklas Muennighoff Nouamane Tazi L. Magne Nils Reimers 26 370 0 13 Oct 2022
Analyzing Text Representations under Tight Annotation Budgets: Measuring Structural Alignment César González-Gutiérrez Audi Primadhanty Francesco Cazzaro A. Quattoni 23 0 0 11 Oct 2022
Unsupervised Sentence Textual Similarity with Compositional Phrase Semantics Zihao W. Wang Jiaheng Dou Yong Zhang OT 24 4 0 05 Oct 2022
Efficient Few-Shot Learning Without Prompts Lewis Tunstall Nils Reimers Unso Eun Seo Jo Luke Bates Daniel Korat Moshe Wasserblat Oren Pereg VLM 30 181 0 22 Sep 2022
Ranking-Enhanced Unsupervised Sentence Representation Learning Yeon Seonwoo Guoyin Wang Changmin Seo Sajal Choudhary Jiwei Li Xiang Li Puyang Xu Sunghyun Park Alice H. Oh SSL DRL AI4TS 47 15 0 09 Sep 2022
Masked Autoencoders As The Unified Learners For Pre-Trained Sentence Representation Alexander H. Liu Samuel J. Yang 24 5 0 30 Jul 2022
Knowledge Distillation of Transformer-based Language Models Revisited Chengqiang Lu Jianwei Zhang Yunfei Chu Zhengyu Chen Jingren Zhou Fei Wu Haiqing Chen Hongxia Yang VLM 19 10 0 29 Jun 2022
Evaluating Self-Supervised Learning for Molecular Graph Embeddings Hanchen Wang Jean Kaddour Shengchao Liu Jian Tang Joan Lasenby Qi Liu 22 20 0 16 Jun 2022
A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference Shuang Li Xuming Hu Li Lin Aiwei Liu Lijie Wen Philip S. Yu 25 18 0 31 May 2022
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 31 27 0 30 May 2022
Parameter-Efficient and Student-Friendly Knowledge Distillation Jun Rao Xv Meng Liang Ding Shuhan Qi Dacheng Tao 29 46 0 28 May 2022
Unsupervised Attention-based Sentence-Level Meta-Embeddings from Contextualised Language Models Keigo Takahashi Danushka Bollegala 28 5 0 16 Apr 2022
Contextual Representation Learning beyond Masked Language Modeling Zhiyi Fu Wangchunshu Zhou Jingjing Xu Hao Zhou Lei Li 23 25 0 08 Apr 2022
How does the pre-training objective affect what large language models learn about linguistic properties? Ahmed Alajrami Nikolaos Aletras 21 20 0 20 Mar 2022
SCD: Self-Contrastive Decorrelation for Sentence Embeddings T. Klein Moin Nabi SSL 19 25 0 15 Mar 2022
Just Rank: Rethinking Evaluation with Word and Sentence Similarities Bin Wang C.-C. Jay Kuo Haizhou Li ELM 6 29 0 05 Mar 2022
Comparison and Combination of Sentence Embeddings Derived from Different Supervision Signals Hayato Tsukagoshi Ryohei Sasano Koichi Takeda 12 8 0 07 Feb 2022