A Survey on Contextual Embeddings

16 March 2020

Qi Liu

Papers citing "A Survey on Contextual Embeddings"

50 / 52 papers shown

Title
Contextual Embedding-based Clustering to Identify Topics for Healthcare Service Improvement K. M. S. Islam Ravi Teja Karri Srujan Vegesna Jiawei Wu Praveen Madiraju 19 0 0 18 Apr 2025
The cell as a token: high-dimensional geometry in language models and cell embeddings William Gilpin 77 0 0 26 Mar 2025
Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmark Hongliu Cao AI4TS 35 11 0 27 May 2024
SetCSE: Set Operations using Contrastive Learning of Sentence Embeddings Kang Liu 27 3 0 25 Apr 2024
Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Survey Dinh-Viet-Toan Le Louis Bigo Mikaela Keller Dorien Herremans MedIm 32 9 0 27 Feb 2024
Engineering A Large Language Model From Scratch Abiodun Finbarrs Oketunji 32 0 0 30 Jan 2024
Empowering ChatGPT-Like Large-Scale Language Models with Local Knowledge Base for Industrial Prognostics and Health Management Huan Wang Yan-Fu Li Min Xie LM&MA AI4MH AI4CE 11 4 0 06 Dec 2023
Learning Defect Prediction from Unrealistic Data Kamel Alrashedy Vincent J. Hellendoorn Alessandro Orso 11 5 0 02 Nov 2023
A Family of Pretrained Transformer Language Models for Russian Dmitry Zmitrovich Alexander Abramov Andrey Kalmykov Maria Tikhonova Ekaterina Taktasheva ... Vitalii Kadulin Sergey Markov Tatiana Shavrina Vladislav Mikhailov Alena Fenogenova 28 26 0 19 Sep 2023
A study on the impact of pre-trained model on Just-In-Time defect prediction Yuxiang Guo Xiaopeng Gao Zhenyu Zhang William Chan Bo Jiang VLM 14 3 0 05 Sep 2023
A Comparative Analysis of Pretrained Language Models for Text-to-Speech M. G. Moya Panagiota Karanasou S. Karlapati Bastian Schnell Nicole Peinelt Alexis Moinet Thomas Drugman 37 3 0 04 Sep 2023
Towards Automatic Boundary Detection for Human-AI Collaborative Hybrid Essay in Education Zijie Zeng Lele Sha Yuheng Li Kaixun Yang D. Gašević Guanliang Chen DeLMO 22 12 0 23 Jul 2023
Can Instruction Fine-Tuned Language Models Identify Social Bias through Prompting? O. Dige Jacob-Junqi Tian David B. Emerson Faiza Khan Khattak ALM 20 5 0 19 Jul 2023
Soft-prompt Tuning for Large Language Models to Evaluate Bias Jacob-Junqi Tian David B. Emerson Sevil Zanjani Miyandoab D. Pandya Laleh Seyyed-Kalantari Faiza Khan Khattak VLM 27 10 0 07 Jun 2023
Characterizing and Measuring Linguistic Dataset Drift Tyler A. Chang Kishaloy Halder Neha Ann John Yogarshi Vyas Yassine Benajiba Miguel Ballesteros Dan Roth 13 2 0 26 May 2023
Scaling laws for language encoding models in fMRI Richard Antonello Aditya R. Vaidya Alexander G. Huth MedIm 24 55 0 19 May 2023
Reviewer assignment problem: A scoping review Jelena Jovanovic E. Bagheri 17 2 0 13 May 2023
Pre-trained Embeddings for Entity Resolution: An Experimental Analysis [Experiment, Analysis & Benchmark] Alexandros Zeakis G. Papadakis Dimitrios Skoutas Manolis Koubarakis 29 37 0 24 Apr 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey Xiao Wang Guangyao Chen Guangwu Qian Pengcheng Gao Xiaoyong Wei Yaowei Wang Yonghong Tian Wen Gao AI4CE VLM 31 201 0 20 Feb 2023
Linguistic ambiguity analysis in ChatGPT Miguel Ortega-Martín Óscar García-Sierra Alfonso Ardoiz Jorge Álvarez J. C. Armenteros Adrián Alonso UQLM AI4CE 18 23 0 13 Feb 2023
A comprehensive review of automatic text summarization techniques: method, data, evaluation and coding D. Cajueiro A. G. Nery Igor Tavares Maísa Kely de Melo Silvia A. dos Reis Weigang Li V. R. R. Celestino 28 15 0 04 Jan 2023
Multimodal learning with graphs Yasha Ektefaie George Dasoulas Ayush Noori Maha Farhat Marinka Zitnik 51 82 0 07 Sep 2022
A Graphical Model for Fusing Diverse Microbiome Data Mehmet Aktukmak Haonan Zhu M. Chevrette Julia Nepper S. Magesh J. Handelsman Alfred Hero 19 2 0 21 Aug 2022
Word-Embeddings Distinguish Denominal and Root-Derived Verbs in Semitic Ido Benbaji Omri Doron Adèle Hénot-Mortier 17 1 0 11 Aug 2022
Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russian T. Shamardina Vladislav Mikhailov Daniil Chernianskii Alena Fenogenova Marat Saidov A. Valeeva Tatiana Shavrina I. Smurov E. Tutubalina Ekaterina Artemova DeLMO 16 30 0 03 Jun 2022
mGPT: Few-Shot Learners Go Multilingual Oleh Shliazhko Alena Fenogenova Maria Tikhonova Vladislav Mikhailov Anastasia Kozlova Tatiana Shavrina 43 149 0 15 Apr 2022
GWA: A Large High-Quality Acoustic Dataset for Audio Processing Zhenyu Tang R. Aralikatti Anton Ratnarajah Dinesh Manocha 27 31 0 04 Apr 2022
SGPT: GPT Sentence Embeddings for Semantic Search Niklas Muennighoff RALM 25 175 0 17 Feb 2022
On Cross-Lingual Retrieval with Multilingual Text Encoders Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavavs 11 38 0 21 Dec 2021
A Deep Learning Approach for Ontology Enrichment from Unstructured Text Lalit Mohan Sanagavarapu Vivek Iyer Y. R. Reddy 20 6 0 16 Dec 2021
Focusing on Potential Named Entities During Active Label Acquisition Ali Osman Berk Şapcı Oznur Tastan Reyyan Yeniterzi 27 2 0 06 Nov 2021
A Comprehensive Comparison of Word Embeddings in Event & Entity Coreference Resolution Judicael Poumay A. Ittoo 6 2 0 11 Oct 2021
Pre-trained Language Models in Biomedical Domain: A Systematic Survey Benyou Wang Qianqian Xie Jiahuan Pei Zhihong Chen Prayag Tiwari Zhao Li Jie Fu LM&MA AI4CE 37 163 0 11 Oct 2021
A Survey On Neural Word Embeddings Erhan Sezerer Selma Tekir AI4TS 26 12 0 05 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 30 5 0 01 Oct 2021
Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations Ekaterina Taktasheva Vladislav Mikhailov Ekaterina Artemova 19 13 0 28 Sep 2021
MigrationsKB: A Knowledge Base of Public Attitudes towards Migrations and their Driving Factors Yiyi Chen Harald Sack Mehwish Alam 18 3 0 17 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 26 260 0 12 Aug 2021
Are Pre-trained Convolutions Better than Pre-trained Transformers? Yi Tay Mostafa Dehghani J. Gupta Dara Bahri V. Aribandi Zhen Qin Donald Metzler AI4CE 22 48 0 07 May 2021
Literature review on vulnerability detection using NLP technology Jiajie Wu 39 14 0 23 Apr 2021
AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha LM&MA MedIm 20 164 0 16 Apr 2021
Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders Brendan Chambers James A. Evans MedIm 13 0 0 13 Apr 2021
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval Robert Litschko Ivan Vulić Simone Paolo Ponzetto Goran Glavavs 13 23 0 21 Jan 2021
User-friendly automatic transcription of low-resource languages: Plugging ESPnet into Elpis Oliver Adams Benjamin Galliot Guillaume Wisniewski Nicholas Lambourne Ben Foley ... Laurent Besacier Christopher Cox Katya Aplonova Guillaume Jacques Nathan W. Hill 24 10 0 15 Dec 2020
Syntax Representation in Word Embeddings and Neural Networks -- A Survey Tomasz Limisiewicz David Marecek NAI 23 9 0 02 Oct 2020
Data-Efficient Pretraining via Contrastive Self-Supervision Nils Rethmeier Isabelle Augenstein 15 20 0 02 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders Patrick Xia Shijie Wu Benjamin Van Durme 26 50 0 02 Oct 2020
Label or Message: A Large-Scale Experimental Survey of Texts and Objects Co-Occurrence Koki Takeshita Juntaro Shioyama S. Uchida 12 1 0 30 Jul 2020
Deep Learning for Insider Threat Detection: Review, Challenges and Opportunities Shuhan Yuan Xintao Wu AAML 20 156 0 25 May 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,450 0 18 Mar 2020