Unsupervised Domain Clusters in Pretrained Language Models

5 April 2020

Papers citing "Unsupervised Domain Clusters in Pretrained Language Models"

50 / 61 papers shown

Title
Improving Retrieval-Augmented Neural Machine Translation with Monolingual Data Maxime Bouthors Josep Crego François Yvon RALM LRM 51 0 0 30 Apr 2025
DMDTEval: An Evaluation and Analysis of LLMs on Disambiguation in Multi-domain Translation Zhibo Man Yuanmeng Chen Yuyao Zhang Yufeng Chen Jinan Xu 62 0 0 29 Apr 2025
Generate to Discriminate: Expert Routing for Continual Learning Yewon Byun Sanket Vaibhav Mehta Saurabh Garg Emma Strubell Michael Oberst Bryan Wilder Zachary Chase Lipton 78 0 0 31 Dec 2024
Task-Adaptive Pretrained Language Models via Clustered-Importance Sampling David Grangier Simin Fan Skyler Seto Pierre Ablin 41 3 0 30 Sep 2024
Explaining Datasets in Words: Statistical Models with Natural Language Parameters Ruiqi Zhong Heng Wang Dan Klein Jacob Steinhardt 37 6 0 13 Sep 2024
On Behalf of the Stakeholders: Trends in NLP Model Interpretability in the Era of LLMs Nitay Calderon Roi Reichart 40 10 0 27 Jul 2024
AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees William Fleshman Aleem Khan Marc Marone Benjamin Van Durme CLL KELM 55 3 0 12 Apr 2024
Improving Neural Machine Translation by Multi-Knowledge Integration with Prompting Ke Min Wang Jun Xie Yuqi Zhang Yu Zhao AI4CE 17 2 0 08 Dec 2023
There's no Data Like Better Data: Using QE Metrics for MT Data Filtering Jan-Thorsten Peter David Vilar Daniel Deutsch Mara Finkelstein Juraj Juraska Markus Freitag 14 16 0 09 Nov 2023
Towards Concept-Aware Large Language Models Chen Shani Jilles Vreeken Dafna Shahaf LRM 22 6 0 03 Nov 2023
Human-in-the-loop Machine Translation with Large Language Model Xinyi Yang Runzhe Zhan Derek F. Wong Junchao Wu Lidia S. Chao 21 3 0 13 Oct 2023
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework Yangyi Chen Hongcheng Gao Ganqu Cui Lifan Yuan Dehan Kong ... Longtao Huang H. Xue Zhiyuan Liu Maosong Sun Heng Ji AAML ELM 27 6 0 29 May 2023
Augmenting Large Language Model Translators via Translation Memories Yongyu Mu Abudurexiti Reheman Zhiquan Cao Yuchun Fan Bei Li Yinqiao Li Tong Xiao Chunliang Zhang Jingbo Zhu LRM 30 25 0 27 May 2023
Bridging the Domain Gaps in Context Representations for k-Nearest Neighbor Neural Machine Translation Zhiwei Cao Baosong Yang Huan Lin Suhang Wu Xiangpeng Wei Dayiheng Liu Jun Xie Min Zhang Jinsong Su 23 2 0 26 May 2023
CombLM: Adapting Black-Box Language Models through Small Fine-Tuned Models Aitor Ormazabal Mikel Artetxe Eneko Agirre 33 19 0 23 May 2023
MEGClass: Extremely Weakly Supervised Text Classification via Mutually-Enhancing Text Granularities Priyanka Kargupta Tanay Komarlu Susik Yoon Xuan Wang Jiawei Han 31 8 0 04 Apr 2023
Scaling Expert Language Models with Unsupervised Domain Discovery Suchin Gururangan Margaret Li M. Lewis Weijia Shi Tim Althoff Noah A. Smith Luke Zettlemoyer MoE 25 46 0 24 Mar 2023
Goal Driven Discovery of Distributional Differences via Language Descriptions Ruiqi Zhong Peter Zhang Steve Li Jinwoo Ahn Dan Klein Jacob Steinhardt 47 48 0 28 Feb 2023
AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Alexander Fraser Jesse Dodge MoMe 21 65 0 14 Feb 2023
N-Gram Nearest Neighbor Machine Translation Rui Lv Junliang Guo Rui Wang Xu Tan Qi Liu Tao Qin 23 2 0 30 Jan 2023
Interpretability in Activation Space Analysis of Transformers: A Focused Survey Soniya Vijayakumar AI4CE 32 3 0 22 Jan 2023
Prompting Large Language Model for Machine Translation: A Case Study Biao Zhang Barry Haddow Alexandra Birch LRM 18 274 0 17 Jan 2023
Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publications L. Lucy Jesse Dodge David Bamman Katherine A. Keith 34 9 0 19 Dec 2022
What Knowledge Is Needed? Towards Explainable Memory for kNN-MT Domain Adaptation Wenhao Zhu Shujian Huang Yunzhe Lv Xin Zheng Jiajun Chen 25 7 0 08 Nov 2022
Continual Learning of Neural Machine Translation within Low Forgetting Risk Regions Shuhao Gu Bojie Hu Yang Feng CLL 33 11 0 03 Nov 2022
Beyond Prompting: Making Pre-trained Language Models Better Zero-shot Learners by Clustering Representations Yu Fei Ping Nie Zhao Meng Roger Wattenhofer Mrinmaya Sachan VLM 47 20 0 29 Oct 2022
Specializing Multi-domain NMT via Penalizing Low Mutual Information Jiyoung Lee H. Kim Hyun Chang Cho E. Choi Cheonbok Park 21 4 0 24 Oct 2022
$m^4Adapter$ : Multilingual Multi-Domain Adaptation for Machine Translation with a Meta-Adapter Wen Lai Alexandra Chronopoulou Alexander Fraser 16 3 0 21 Oct 2022
Improving Robustness of Retrieval Augmented Translation via Shuffling of Suggestions Cuong Hoang Devendra Singh Sachan Prashant Mathur Brian Thompson Marcello Federico 35 2 0 11 Oct 2022
Zero-shot Domain Adaptation for Neural Machine Translation with Retrieved Phrase-level Prompts Zewei Sun Qingnan Jiang Shujian Huang Jun Cao Shanbo Cheng Mingxuan Wang VLM 46 8 0 23 Sep 2022
Generalizing through Forgetting -- Domain Generalization for Symptom Event Extraction in Clinical Notes Sitong Zhou K. Lybarger Meliha Yetisgen-Yildiz Mari Ostendorf 34 2 0 20 Sep 2022
T-NER: An All-Round Python Library for Transformer-based Named Entity Recognition Asahi Ushio Jose Camacho-Collados 12 72 0 09 Sep 2022
On the Limitations of Sociodemographic Adaptation with Transformers Chia-Chien Hung Anne Lauscher Dirk Hovy Simone Paolo Ponzetto Goran Glavavs 19 0 0 01 Aug 2022
Domain Confused Contrastive Learning for Unsupervised Domain Adaptation Quanyu Long Tianze Luo Wenya Wang Sinno Jialin Pan 54 8 0 10 Jul 2022
Augmenting Scientific Creativity with Retrieval across Knowledge Domains Hyeonsu B Kang Sheshera Mysore Kevin Huang Haw-Shiuan Chang Thorben Prein Andrew McCallum A. Kittur E. Olivetti 26 9 0 02 Jun 2022
Chunk-based Nearest Neighbor Machine Translation Pedro Henrique Martins Zita Marinho André F.T. Martins RALM 80 28 0 24 May 2022
Lack of Fluency is Hurting Your Translation Model J. Yoo Jaewoo Kang 18 0 0 24 May 2022
Nearest Neighbor Knowledge Distillation for Neural Machine Translation Zhixian Yang Renliang Sun Xiaojun Wan 15 12 0 01 May 2022
Efficient Machine Translation Domain Adaptation Pedro Henrique Martins Zita Marinho André F.T. Martins 67 14 0 26 Apr 2022
Explainable Misinformation Detection Across Multiple Social Media Platforms Gargi Joshi Ananya Srivastava Bhargav D. Yagnik Md Musleh Uddin Hasan Zainuddin Saiyed Lubna A Gabralla Ajith Abraham Rahee Walambe K. Kotecha 23 17 0 20 Mar 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP Yulong Chen Yang Liu Li Dong Shuohang Wang Chenguang Zhu Michael Zeng Yue Zhang VLM 27 45 0 10 Feb 2022
Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval Uri Alon Frank F. Xu Junxian He Sudipta Sengupta Dan Roth Graham Neubig RALM 77 62 0 28 Jan 2022
Describing Differences between Text Distributions with Natural Language Ruiqi Zhong Charles Burton Snell Dan Klein Jacob Steinhardt VLM 132 42 0 28 Jan 2022
Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Jesse Dodge 23 42 0 16 Dec 2021
Sequential Reptile: Inter-Task Gradient Alignment for Multilingual Learning Seanie Lee Haebeom Lee Juho Lee Sung Ju Hwang MoMe CLL 38 16 0 06 Oct 2021
Learning Kernel-Smoothed Machine Translation with Retrieved Examples Qingnan Jiang Mingxuan Wang Jun Cao Shanbo Cheng Shujian Huang Lei Li 31 33 0 21 Sep 2021
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation Xin Zheng Zhirui Zhang Shujian Huang Boxing Chen Jun Xie Weihua Luo Jiajun Chen 68 25 0 14 Sep 2021
Efficient Nearest Neighbor Language Models Junxian He Graham Neubig Taylor Berg-Kirkpatrick RALM 195 103 0 09 Sep 2021
GAIA: A Transfer Learning System of Object Detection that Fits Your Needs Xingyuan Bu Junran Peng Junjie Yan Tieniu Tan Zhaoxiang Zhang ObjD VLM 28 53 0 21 Jun 2021
CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding Dustin Wright Isabelle Augenstein 8 24 0 23 May 2021