Controlling Conditional Language Models without Catastrophic Forgetting

v1v2 (latest)

Controlling Conditional Language Models without Catastrophic Forgetting

1 December 2021

Germán Kruszewski

ArXiv (abs)PDF HTML

Papers citing "Controlling Conditional Language Models without Catastrophic Forgetting"

15 / 15 papers shown

Title
Disentangling Dual-Encoder Masked Autoencoder for Respiratory Sound Classification Peidong Wei Shiyu Miao Lin Li Shiyu Miao Lin Li 116 0 0 12 Jun 2025
Self-Data Distillation for Recovering Quality in Pruned Large Language Models Vithursan Thangarasa Ganesh Venkatesh Mike Lasby Nish Sinnadurai Sean Lie SyDa 175 2 0 13 Oct 2024
Guaranteed Generation from Large Language Models Minbeom Kim Thibaut Thonet Jos Rozen Hwaran Lee Kyomin Jung Marc Dymetman 84 1 0 09 Oct 2024
Reasoning Elicitation in Language Models via Counterfactual Feedback Alihan Hüyük Xinnuo Xu Jacqueline R. M. A. Maasch Aditya V. Nori Javier González ReLM LRM 449 3 0 02 Oct 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 177 5 0 30 Jul 2024
Towards Minimal Targeted Updates of Language Models with Targeted Negative Training Lily H. Zhang Rajesh Ranganath Arya Tafvizi 117 1 0 19 Jun 2024
SuperHF: Supervised Iterative Learning from Human Feedback Gabriel Mukobi Peter Chatain Su Fong Robert Windesheim Gitta Kutyniok Kush S. Bhatia Silas Alberti ALM 92 8 0 25 Oct 2023
ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation Jianghao Lin Rongjie Shan Chenxu Zhu Kounianhua Du Bo Chen Shigang Quan Ruiming Tang Yong Yu Weinan Zhang LRM 210 93 0 22 Aug 2023
disco: a toolkit for Distributional Control of Generative Models Germán Kruszewski Jos Rozen Marc Dymetman 59 4 0 08 Mar 2023
GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation Jing Zhang Yanling Wang Daniel Zhang-Li Jifan Yu Zijun Yao ... Xiaohan Zhang Nianyi Lin Sunrui Lu Juan Li Jie Tang 81 19 0 28 Feb 2023
Aligning Language Models with Preferences through f-divergence Minimization Dongyoung Go Tomasz Korbak Germán Kruszewski Jos Rozen Nahyeon Ryu Marc Dymetman 107 76 0 16 Feb 2023
PEER: A Collaborative Language Model Timo Schick Jane Dwivedi-Yu Zhengbao Jiang Fabio Petroni Patrick Lewis Gautier Izacard Qingfei You Christoforos Nalmpantis Edouard Grave Sebastian Riedel ALM 106 97 0 24 Aug 2022
On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting Tomasz Korbak Hady ElSahar Germán Kruszewski Marc Dymetman CLL 105 57 0 01 Jun 2022
Controllable Text Generation with Neurally-Decomposed Oracle Tao Meng Sidi Lu Nanyun Peng Kai-Wei Chang BDL 103 37 0 27 May 2022
Gradient-Based Constrained Sampling from Language Models Sachin Kumar Biswajit Paria Yulia Tsvetkov BDL 99 57 0 25 May 2022