DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts

7 May 2021

Yejin Choi

Papers citing "DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts"

50 / 274 papers shown

Title
"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters Yixin Wan George Pu Jiao Sun Aparna Garimella Kai-Wei Chang Nanyun Peng 41 163 0 13 Oct 2023
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection Sehyun Choi Tianqing Fang Zhaowei Wang Yangqiu Song 35 33 0 13 Oct 2023
The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values Hannah Rose Kirk Andrew M. Bean Bertie Vidgen Paul Röttger Scott A. Hale ALM 23 42 0 11 Oct 2023
Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Models Luiza Amador Pozzobon Beyza Ermis Patrick Lewis Sara Hooker 36 20 0 11 Oct 2023
Amortizing intractable inference in large language models Marvin Schmitt Moksh Jain Daniel Habermann Younesse Kaddar Ullrich Kothe Stefan T. Radev Nikolay Malkin AIFin BDL 32 49 0 06 Oct 2023
Controllable Text Generation with Residual Memory Transformer Hanqing Zhang Sun Si Haiming Wu Dawei Song 37 1 0 28 Sep 2023
Is it Possible to Modify Text to a Target Readability Level? An Initial Investigation Using Zero-Shot Large Language Models Asma Farajidizaji Vatsal Raina Mark Gales 40 1 0 22 Sep 2023
Contrastive Decoding Improves Reasoning in Large Language Models Sean O'Brien Mike Lewis SyDa LRM ReLM 32 32 0 17 Sep 2023
How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models? Danni Liu Jan Niehues 16 3 0 15 Sep 2023
Bias and Fairness in Large Language Models: A Survey Isabel O. Gallegos Ryan A. Rossi Joe Barrow Md Mehrab Tanjim Sungchul Kim Franck Dernoncourt Tong Yu Ruiyi Zhang Nesreen Ahmed AILaw 40 498 0 02 Sep 2023
Text-Only Training for Visual Storytelling Yuechen Wang Wen-gang Zhou Zhenbo Lu Houqiang Li DiffM 28 2 0 17 Aug 2023
CMD: a framework for Context-aware Model self-Detoxification Zecheng Tang Keyan Zhou Juntao Li Yuyang Ding Pinzheng Wang Bowen Yan Minzhang MU 25 5 0 16 Aug 2023
Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module Operation Xinshuo Hu Dongfang Li Baotian Hu Zihao Zheng Zhenyu Liu Hao Fei KELM MU 40 26 0 16 Aug 2023
Teach LLMs to Personalize -- An Approach inspired by Writing Education Cheng Li Mingyang Zhang Qiaozhu Mei Yaqing Wang Spurthi Amba Hombaiah Yi Liang Michael Bendersky AI4Ed 45 33 0 15 Aug 2023
Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation Charles OÑeill Y. Ting 丁 I. Ciucă Jack Miller Thang Bui SyDa 44 1 0 15 Aug 2023
Neural Conversation Models and How to Rein Them in: A Survey of Failures and Fixes Fabian Galetzka Anne Beyer David Schlangen AI4CE 32 1 0 11 Aug 2023
Pluggable Neural Machine Translation Models via Memory-augmented Adapters Yuzhuang Xu Shuo Wang Peng Li Xuebo Liu Xiaolong Wang Weidong Liu Yang Liu 50 1 0 12 Jul 2023
ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oracles Haoqin Tu Bowen Yang Xianfeng Zhao 32 6 0 29 Jun 2023
DiNADO: Norm-Disentangled Neurally-Decomposed Oracles for Controlling Language Models Sidi Lu Wenbo Zhao Chenyang Tao Arpit Gupta Shan Wu Tagyoung Chung Nanyun Peng 29 1 0 20 Jun 2023
KEST: Kernel Distance Based Efficient Self-Training for Improving Controllable Text Generation Yuxi Feng Xiaoyuan Yi L. Lakshmanan Xing Xie 38 1 0 17 Jun 2023
Click: Controllable Text Generation with Sequence Likelihood Contrastive Learning Chujie Zheng Pei Ke Zheng Zhang Minlie Huang BDL 23 31 0 06 Jun 2023
Information Flow Control in Machine Learning through Modular Model Architecture Trishita Tiwari Suchin Gururangan Chuan Guo Weizhe Hua Sanjay Kariyappa Udit Gupta Wenjie Xiong Kiwan Maeng Hsien-Hsin S. Lee G. E. Suh 26 6 0 05 Jun 2023
Structured Voronoi Sampling Afra Amini Li Du Ryan Cotterell DiffM 30 1 0 05 Jun 2023
Fine-Grained Human Feedback Gives Better Rewards for Language Model Training Zeqiu Wu Yushi Hu Weijia Shi Nouha Dziri Alane Suhr Prithviraj Ammanabrolu Noah A. Smith Mari Ostendorf Hannaneh Hajishirzi ALM 53 305 0 02 Jun 2023
Interpretable Math Word Problem Solution Generation Via Step-by-step Planning Mengxue Zhang Zichao Wang Zhichao Yang Weiqi Feng Andrew Lan LRM 22 17 0 01 Jun 2023
CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generation Rahul Madhavan Rishabh Garg Kahini Wadhawan S. Mehta 33 5 0 01 Jun 2023
Focused Prefix Tuning for Controllable Text Generation Congda Ma Tianyu Zhao Makoto Shing Kei Sawada Manabu Okumura 37 8 0 01 Jun 2023
An Invariant Learning Characterization of Controlled Text Generation Carolina Zheng Claudia Shi Keyon Vafa Amir Feder David M. Blei OOD 38 8 0 31 May 2023
Less Likely Brainstorming: Using Language Models to Generate Alternative Hypotheses Liyan Tang Yifan Peng Yanshan Wang Ying Ding Greg Durrett Justin F. Rousseau 32 9 0 30 May 2023
Controlled Text Generation with Hidden Representation Transformations Vaibhav Kumar H. Koorehdavoudi Masud Moshtaghi Amita Misra Ankit Chadha Emilio Ferrara 26 3 0 30 May 2023
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning Ximing Lu Faeze Brahman Peter West Jaehun Jang Khyathi Raghavi Chandu ... Bill Yuchen Lin Skyler Hallinan Xiang Ren Sean Welleck Yejin Choi 28 26 0 24 May 2023
David helps Goliath: Inference-Time Collaboration Between Small Specialized and Large General Diffusion LMs Xiaochuang Han Sachin Kumar Yulia Tsvetkov Marjan Ghazvininejad DiffM 34 3 0 24 May 2023
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding Weijia Shi Xiaochuang Han M. Lewis Yulia Tsvetkov Luke Zettlemoyer Scott Yih HILM 27 192 0 24 May 2023
TalkUp: Paving the Way for Understanding Empowering Language Lucille Njoo Chan Young Park Octavia Stappart Marvin Thielk Yi Chu Yulia Tsvetkov 24 3 0 23 May 2023
Detecting and Mitigating Hallucinations in Multilingual Summarisation Yifu Qiu Yftah Ziser Anna Korhonen Edoardo Ponti Shay B. Cohen HILM 61 43 0 23 May 2023
APPLS: Evaluating Evaluation Metrics for Plain Language Summarization Yue Guo Tal August Gondy Leroy T. Cohen Lucy Lu Wang 57 9 0 23 May 2023
Word Embeddings Are Steers for Language Models Chi Han Jialiang Xu Manling Li Yi R. Fung Chenkai Sun Nan Jiang Tarek Abdelzaher Heng Ji LLMSV 32 29 0 22 May 2023
MacLaSa: Multi-Aspect Controllable Text Generation via Efficient Sampling from Compact Latent Space Hanxing Ding Liang Pang Zihao Wei Huawei Shen Xueqi Cheng Tat-Seng Chua DiffM 43 10 0 22 May 2023
CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing Zhibin Gou Zhihong Shao Yeyun Gong Yelong Shen Yujiu Yang Nan Duan Weizhu Chen KELM LRM 36 360 0 19 May 2023
NeuroComparatives: Neuro-Symbolic Distillation of Comparative Knowledge Phillip Howard Junlin Wang Vasudev Lal Gadi Singer Yejin Choi Swabha Swayamdipta 42 9 0 08 May 2023
Semantic Space Grounded Weighted Decoding for Multi-Attribute Controllable Dialogue Generation Zhiling Zhang Mengyue Wu Ke Zhu AI4CE 30 1 0 04 May 2023
The Benefits of Bad Advice: Autocontrastive Decoding across Model Layers Ariel Gera Roni Friedman Ofir Arviv Chulaka Gunasekara Benjamin Sznajder Noam Slonim Eyal Shnarch 50 19 0 02 May 2023
On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research Luiza Amador Pozzobon Beyza Ermis Patrick Lewis Sara Hooker 46 45 0 24 Apr 2023
Learn What NOT to Learn: Towards Generative Safety in Chatbots Leila Khalatbari Yejin Bang Dan Su Willy Chung Saeedeh Ghadimi Hossein Sameti Pascale Fung 41 7 0 21 Apr 2023
A Cheaper and Better Diffusion Language Model with Soft-Masked Noise Jiaao Chen Aston Zhang Mu Li Alexander J. Smola Diyi Yang DiffM 32 17 0 10 Apr 2023
Elastic Weight Removal for Faithful and Abstractive Dialogue Generation Nico Daheim Nouha Dziri Mrinmaya Sachan Iryna Gurevych Edoardo Ponti MoMe 39 30 0 30 Mar 2023
Unit Scaling: Out-of-the-Box Low-Precision Training Charlie Blake Douglas Orr Carlo Luschi MQ 24 7 0 20 Mar 2023
Diffusion Models for Non-autoregressive Text Generation: A Survey Yifan Li Kun Zhou Wayne Xin Zhao Ji-Rong Wen MedIm DiffM 45 33 0 12 Mar 2023
Automatically Auditing Large Language Models via Discrete Optimization Erik Jones Anca Dragan Aditi Raghunathan Jacob Steinhardt 48 159 0 08 Mar 2023
Mixture of Soft Prompts for Controllable Data Generation Derek Chen Celine Lee Yunan Lu Domenic Rosati Zhou Yu 117 23 0 02 Mar 2023