v1v2v3 (latest)

COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamics

23 February 2022

Lianhui Qin

Sean Welleck

Daniel Khashabi

Yejin Choi

AI4CE

ArXiv (abs)PDF HTML

Papers citing "COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamics"

50 / 114 papers shown

Title
DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generation Chen Xu Tian Lan Changlong Yu Wei Wang Jun Gao ... Qunxi Dong Kun Qian Piji Li Wei Bi Bin Hu 82 1 0 04 Mar 2024
Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding Guangyi Liu Yu Wang Zeyu Feng Qiyu Wu Liping Tang ... Shuguang Cui Julian McAuley Zichao Yang Eric P. Xing Zhiting Hu DiffM 97 4 0 29 Feb 2024
Generative AI Security: Challenges and Countermeasures Banghua Zhu Norman Mu Jiantao Jiao David Wagner AAML SILM 107 10 0 20 Feb 2024
COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability Xing-ming Guo Fangxu Yu Huan Zhang Lianhui Qin Bin Hu AAML 178 92 0 13 Feb 2024
A Roadmap to Pluralistic Alignment Taylor Sorensen Jared Moore Jillian R. Fisher Mitchell L. Gordon Niloofar Mireshghallah ... Liwei Jiang Ximing Lu Nouha Dziri Tim Althoff Yejin Choi 142 94 0 07 Feb 2024
Constrained Decoding for Cross-lingual Label Projection Duong Minh Le Yang Chen Alan Ritter Wei Xu 65 7 0 05 Feb 2024
DeAL: Decoding-time Alignment for Large Language Models James Y. Huang Sailik Sengupta Daniele Bonadiman Yi-An Lai Arshit Gupta Nikolaos Pappas Saab Mansour Katrin Kirchoff Dan Roth 129 36 0 05 Feb 2024
Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents Zelong Li Wenyue Hua Hao Wang He Zhu Yongfeng Zhang LLMAG 135 23 0 01 Feb 2024
Effective Controllable Bias Mitigation for Classification and Retrieval using Gate Adapters Shahed Masoudian Cornelia Volaucnik Markus Schedl Navid Rekabsaz 73 6 0 29 Jan 2024
DeepEdit: Knowledge Editing as Decoding with Constraints Yiwei Wang Muhao Chen Nanyun Peng Kai-Wei Chang KELM 97 28 0 19 Jan 2024
Controllable Decontextualization of Yes/No Question and Answers into Factual Statements Lingbo Mo B. Fetahu Oleg Rokhlenko S. Malmasi 82 0 0 18 Jan 2024
Benchmarking Large Language Models on Controllable Generation under Diversified Instructions Yihan Chen Benfeng Xu Quan Wang Yi Liu Zhendong Mao ALM ELM 87 29 0 01 Jan 2024
Principled Gradient-based Markov Chain Monte Carlo for Text Generation Li Du Afra Amini Lucas Torroba Hennigen Xinyan Velocity Yu Jason Eisner Holden Lee Ryan Cotterell BDL 53 1 0 29 Dec 2023
A Block Metropolis-Hastings Sampler for Controllable Energy-based Text Generation Jarad Forristal Niloofar Mireshghallah Greg Durrett Taylor Berg-Kirkpatrick 151 6 0 07 Dec 2023
To be or not to be? an exploration of continuously controllable prompt engineering Yuhan Sun Mukai Li Yixin Cao Kun Wang Wenxiao Wang Xingyu Zeng Rui Zhao LLMAG 39 3 0 16 Nov 2023
P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models Yuhan Liu Shangbin Feng Xiaochuang Han Vidhisha Balachandran Chan Young Park Sachin Kumar Yulia Tsvetkov DiffM 86 4 0 16 Nov 2023
CoRE-CoG: Conversational Recommendation of Entities using Constrained Generation Harshvardhan Srivastava Kanav Pruthi Soumen Chakrabarti Mausam 91 1 0 14 Nov 2023
Controlled Text Generation for Black-box Language Models via Score-based Progressive Editor Sangwon Yu Changmin Lee Hojin Lee Sungroh Yoon 137 0 0 13 Nov 2023
BOOST: Harnessing Black-Box Control to Boost Commonsense in LMs' Generation Yufei Tian Felix Zhang Nanyun Peng 63 0 0 25 Oct 2023
Controlled Decoding from Language Models Sidharth Mudgal Jong Lee H. Ganapathy Yaguang Li Tao Wang ... Michael Collins Trevor Strohman Jilin Chen Alex Beutel Ahmad Beirami 129 91 0 25 Oct 2023
Evaluating Large Language Models on Controlled Generation Tasks Jiao Sun Yufei Tian Wangchunshu Zhou Nan Xu Qian Hu Rahul Gupta John Wieting Nanyun Peng Xuezhe Ma LRM ELM 97 65 0 23 Oct 2023
MIRACLE: Towards Personalized Dialogue Generation with Latent-Space Multiple Personal Attribute Control Zhenyi Lu Wei Wei Xiaoye Qu Xian-Ling Mao Dangyang Chen Jixiong Chen 380 11 0 22 Oct 2023
Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning Shitong Duan Xiaoyuan Yi Peng Zhang Tun Lu Xing Xie Ning Gu 90 12 0 17 Oct 2023
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection Sehyun Choi Tianqing Fang Zhaowei Wang Yangqiu Song 83 39 0 13 Oct 2023
Fill in the Blank: Exploring and Enhancing LLM Capabilities for Backward Reasoning in Math Word Problems Aniruddha Deb Neeva Oza Sarthak Singla Dinesh Khandelwal Dinesh Garg Parag Singla 61 8 0 03 Oct 2023
Controllable Text Generation with Residual Memory Transformer Hanqing Zhang Sun Si Haiming Wu Dawei Song 63 1 0 28 Sep 2023
Toward Unified Controllable Text Generation via Regular Expression Instruction Xin Zheng Hongyu Lin Xianpei Han Le Sun 96 5 0 19 Sep 2023
Situated Natural Language Explanations Zining Zhu Hao Jiang Jingfeng Yang Sreyashi Nag Chao Zhang Jie Huang Yifan Gao Frank Rudzicz Bing Yin LRM 66 1 0 27 Aug 2023
Universal and Transferable Adversarial Attacks on Aligned Language Models Andy Zou Zifan Wang Nicholas Carlini Milad Nasr J. Zico Kolter Matt Fredrikson 347 1,528 0 27 Jul 2023
Sequential Monte Carlo Steering of Large Language Models using Probabilistic Programs Alexander K. Lew Tan Zhi-Xuan Gabriel Grand Vikash K. Mansinghka LLMSV LRM 125 41 0 05 Jun 2023
Structured Voronoi Sampling Afra Amini Li Du Ryan Cotterell DiffM 95 2 0 05 Jun 2023
Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind Ece Takmaz Nicolo' Brandizzi Mario Giulianelli Sandro Pezzelle Raquel Fernández 70 7 0 31 May 2023
PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning Faeze Brahman Chandra Bhagavatula Valentina Pyatkin Jena D. Hwang Xiang Lorraine Li H. J. Arai Soumya Sanyal Keisuke Sakaguchi Xiang Ren Yejin Choi LRM 97 0 0 31 May 2023
Concise Answers to Complex Questions: Summarization of Long-form Answers Abhilash Potluri Fangyuan Xu Eunsol Choi ELM 72 11 0 30 May 2023
The Magic of IF: Investigating Causal Reasoning Abilities in Large Language Models of Code Xiao Liu Da Yin Chen Zhang Yansong Feng Dongyan Zhao ELM ReLM ReCod LRM 91 22 0 30 May 2023
A Critical Evaluation of Evaluations for Long-form Question Answering Fangyuan Xu Yixiao Song Mohit Iyyer Eunsol Choi ELM 100 104 0 29 May 2023
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning Ximing Lu Faeze Brahman Peter West Jaehun Jang Khyathi Chandu ... Bill Yuchen Lin Skyler Hallinan Xiang Ren Sean Welleck Yejin Choi 122 29 0 24 May 2023
Extrapolating Multilingual Understanding Models as Multilingual Generators Bohong Wu Fei Yuan Hai Zhao Lei Li Jingjing Xu AI4CE 75 2 0 22 May 2023
MacLaSa: Multi-Aspect Controllable Text Generation via Efficient Sampling from Compact Latent Space Hanxing Ding Liang Pang Zihao Wei Huawei Shen Xueqi Cheng Tat-Seng Chua DiffM 73 10 0 22 May 2023
BOLT: Fast Energy-based Controlled Text Generation with Tunable Biases Xin Liu Muhammad Khalifa Lu Wang 115 20 0 19 May 2023
Controlled Text Generation with Natural Language Instructions Wangchunshu Zhou Yuchen Eleanor Jiang Ethan Gotlieb Wilcox Ryan Cotterell Mrinmaya Sachan 215 91 0 27 Apr 2023
Automatically Auditing Large Language Models via Discrete Optimization Erik Jones Anca Dragan Aditi Raghunathan Jacob Steinhardt 119 172 0 08 Mar 2023
Aligning Language Models with Preferences through f-divergence Minimization Dongyoung Go Tomasz Korbak Germán Kruszewski Jos Rozen Nahyeon Ryu Marc Dymetman 107 76 0 16 Feb 2023
Opportunities and Challenges in Neural Dialog Tutoring Jakub Macina Nico Daheim Lingzhi Wang Tanmay Sinha Manu Kapur Iryna Gurevych Mrinmaya Sachan 96 29 0 24 Jan 2023
Plug & Play Directed Evolution of Proteins with Gradient-based Discrete MCMC Patrick Emami Aidan Perreault Jeffrey N. Law David J. Biagioni Peter C. St. John 94 15 0 20 Dec 2022
An Extensible Plug-and-Play Method for Multi-Aspect Controllable Text Generation Xuancheng Huang Zijun Liu Peng Li Tao Li Maosong Sun Yang Liu 97 10 0 19 Dec 2022
Controllable Text Generation via Probability Density Estimation in the Latent Space Yuxuan Gu Xiaocheng Feng Sicheng Ma Lingyuan Zhang Heng Gong Weihong Zhong Bing Qin 90 18 0 16 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief Review Jiangjie Chen Yanghua Xiao 116 5 0 07 Dec 2022
Generating Sequences by Learning to Self-Correct Sean Welleck Ximing Lu Peter West Faeze Brahman T. Shen Daniel Khashabi Yejin Choi LRM 111 238 0 31 Oct 2022
SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control Xiaochuang Han Sachin Kumar Yulia Tsvetkov 165 91 0 31 Oct 2022