Plug and Play Language Models: A Simple Approach to Controlled Text Generation

4 December 2019

Andrea Madotto

Papers citing "Plug and Play Language Models: A Simple Approach to Controlled Text Generation"

50 / 619 papers shown

Title
Controlling the Focus of Pretrained Language Generation Models Jiabao Ji Yoon Kim James R. Glass Tianxing He 38 5 0 02 Mar 2022
VScript: Controllable Script Generation with Visual Presentation Ziwei Ji Yan Xu I-Tsun Cheng Samuel Cahyawijaya Rita Frieske Etsuko Ishii Mini Zeng Andrea Madotto Pascale Fung 20 3 0 01 Mar 2022
Controllable Natural Language Generation with Contrastive Prefixes Jing Qian Li Dong Yelong Shen Furu Wei Weizhu Chen 10 95 0 27 Feb 2022
COLD Decoding: Energy-based Constrained Text Generation with Langevin Dynamics Lianhui Qin Sean Welleck Daniel Khashabi Yejin Choi AI4CE 58 144 0 23 Feb 2022
Reward Modeling for Mitigating Toxicity in Transformer-based Language Models Farshid Faal K. Schmitt Jia Yuan Yu 13 24 0 19 Feb 2022
XFBoost: Improving Text Generation with Controllable Decoders Xiangyu Peng Michael Sollami 30 1 0 16 Feb 2022
ViNTER: Image Narrative Generation with Emotion-Arc-Aware Transformer Kohei Uehara Yusuke Mori Yusuke Mukuta Tatsuya Harada 30 6 0 15 Feb 2022
Generating Training Data with Language Models: Towards Zero-Shot Language Understanding Yu Meng Jiaxin Huang Yu Zhang Jiawei Han SyDa 32 229 0 09 Feb 2022
Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models Wei Ping Ming-Yu Liu Chaowei Xiao P. Xu M. Patwary M. Shoeybi Bo-wen Li Anima Anandkumar Bryan Catanzaro 25 65 0 08 Feb 2022
Cedille: A large autoregressive French language model Martin Müller Florian Laurent 36 19 0 07 Feb 2022
Towards Coherent and Consistent Use of Entities in Narrative Generation Pinelopi Papalampidi Kris Cao Tomás Kociský HILM 22 12 0 03 Feb 2022
A Causal Lens for Controllable Text Generation Zhiting Hu Erran L. Li 45 59 0 22 Jan 2022
CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities Mina Lee Percy Liang Qian Yang HAI 26 361 0 18 Jan 2022
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang Haolin Song Shaoyu Li Ming Zhou Dawei Song 52 215 0 14 Jan 2022
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao J. Nie Ji-Rong Wen AI4CE 36 128 0 14 Jan 2022
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Shuohuan Wang Yu Sun Yang Xiang Zhihua Wu Siyu Ding ... Tian Wu Wei Zeng Ge Li Wen Gao Haifeng Wang ELM 39 79 0 23 Dec 2021
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics Ximing Lu Sean Welleck Peter West Liwei Jiang Jungo Kasai ... Lianhui Qin Youngjae Yu Rowan Zellers Noah A. Smith Yejin Choi 11 158 0 16 Dec 2021
Reconsidering the Past: Optimizing Hidden States in Language Models Davis Yoshida Kevin Gimpel BDL 28 2 0 16 Dec 2021
Prompt Waywardness: The Curious Case of Discretized Interpretation of Continuous Prompts Daniel Khashabi Xinxi Lyu Sewon Min Lianhui Qin Kyle Richardson ... Hannaneh Hajishirzi Tushar Khot Ashish Sabharwal Sameer Singh Yejin Choi 26 75 0 15 Dec 2021
Simple Text Detoxification by Identifying a Linear Toxic Subspace in Language Model Embeddings Andrew Wang Mohit Sudhakar Yangfeng Ji 15 2 0 15 Dec 2021
Controlled Cue Generation for Play Scripts Alara Dirik Hilal Donmez Pinar Yanardag 22 3 0 13 Dec 2021
Unsupervised Editing for Counterfactual Stories Jiangjie Chen Chun Gan Sijie Cheng Hao Zhou Yanghua Xiao Lei Li 34 12 0 10 Dec 2021
Controllable Response Generation for Assistive Use-cases Shachi H. Kumar Hsuan Su R. Manuvinakurike Saurav Sahay L. Nachman 27 1 0 04 Dec 2021
Controlling Conditional Language Models without Catastrophic Forgetting Tomasz Korbak Hady ElSahar Germán Kruszewski Marc Dymetman CLL AI4CE 23 33 0 01 Dec 2021
ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic Yoad Tewel Yoav Shalev Idan Schwartz Lior Wolf VLM 34 192 0 29 Nov 2021
Modelling Direct Messaging Networks with Multiple Recipients for Cyber Deception Kristen Moore Cody James Christopher David Liebowitz Surya Nepal R. Selvey 26 4 0 21 Nov 2021
Unsupervised and Distributional Detection of Machine-Generated Text Matthias Gallé Jos Rozen Germán Kruszewski Hady ElSahar DeLMO 31 26 0 04 Nov 2021
PnPOOD : Out-Of-Distribution Detection for Text Classification via Plug andPlay Data Augmentation Mrinal Rawat R. Hebbalaguppe L. Vig OODD 6 10 0 31 Oct 2021
Controllable Semantic Parsing via Retrieval Augmentation Panupong Pasupat Yuan Zhang Kelvin Guu 132 47 0 16 Oct 2021
Control Prefixes for Parameter-Efficient Text Generation Jordan Clive Kris Cao Marek Rei 44 32 0 15 Oct 2021
Hindsight: Posterior-guided training of retrievers for improved open-ended generation Ashwin Paranjape Omar Khattab Christopher Potts Matei A. Zaharia Christopher D. Manning RALM 72 43 0 14 Oct 2021
Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation Florian Mai James Henderson 21 2 0 13 Oct 2021
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 134 350 0 13 Oct 2021
On the Latent Holes of VAEs for Text Generation Ruizhe Li Xutan Peng Chenghua Lin 52 4 0 07 Oct 2021
Self-conditioning pre-trained language models Xavier Suau Luca Zappella N. Apostoloff 21 10 0 30 Sep 2021
PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided MCTS Decoding Antoine Chaffin Vincent Claveau Ewa Kijak 31 36 0 28 Sep 2021
TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generation Adaku Uchendu Zeyu Ma Thai Le Rui Zhang Dongwon Lee DeLMO 31 124 0 27 Sep 2021
Style Control for Schema-Guided Natural Language Generation Alicia Y. Tsai Shereen Oraby Vittorio Perera Jiun-Yu Kao Yuheng Du Anjali Narayan-Chen Tagyoung Chung Dilek Z. Hakkani-Tür 74 12 0 24 Sep 2021
Detect and Perturb: Neutral Rewriting of Biased and Sensitive Text via Gradient-based Decoding Zexue He Bodhisattwa Prasad Majumder Julian McAuley 17 27 0 24 Sep 2021
A Plug-and-Play Method for Controlled Text Generation Damian Pascual Béni Egressy Clara Meister Ryan Cotterell Roger Wattenhofer 27 89 0 20 Sep 2021
Text Detoxification using Large Pre-trained Neural Models David Dale Anton Voronov Daryna Dementieva V. Logacheva Olga Kozlova Nikita Semenov Alexander Panchenko 39 71 0 18 Sep 2021
Let the CAT out of the bag: Contrastive Attributed explanations for Text Saneem A. Chemmengath A. Azad Ronny Luss Amit Dhurandhar FAtt 34 10 0 16 Sep 2021
Challenges in Detoxifying Language Models Johannes Welbl Amelia Glaese J. Uesato Sumanth Dathathri John F. J. Mellor Lisa Anne Hendricks Kirsty Anderson Pushmeet Kohli Ben Coppin Po-Sen Huang LM&MA 253 193 0 15 Sep 2021
Automatically Exposing Problems with Neural Dialog Models Dian Yu Kenji Sagae 31 9 0 14 Sep 2021
TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue System Hongru Wang Mingyu Cui Zimo Zhou Gabriel Pui Cheong Fung Kam-Fai Wong BDL 22 10 0 11 Sep 2021
SideControl: Controlled Open-domain Dialogue Generation via Additive Side Networks Wanyu Du Yangfeng Ji AI4CE 21 7 0 05 Sep 2021
Sentence Bottleneck Autoencoders from Transformer Language Models Ivan Montero Nikolaos Pappas Noah A. Smith AI4CE 22 28 0 31 Aug 2021
A Single Example Can Improve Zero-Shot Data Generation Pavel Burnyshev Valentin Malykh A. Bout Ekaterina Artemova Irina Piontkovskaya 18 3 0 16 Aug 2021
DEMix Layers: Disentangling Domains for Modular Language Modeling Suchin Gururangan Michael Lewis Ari Holtzman Noah A. Smith Luke Zettlemoyer KELM MoE 21 128 0 11 Aug 2021
Controlled Text Generation as Continuous Optimization with Multiple Constraints Sachin Kumar Eric Malmi Aliaksei Severyn Yulia Tsvetkov BDL AI4CE 43 76 0 04 Aug 2021