Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation

15 August 2023

Jack Miller

Papers citing "Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation"

50 / 62 papers shown

Title
Aligning Instruction Tuning with Pre-training Yiming Liang Tianyu Zheng Xinrun Du Ge Zhang Qingbin Liu ... Zhaoxiang Zhang Wenhao Huang Jiajun Zhang Xiang Yue Jiajun Zhang 136 2 0 16 Jan 2025
Stay on topic with Classifier-Free Guidance Guillaume Sanchez Honglu Fan Alexander Spangher Elad Levi Pawan Sasanka Ammanamanchi Stella Biderman 3DV 60 50 0 30 Jun 2023
Art and the science of generative AI: A deeper dive Ziv Epstein Aaron Hertzmann L. Herman Robert Mahari M. Frank ... Jessica Fjeld Hany Farid Neil Leach Alex Pentland Olga Russakovsky 47 303 0 07 Jun 2023
Increasing Diversity While Maintaining Accuracy: Text Data Generation with Large Language Models and Human Interventions John Joon Young Chung Ece Kamar Saleema Amershi ALM 87 117 0 07 Jun 2023
Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Models Daiki Miyake Akihiro Iohara Yuriko Saito Toshiyuki Tanaka DiffM 61 117 0 26 May 2023
Generating Faithful Synthetic Data with Large Language Models: A Case Study in Computational Social Science V. Veselovsky Manoel Horta Ribeiro Akhil Arora Martin Josifoski Ashton Anderson Robert West SyDa HILM 45 31 0 24 May 2023
Trusting Your Evidence: Hallucinate Less with Context-aware Decoding Weijia Shi Xiaochuang Han M. Lewis Yulia Tsvetkov Luke Zettlemoyer Scott Yih HILM 54 200 0 24 May 2023
TinyStories: How Small Can Language Models Be and Still Speak Coherent English? Ronen Eldan Yuan-Fang Li SyDa LRM 50 255 0 12 May 2023
The Parrot Dilemma: Human-Labeled vs. LLM-augmented Data in Classification Tasks Anders Giovanni Møller Jacob Aarup Dalsgaard Arianna Pera L. Aiello 88 37 0 26 Apr 2023
Semantic Compression With Large Language Models Henry Gilbert Michael Sandborn Douglas C. Schmidt Jesse Spencer-Smith Jules White 39 22 0 25 Apr 2023
A Latent Space Theory for Emergent Abilities in Large Language Models Hui Jiang LRM 53 36 0 19 Apr 2023
Synthetically generated text for supervised text analysis Andrew Halterman DeLMO 41 6 0 28 Mar 2023
Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extraction Martin Josifoski Marija Sakota Maxime Peyrard Robert West SyDa 83 81 0 07 Mar 2023
Machine Learning for Synthetic Data Generation: A Review Ying-Cheng Lu Minjie Shen Huazheng Wang Xiao Wang Capucine Van Rechem Tianfan Fu Wenqi Wei SyDa 70 142 0 08 Feb 2023
Talking About Large Language Models Murray Shanahan AI4CE 58 257 0 07 Dec 2022
Contrastive Decoding: Open-ended Text Generation as Optimization Xiang Lisa Li Ari Holtzman Daniel Fried Percy Liang Jason Eisner Tatsunori Hashimoto Luke Zettlemoyer M. Lewis 82 348 0 27 Oct 2022
On the Transformation of Latent Space in Fine-Tuned NLP Models Nadir Durrani Hassan Sajjad Fahim Dalvi Firoj Alam 84 19 0 23 Oct 2022
Scaling Instruction-Finetuned Language Models Hyung Won Chung Le Hou Shayne Longpre Barret Zoph Yi Tay ... Jacob Devlin Adam Roberts Denny Zhou Quoc V. Le Jason W. Wei ReLM LRM 151 3,072 0 20 Oct 2022
Rule-adhering synthetic data -- the lingua franca of learning Michaela D. Platzer Ivona Krchova 79 2 0 12 Sep 2022
Classifier-Free Diffusion Guidance Jonathan Ho Tim Salimans FaML 131 3,830 0 26 Jul 2022
Emergent Abilities of Large Language Models Jason W. Wei Yi Tay Rishi Bommasani Colin Raffel Barret Zoph ... Tatsunori Hashimoto Oriol Vinyals Percy Liang J. Dean W. Fedus ELM ReLM LRM 189 2,428 0 15 Jun 2022
Classifiers are Better Experts for Controllable Text Generation Askhat Sitdikov Nikita Balagansky Daniil Gavrilov Alexander Markov 60 7 0 15 May 2022
TreeMix: Compositional Constituency-based Data Augmentation for Natural Language Understanding Le Zhang Zichao Yang Diyi Yang 59 24 0 12 May 2022
VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance Katherine Crowson Stella Biderman Daniel Kornis Dashiell Stander Eric Hallahan Louis Castricato Edward Raff CLIP 102 375 0 18 Apr 2022
Using Synthetic Data for Conversational Response Generation in Low-resource Settings Gabriel Louis Tan Adrian Paule Ty Schuyler Ng Denzel Adrian Co Jan Christian Blaise Cruz C. Cheng SyDa 38 2 0 06 Apr 2022
Data Augmentation for Intent Classification with Off-the-shelf Large Language Models Gaurav Sahu Pau Rodríguez López I. Laradji Parmida Atighehchian David Vazquez Dzmitry Bahdanau 57 61 0 05 Apr 2022
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection Thomas Hartvigsen Saadia Gabriel Hamid Palangi Maarten Sap Dipankar Ray Ece Kamar 51 362 0 17 Mar 2022
Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods Wei Li Wenhao Wu Moye Chen Jiachen Liu Xinyan Xiao Hua Wu HILM 85 27 0 10 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 199 30,069 0 01 Mar 2022
Text Smoothing: Enhance Various Data Augmentation Methods on Text Classification Tasks Xing Wu Chaochen Gao Meng Lin Liangjun Zang Zhongyuan Wang Songlin Hu 31 26 0 28 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 298 15,081 0 20 Dec 2021
Coherence boosting: When your pretrained language model is not paying enough attention Nikolay Malkin Zhen Wang Nebojsa Jojic RALM 31 35 0 15 Oct 2021
Generate, Annotate, and Learn: NLP with Synthetic Text Xuanli He Islam Nassar J. Kiros Gholamreza Haffari Mohammad Norouzi 52 52 0 11 Jun 2021
Latent Space Refinement for Deep Generative Models R. Winterhalder Marco Bellagente Benjamin Nachman BDL GAN DRL DiffM 68 27 0 01 Jun 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 150 7,639 0 11 May 2021
A Survey of Data Augmentation Approaches for NLP Steven Y. Feng Varun Gangal Jason W. Wei Sarath Chandar Soroush Vosoughi Teruko Mitamura Eduard H. Hovy AIMat 88 813 0 07 May 2021
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts Alisa Liu Maarten Sap Ximing Lu Swabha Swayamdipta Chandra Bhagavatula Noah A. Smith Yejin Choi MU 96 369 0 07 May 2021
GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation Kang Min Yoo Dongju Park Jaewook Kang Sang-Woo Lee Woomyeong Park 79 238 0 18 Apr 2021
How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Models Ahmed Alaa B. V. Breugel Evgeny S. Saveliev M. Schaar 83 189 0 17 Feb 2021
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 89 347 0 02 Feb 2021
Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation Ruibo Liu Guangxuan Xu Chenyan Jia Weicheng Ma Lili Wang Soroush Vosoughi 44 108 0 05 Dec 2020
Sequence-Level Mixed Sample Data Augmentation Demi Guo Yoon Kim Alexander M. Rush 53 99 0 18 Nov 2020
SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness Nathan Ng Kyunghyun Cho Marzyeh Ghassemi 53 146 0 21 Sep 2020
GeDi: Generative Discriminator Guided Sequence Generation Ben Krause Akhilesh Deepak Gotmare Bryan McCann N. Keskar Shafiq Joty R. Socher Nazneen Rajani 87 398 0 14 Sep 2020
Compositional Visual Generation and Inference with Energy Based Models Yilun Du Shuang Li Igor Mordatch CoGe 46 23 0 13 Apr 2020
A Non-Parametric Test to Detect Data-Copying in Generative Models Casey Meehan Kamalika Chaudhuri S. Dasgupta 42 63 0 12 Apr 2020
CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection Congying Xia Chenwei Zhang Hoang Nguyen Jiawei Zhang Philip Yu 26 43 0 04 Apr 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 259 10,591 0 17 Feb 2020
Plug and Play Language Models: A Simple Approach to Controlled Text Generation Sumanth Dathathri Andrea Madotto Janice Lan Jane Hung Eric Frank Piero Molino J. Yosinski Rosanne Liu KELM 106 966 0 04 Dec 2019
Investigating Under and Overfitting in Wasserstein Generative Adversarial Networks Ben Adlam Charles Weill Amol Kapoor 32 17 0 30 Oct 2019