Trading Off Diversity and Quality in Natural Language Generation

22 April 2020

Papers citing "Trading Off Diversity and Quality in Natural Language Generation"

50 / 71 papers shown

Title
TF1-EN-3M: Three Million Synthetic Moral Fables for Training Small, Open Language Models Mihai Nadas Laura Diosan Andrei Piscoran Andreea Tomescu VGen 59 0 0 29 Apr 2025
Evaluating the Diversity and Quality of LLM Generated Content Alexander Shypula Shuo Li Botong Zhang Vishakh Padmakumar Kayo Yin Osbert Bastani 56 1 0 16 Apr 2025
Local Normalization Distortion and the Thermodynamic Formalism of Decoding Strategies for Large Language Models Tom Kempton Stuart Burrell 42 0 0 27 Mar 2025
TempTest: Local Normalization Distortion and the Detection of Machine-generated Text Tom Kempton Stuart Burrell Connor Cheverall DeLMO 116 0 0 26 Mar 2025
Modifying Large Language Model Post-Training for Diverse Creative Writing John Joon Young Chung Vishakh Padmakumar Melissa Roemmele Yuqian Sun Max Kreminski MoMe 51 0 0 21 Mar 2025
Waste Not, Want Not; Recycled Gumbel Noise Improves Consistency in Natural Language Generation Damien de Mijolla Hannan Saddiq Kim Moore 59 0 0 02 Mar 2025
Multi-LLM Collaborative Search for Complex Problem Solving Sen Yang Yafu Li Wai Lam Yu Cheng LLMAG LRM 68 1 0 26 Feb 2025
Scalable Best-of-N Selection for Large Language Models via Self-Certainty Zhewei Kang Xuandong Zhao Dawn Song LRM 72 2 0 25 Feb 2025
Diverse Preference Optimization Jack Lanchantin Angelica Chen S. Dhuliawala Ping Yu Jason Weston Sainbayar Sukhbaatar Ilia Kulikov 102 4 0 30 Jan 2025
The Jungle of Generative Drug Discovery: Traps, Treasures, and Ways Out Rıza Özçelik F. Grisoni 48 0 0 24 Dec 2024
Improving Medical Diagnostics with Vision-Language Models: Convex Hull-Based Uncertainty Analysis Ferhat Ozgur Catak Murat Kuzlu Taylor Patrick 95 0 0 24 Nov 2024
Hard-Constrained Neural Networks with Universal Approximation Guarantees Youngjae Min Anoopkumar Sonar PINN 22 3 0 14 Oct 2024
Diversity-Rewarded CFG Distillation Geoffrey Cideron A. Agostinelli Johan Ferret Sertan Girgin Romuald Elie Olivier Bachem Sarah Perrin Alexandre Ramé 49 2 0 08 Oct 2024
Collective Critics for Creative Story Generation Minwook Bae Hyounghun Kim 34 2 0 03 Oct 2024
CONTESTS: a Framework for Consistency Testing of Span Probabilities in Language Models Eitan Wagner Yuli Slavutsky Omri Abend 23 1 0 30 Sep 2024
Mitigating Hallucinations in Large Vision-Language Models (LVLMs) via Language-Contrastive Decoding (LCD) Avshalom Manevich Reut Tsarfaty MLLM 31 4 0 06 Aug 2024
From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models Sean Welleck Amanda Bertsch Matthew Finlayson Hailey Schoelkopf Alex Xie Graham Neubig Ilia Kulikov Zaid Harchaoui 33 51 0 24 Jun 2024
Measuring memorization in RLHF for code completion Aneesh Pappu Billy Porter Ilia Shumailov Jamie Hayes 33 0 0 17 Jun 2024
Is Temperature the Creativity Parameter of Large Language Models? Max Peeperkorn Tom Kouwenhoven Daniel G. Brown Anna K. Jordanous 37 45 0 01 May 2024
Forcing Diffuse Distributions out of Language Models Yiming Zhang Avi Schwarzschild Nicholas Carlini Zico Kolter Daphne Ippolito ALM DiffM 44 17 0 16 Apr 2024
Generating Diverse Translation with Perturbed kNN-MT Yuto Nishida Makoto Morishita Hidetaka Kamigaito Taro Watanabe 21 1 0 14 Feb 2024
Generating Diverse and High-Quality Texts by Minimum Bayes Risk Decoding Yuu Jinnai Ukyo Honda Tetsuro Morimura Peinan Zhang 34 6 0 10 Jan 2024
The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Text Yanzhu Guo Guokan Shang Michalis Vazirgiannis Chloé Clavel 34 51 0 16 Nov 2023
Vision-Language Instruction Tuning: A Review and Analysis Chen Li Yixiao Ge Dian Li Ying Shan VLM 39 12 0 14 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 56 744 0 09 Nov 2023
Affective and Dynamic Beam Search for Story Generation Tenghao Huang Ehsan Qasemi Bangzheng Li He Wang Faeze Brahman Muhao Chen Snigdha Chaturvedi 36 11 0 23 Oct 2023
Probing the Creativity of Large Language Models: Can models produce divergent semantic association? Honghua Chen Nai Ding LRM 27 20 0 17 Oct 2023
KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection Sehyun Choi Tianqing Fang Zhaowei Wang Yangqiu Song 35 33 0 13 Oct 2023
Hierarchical Evaluation Framework: Best Practices for Human Evaluation I. Bojić Jessica Chen Si Yuan Chang Qi Chwen Ong Chenyu You Josip Car 43 5 0 03 Oct 2023
Language Model Decoding as Direct Metrics Optimization Haozhe Ji Pei Ke Hongning Wang Minlie Huang 21 7 0 02 Oct 2023
Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering Education M. Abedi Ibrahem Alshybani M. Shahadat M. Murillo 46 13 0 09 Sep 2023
Effective Prompt Extraction from Language Models Yiming Zhang Nicholas Carlini Daphne Ippolito MIACV SILM 38 37 0 13 Jul 2023
On the Efficacy of Sampling Adapters Clara Meister Tiago Pimentel Luca Malagutti Ethan Gotlieb Wilcox Ryan Cotterell 35 12 0 07 Jul 2023
Diverse and Faithful Knowledge-Grounded Dialogue Generation via Sequential Posterior Inference Yan Xu Deqian Kong Dehong Xu Ziwei Ji Bo Pang Pascale Fung Yingting Wu 29 6 0 01 Jun 2023
MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies Shiyue Zhang Shijie Wu Ozan Irsoy Steven Lu Joey Tianyi Zhou Mark Dredze David S. Rosenberg 25 9 0 26 May 2023
A Survey of Diffusion Models in Natural Language Processing Hao-Li Zou Zae Myung Kim Dongyeop Kang DiffM MedIm 25 12 0 24 May 2023
How do decoding algorithms distribute information in dialogue responses? Saranya Venkatraman He He David Reitter 19 5 0 29 Mar 2023
Diffusion Models in NLP: A Survey Yuansong Zhu Yu Zhao DiffM VLM MedIm 29 23 0 14 Mar 2023
Real or Fake Text?: Investigating Human Ability to Detect Boundaries Between Human-Written and Machine-Generated Text Liam Dugan Daphne Ippolito Arun Kirubarajan Sherry Shi Chris Callison-Burch DeLMO 37 65 0 24 Dec 2022
DimonGen: Diversified Generative Commonsense Reasoning for Explaining Concept Relationships Chenzhengyi Liu Jie Huang Kerui Zhu Kevin Chen-Chuan Chang LRM 19 9 0 20 Dec 2022
Implicit causality in GPT-2: a case study H. Huynh T. Lentz Emiel van Miltenburg LRM 27 3 0 08 Dec 2022
Best- $k$ Search Algorithm for Neural Text Generation Jiacheng Xu Caiming Xiong Silvio Savarese Yingbo Zhou 37 5 0 22 Nov 2022
Reranking Overgenerated Responses for End-to-End Task-Oriented Dialogue Systems Songbo Hu Ivan Vulić Fangyu Liu Anna Korhonen 43 0 0 07 Nov 2022
SSD-LM: Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control Xiaochuang Han Sachin Kumar Yulia Tsvetkov 45 79 0 31 Oct 2022
IFDID: Information Filter upon Diversity-Improved Decoding for Diversity-Faithfulness Tradeoff in NLG Han Meng Xiaosong He Zexing Chen F. Zhou 40 0 0 25 Oct 2022
Are Current Decoding Strategies Capable of Facing the Challenges of Visual Dialogue? Amit Kumar Chaudhary Alex J. Lucassen Ioanna Tsani A. Testoni 11 1 0 24 Oct 2022
A Continuum of Generation Tasks for Investigating Length Bias and Degenerate Repetition Darcey Riley David Chiang 26 5 0 19 Oct 2022
DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models Shansan Gong Mukai Li Jiangtao Feng Zhiyong Wu Lingpeng Kong 44 309 0 17 Oct 2022
Bootstrapping Multilingual Semantic Parsers using Large Language Models Abhijeet Awasthi Nitish Gupta Bidisha Samanta Shachi Dave Sunita Sarawagi Partha P. Talukdar 43 7 0 13 Oct 2022
Language Model Decoding as Likelihood-Utility Alignment Martin Josifoski Maxime Peyrard Frano Rajic Jiheng Wei Debjit Paul ... Barun Patra Vishrav Chaudhary Emre Kıcıman Boi Faltings Robert West 46 4 0 13 Oct 2022