On the Efficacy of Sampling Adapters

7 July 2023

Papers citing "On the Efficacy of Sampling Adapters"

33 / 33 papers shown

Title
What do Language Model Probabilities Represent? From Distribution Estimation to Response Prediction Eitan Wagner Omri Abend 101 1 0 04 May 2025
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.4K 14,313 0 15 Mar 2023
A Measure-Theoretic Characterization of Tight Language Models Li Du Lucas Torroba Hennigen Tiago Pimentel Clara Meister Jason Eisner Ryan Cotterell 61 32 0 20 Dec 2022
Training Trajectories of Language Models Across Scales Mengzhou Xia Mikel Artetxe Chunting Zhou Xi Lin Ramakanth Pasunuru Danqi Chen Luke Zettlemoyer Ves Stoyanov AIFin LRM 81 61 0 19 Dec 2022
Truncation Sampling as Language Model Desmoothing John Hewitt Christopher D. Manning Percy Liang BDL 75 81 0 27 Oct 2022
Contrastive Decoding: Open-ended Text Generation as Optimization Xiang Lisa Li Ari Holtzman Daniel Fried Percy Liang Jason Eisner Tatsunori Hashimoto Luke Zettlemoyer M. Lewis 101 359 0 27 Oct 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 477 6,231 0 05 Apr 2022
On the probability-quality paradox in language generation Clara Meister Gian Wiher Tiago Pimentel Ryan Cotterell 62 14 0 31 Mar 2022
On Decoding Strategies for Neural Text Generators Gian Wiher Clara Meister Ryan Cotterell 74 68 0 29 Mar 2022
Locally Typical Sampling Clara Meister Tiago Pimentel Gian Wiher Ryan Cotterell 181 89 0 01 Feb 2022
All That's 'Human' Is Not Gold: Evaluating Human Evaluation of Generated Text Elizabeth Clark Tal August Sofia Serrano Nikita Haduong Suchin Gururangan Noah A. Smith DeLMO 96 410 0 30 Jun 2021
MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers Krishna Pillutla Swabha Swayamdipta Rowan Zellers John Thickstun Sean Welleck Yejin Choi Zaïd Harchaoui 100 360 0 02 Feb 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 450 2,093 0 31 Dec 2020
Text Generation by Learning from Demonstrations Richard Yuanzhe Pang He He OffRL 58 80 0 16 Sep 2020
A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation Moin Nadeem Tianxing He Kyunghyun Cho James R. Glass 41 31 0 15 Sep 2020
Mirostat: A Neural Text Decoding Algorithm that Directly Controls Perplexity Sourya Basu Govardana Sachithanandam Ramachandran N. Keskar Lav Varshney AAML 46 7 0 29 Jul 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 755 41,932 0 28 May 2020
Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine Translation Bryan Eikema Wilker Aziz 72 135 0 20 May 2020
Generalized Entropy Regularization or: There's Nothing Special about Label Smoothing Clara Meister Elizabeth Salesky Ryan Cotterell UQCV 41 61 0 02 May 2020
Improved Natural Language Generation via Loss Truncation Daniel Kang Tatsunori Hashimoto 56 97 0 30 Apr 2020
Trading Off Diversity and Quality in Natural Language Generation Hugh Zhang Daniel Duckworth Daphne Ippolito Arvind Neelakantan 64 96 0 22 Apr 2020
Sparse Text Generation Pedro Henrique Martins Zita Marinho André F. T. Martins MoE 39 39 0 06 Apr 2020
Neural Text Generation with Unlikelihood Training Sean Welleck Ilia Kulikov Stephen Roller Emily Dinan Kyunghyun Cho Jason Weston MU 45 576 0 12 Aug 2019
Calibration, Entropy Rates, and Memory in Language Models M. Braverman Xinyi Chen Sham Kakade Karthik Narasimhan Cyril Zhang Yi Zhang 58 39 0 11 Jun 2019
Sparse Sequence-to-Sequence Models Ben Peters Vlad Niculae André F. T. Martins TPM 172 212 0 14 May 2019
The Curious Case of Neural Text Degeneration Ari Holtzman Jan Buys Li Du Maxwell Forbes Yejin Choi 184 3,175 0 22 Apr 2019
Unifying Human and Statistical Evaluation for Natural Language Generation Tatsunori B. Hashimoto Hugh Zhang Percy Liang 66 223 0 04 Apr 2019
Assessing Generative Models via Precision and Recall Mehdi S. M. Sajjadi Olivier Bachem Mario Lucic Olivier Bousquet Sylvain Gelly EGVM 78 577 0 31 May 2018
Hierarchical Neural Story Generation Angela Fan M. Lewis Yann N. Dauphin DiffM 173 1,619 0 13 May 2018
Are GANs Created Equal? A Large-Scale Study Mario Lucic Karol Kurach Marcin Michalski Sylvain Gelly Olivier Bousquet EGVM 60 1,011 0 28 Nov 2017
Pointer Sentinel Mixture Models Stephen Merity Caiming Xiong James Bradbury R. Socher RALM 308 2,859 0 26 Sep 2016
How (not) to Train your Generative Model: Scheduled Sampling, Likelihood, Adversary? Ferenc Huszár OOD DiffM GAN 84 296 0 16 Nov 2015
A note on the evaluation of generative models Lucas Theis Aaron van den Oord Matthias Bethge EGVM 126 1,145 0 05 Nov 2015