Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding

14 November 2022

Dan Jurafsky

Papers citing "Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding"

45 / 45 papers shown

Title
Estimating Optimal Context Length for Hybrid Retrieval-augmented Multi-document Summarization Adithya Pratapa Teruko Mitamura RALM 34 0 0 17 Apr 2025
CoKe: Customizable Fine-Grained Story Evaluation via Chain-of-Keyword Rationalization Brihi Joshi Sriram Venkatapathy Mohit Bansal Nanyun Peng Haw-Shiuan Chang LRM 49 0 0 21 Mar 2025
Uncertainty-Aware Decoding with Minimum Bayes Risk Nico Daheim Clara Meister Thomas Möllenhoff Iryna Gurevych 53 0 0 07 Mar 2025
VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models Ming Cheng Jiaying Gong Chenhan Yuan William A. Ingram Edward A. Fox Hoda Eldardiry 47 0 0 07 Nov 2024
Belief in the Machine: Investigating Epistemological Blind Spots of Language Models Mirac Suzgun Tayfun Gur Federico Bianchi Daniel E. Ho Thomas F. Icard Dan Jurafsky James Zou 29 1 0 28 Oct 2024
Theoretical Aspects of Bias and Diversity in Minimum Bayes Risk Decoding Hidetaka Kamigaito Hiroyuki Deguchi Yusuke Sakai Katsuhiko Hayashi Taro Watanabe 41 1 0 19 Oct 2024
Better Instruction-Following Through Minimum Bayes Risk Ian Wu Patrick Fernandes Amanda Bertsch Seungone Kim Sina Pakazad Graham Neubig 48 9 0 03 Oct 2024
Improving Minimum Bayes Risk Decoding with Multi-Prompt David Heineman Yao Dou Wei-ping Xu 36 6 0 22 Jul 2024
Don't Throw Away Data: Better Sequence Knowledge Distillation Jun Wang Eleftheria Briakou Hamid Dadkhahi Rishabh Agarwal Colin Cherry Trevor Cohn 50 5 0 15 Jul 2024
Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language Generation Xinglin Wang Yiwei Li Shaoxiong Feng Peiwen Yuan Boyuan Pan Heda Wang Yao Hu Kan Li 28 10 0 02 Jul 2024
Compare without Despair: Reliable Preference Evaluation with Generation Separability Sayan Ghosh Tejas Srinivasan Swabha Swayamdipta 43 2 0 02 Jul 2024
From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models Sean Welleck Amanda Bertsch Matthew Finlayson Hailey Schoelkopf Alex Xie Graham Neubig Ilia Kulikov Zaid Harchaoui 33 50 0 24 Jun 2024
Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation Yiwei Li Fei Mi Yitong Li Yasheng Wang Bin Sun Shaoxiong Feng Kan Li 29 4 0 12 Jun 2024
CERET: Cost-Effective Extrinsic Refinement for Text Generation Jason (Jinglun) Cai Hang Su Monica Sunkara Igor Shalyminov Saab Mansour 29 1 0 08 Jun 2024
Annotation-Efficient Preference Optimization for Language Model Alignment Yuu Jinnai Ukyo Honda 42 0 0 22 May 2024
Conformal Prediction for Natural Language Processing: A Survey Margarida M. Campos António Farinhas Chrysoula Zerva Mário A. T. Figueiredo André F. T. Martins AI4CE 45 14 0 03 May 2024
Regularized Best-of-N Sampling with Minimum Bayes Risk Objective for Language Model Alignment Yuu Jinnai Tetsuro Morimura Kaito Ariu Kenshi Abe 66 7 0 01 Apr 2024
On the True Distribution Approximation of Minimum Bayes-Risk Decoding Atsumoto Ohashi Ukyo Honda Tetsuro Morimura Yuu Jinnai 33 2 0 31 Mar 2024
Look Before You Leap: Problem Elaboration Prompting Improves Mathematical Reasoning in Large Language Models Haoran Liao Jidong Tian Shaohua Hu Hao He Yaohui Jin ReLM LRM 46 1 0 24 Feb 2024
Towards Uncertainty-Aware Language Agent Jiuzhou Han Wray L. Buntine Ehsan Shareghi LLMAG AI4CE 32 4 0 25 Jan 2024
Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffolding Mirac Suzgun Adam Tauman Kalai KELM LRM LLMAG ReLM 43 65 0 23 Jan 2024
Generating Diverse and High-Quality Texts by Minimum Bayes Risk Decoding Yuu Jinnai Ukyo Honda Tetsuro Morimura Peinan Zhang 31 6 0 10 Jan 2024
Modeling Complex Mathematical Reasoning via Large Language Model based MathAgent Haoran Liao Qinyi Du Shaohua Hu Hao He Yanyan Xu Jidong Tian Yaohui Jin LRM AI4CE 32 1 0 14 Dec 2023
PathFinder: Guided Search over Multi-Step Reasoning Paths O. Yu. Golovneva Sean O'Brien Ramakanth Pasunuru Tianlu Wang Luke Zettlemoyer Maryam Fazel-Zarandi Asli Celikyilmaz LRM 27 7 0 08 Dec 2023
Faster Minimum Bayes Risk Decoding with Confidence-based Pruning Julius Cheng Andreas Vlachos 45 21 0 25 Nov 2023
Direct Preference Optimization for Neural Machine Translation with Minimum Bayes Risk Decoding Guangyu Yang Jinghong Chen Weizhe Lin Bill Byrne 24 20 0 14 Nov 2023
Model-Based Minimum Bayes Risk Decoding for Text Generation Yuu Jinnai Tetsuro Morimura Ukyo Honda Kaito Ariu Kenshi Abe 17 6 0 09 Nov 2023
Ensemble-Instruct: Generating Instruction-Tuning Data with a Heterogeneous Mixture of LMs Young-Suk Lee Md Arafat Sultan Yousef El-Kurdi Tahira Naseem Asim Munawar Radu Florian Salim Roukos Ramón Fernández Astudillo SyDa 19 6 0 21 Oct 2023
Ensemble Distillation for Unsupervised Constituency Parsing Behzad Shayegh Yanshuai Cao Xiaodan Zhu Jackie C.K. Cheung Lili Mou 50 5 0 03 Oct 2023
It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk Amanda Bertsch Alex Xie Graham Neubig Matthew R. Gormley 40 31 0 02 Oct 2023
Small Language Models Improve Giants by Rewriting Their Outputs Giorgos Vernikos Arthur Bravzinskas Jakub Adamek Jonathan Mallinson Aliaksei Severyn Eric Malmi BDL LRM 25 14 0 22 May 2023
What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability Mario Giulianelli Joris Baan Wilker Aziz Raquel Fernández Barbara Plank UQLM 35 30 0 19 May 2023
string2string: A Modern Python Library for String-to-String Algorithms Mirac Suzgun Stuart M. Shieber Dan Jurafsky 39 7 0 27 Apr 2023
Guiding Large Language Models via Directional Stimulus Prompting Zekun Li Baolin Peng Pengcheng He Michel Galley Jianfeng Gao Xi Yan LLMAG LRM LM&Ro 40 94 0 22 Feb 2023
Attend to the Right Context: A Plug-and-Play Module for Content-Controllable Summarization Wen Xiao Lesly Miculicich Yang Liu Pengcheng He Giuseppe Carenini KELM 25 3 0 21 Dec 2022
DC-MBR: Distributional Cooling for Minimum Bayesian Risk Decoding Jianhao Yan Jin Xu Fandong Meng Jie Zhou Yue Zhang 18 3 0 08 Dec 2022
Best- $k$ Search Algorithm for Neural Text Generation Jiacheng Xu Caiming Xiong Silvio Savarese Yingbo Zhou 35 5 0 22 Nov 2022
The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applications Mirac Suzgun Luke Melas-Kyriazi Suproteem K. Sarkar S. Kominers Stuart M. Shieber 46 26 0 08 Jul 2022
Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models Mirac Suzgun Luke Melas-Kyriazi Dan Jurafsky VLM 82 65 0 23 May 2022
Self-Consistency Improves Chain of Thought Reasoning in Language Models Xuezhi Wang Jason W. Wei Dale Schuurmans Quoc Le Ed H. Chi Sharan Narang Aakanksha Chowdhery Denny Zhou ReLM BDL LRM AI4CE 314 3,248 0 21 Mar 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong S. Hoi MLLM BDL VLM CLIP 392 4,137 0 28 Jan 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 367 8,495 0 28 Jan 2022
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics Sebastian Gehrmann Tosin P. Adewumi Karmanya Aggarwal Pawan Sasanka Ammanamanchi Aremu Anuoluwapo ... Nishant Subramani Wei-ping Xu Diyi Yang Akhila Yerukola Jiawei Zhou VLM 254 285 0 02 Feb 2021
Language GANs Falling Short Massimo Caccia Lucas Caccia W. Fedus Hugo Larochelle Joelle Pineau Laurent Charlin 124 215 0 06 Nov 2018
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 175 3,510 0 10 Jun 2015