Document-Level Text Generation with Minimum Bayes Risk Decoding using Optimal Transport

29 May 2025

Papers citing "Document-Level Text Generation with Minimum Bayes Risk Decoding using Optimal Transport"

45 / 45 papers shown

Title
Mitigating Metric Bias in Minimum Bayes Risk Decoding Geza Kovacs Daniel Deutsch Markus Freitag 59 7 0 05 Nov 2024
Better Instruction-Following Through Minimum Bayes Risk Ian Wu Patrick Fernandes Amanda Bertsch Seungone Kim Sina Pakazad Graham Neubig 87 10 0 03 Oct 2024
FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMs Jing Hao Yuxiang Zhao Song Chen Yanpeng Sun Qiang Chen Gang Zhang Kun Yao Errui Ding Jingdong Wang VLM VGen MLLM 62 6 0 20 Sep 2024
Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts Eleftheria Briakou Jiaming Luo Colin Cherry Markus Freitag 77 14 0 10 Sep 2024
From Pixels to Prose: A Large Dataset of Dense Image Captions Vasu Singla Kaiyu Yue Sukriti Paul Reza Shirkavand Mayuka Jayawardhana Alireza Ganjdanesh Heng Huang A. Bhatele Gowthami Somepalli Tom Goldstein 3DV VLM 60 25 0 14 Jun 2024
Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms Firas Trabelsi David Vilar Mara Finkelstein Markus Freitag 45 7 0 05 Jun 2024
Chasing COMET: Leveraging Minimum Bayes Risk Decoding for Self-Improving Machine Translation Kamil Guttmann Miko Pokrywka Adrian Charkiewicz Artur Nowakowski 86 5 0 20 May 2024
DOCCI: Descriptions of Connected and Contrasting Images Yasumasa Onoe Sunayana Rane Zachary Berger Yonatan Bitton Jaemin Cho ... Zarana Parekh Jordi Pont-Tuset Garrett Tanzer Su Wang Jason Baldridge 59 57 0 30 Apr 2024
$$\infty$Bench: Extending Long Context Evaluation Beyond 100K Tokens$ $\infty$ Bench: Extending Long Context Evaluation Beyond 100K Tokens Xinrong Zhang Yingfa Chen Shengding Hu Zihang Xu Junhao Chen ... Xu Han Zhen Leng Thai Shuo Wang Zhiyuan Liu Maosong Sun RALM LRM 55 173 0 21 Feb 2024
Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding Yuu Jinnai Kaito Ariu 64 9 0 05 Jan 2024
Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking Jacob Eisenstein Chirag Nagpal Alekh Agarwal Ahmad Beirami Alex DÁmour ... Katherine Heller Stephen Pfohl Deepak Ramachandran Peter Shaw Jonathan Berant 42 92 0 14 Dec 2023
Faster Minimum Bayes Risk Decoding with Confidence-based Pruning Julius Cheng Andreas Vlachos 50 23 0 25 Nov 2023
Aligning Neural Machine Translation Models: Human Feedback in Training and Inference Miguel Moura Ramos Patrick Fernandes António Farinhas André F. T. Martins ALM 42 16 0 15 Nov 2023
Direct Preference Optimization for Neural Machine Translation with Minimum Bayes Risk Decoding Guangyu Yang Jinghong Chen Weizhe Lin Bill Byrne 37 21 0 14 Nov 2023
Model-Based Minimum Bayes Risk Decoding for Text Generation Yuu Jinnai Tetsuro Morimura Ukyo Honda Kaito Ariu Kenshi Abe 65 7 0 09 Nov 2023
xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection Nuno M. Guerreiro Ricardo Rei Daan van Stigt Luísa Coheur Pierre Colombo André F.T. Martins 86 126 0 16 Oct 2023
MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods M. Finkelstein Subhajit Naskar Mehdi Mirzazadeh Apurva Shah Markus Freitag 58 27 0 19 Sep 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 199 11,636 0 18 Jul 2023
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training Yiming Yan Tao Wang Chengqi Zhao Shujian Huang Jiajun Chen Mingxuan Wang 34 24 0 06 Jul 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 271 3,712 0 29 May 2023
Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation Markus Freitag Behrooz Ghorbani Patrick Fernandes 38 41 0 17 May 2023
How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation Amr Hendy M. Abdelrehim Amr Sharaf Vikas Raunak Mohamed Gabr Hitokazu Matsushita Young Jin Kim Mohamed Afify Hany Awadalla ELM LM&MA AI4CE 52 426 0 18 Feb 2023
Truncation Sampling as Language Model Desmoothing John Hewitt Christopher D. Manning Percy Liang BDL 63 80 0 27 Oct 2022
Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metric Giorgos Vernikos Brian Thompson Prashant Mathur Marcello Federico 50 44 0 27 Sep 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 683 12,525 0 04 Mar 2022
High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics Markus Freitag David Grangier Qijun Tan Bowen Liang 80 93 0 17 Nov 2021
Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation Bryan Eikema Wilker Aziz 39 46 0 10 Aug 2021
BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation Yu Jiang Tianyu Liu Shuming Ma Dongdong Zhang Jian Yang Haoyang Huang Rico Sennrich Ryan Cotterell Mrinmaya Sachan M. Zhou 28 60 0 22 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 671 28,659 0 26 Feb 2021
Learning to summarize from human feedback Nisan Stiennon Long Ouyang Jeff Wu Daniel M. Ziegler Ryan J. Lowe Chelsea Voss Alec Radford Dario Amodei Paul Christiano ALM 175 2,071 0 02 Sep 2020
Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine Translation Bryan Eikema Wilker Aziz 43 132 0 20 May 2020
MPNet: Masked and Permuted Pre-training for Language Understanding Kaitao Song Xu Tan Tao Qin Jianfeng Lu Tie-Yan Liu 94 1,105 0 20 Apr 2020
Multilingual Denoising Pre-training for Neural Machine Translation Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad M. Lewis Luke Zettlemoyer AI4CE AIMat 99 1,786 0 22 Jan 2020
The Curious Case of Neural Text Degeneration Ari Holtzman Jan Buys Li Du Maxwell Forbes Yejin Choi 145 3,133 0 22 Apr 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 196 5,668 0 21 Apr 2019
Optimal Transport for structured data with application on graphs Titouan Vayer Laetitia Chapel Rémi Flamary R. Tavenard Nicolas Courty OT 55 270 0 23 May 2018
A Call for Clarity in Reporting BLEU Scores Matt Post 81 2,941 0 23 Apr 2018
Computational Optimal Transport Gabriel Peyré Marco Cuturi OT 138 2,133 0 01 Mar 2018
Optimal Transport: Fast Probabilistic Approximation with Exact Solvers Max Sommerfeld Jörn Schrieber Y. Zemel Axel Munk OT 17 52 0 14 Feb 2018
Near-linear time approximation algorithms for optimal transport via Sinkhorn iteration Jason M. Altschuler Jonathan Niles-Weed Philippe Rigollet OT 56 587 0 26 May 2017
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations Ranjay Krishna Yuke Zhu Oliver Groth Justin Johnson Kenji Hata ... Yannis Kalantidis Li Li David A. Shamma Michael S. Bernstein Fei-Fei Li 165 5,706 0 23 Feb 2016
DenseCap: Fully Convolutional Localization Networks for Dense Captioning Justin Johnson A. Karpathy Li Fei-Fei VLM 109 1,165 0 24 Nov 2015
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 274 3,527 0 10 Jun 2015
Randomized Approximation of the Gram Matrix: Exact Computation and Probabilistic Bounds J. Holodnak Ilse C. F. Ipsen 62 42 0 05 Oct 2013
Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances Marco Cuturi OT 133 4,210 0 04 Jun 2013