v1v2 (latest)

Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding

13 September 2023

Rico Sennrich

Jannis Vamvas

Alireza Mohammadshahi

HILM

ArXiv (abs)PDF HTML Github (35★)

Papers citing "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding"

30 / 30 papers shown

Title
Mechanistic Understanding and Mitigation of Language Confusion in English-Centric Large Language Models Ercong Nie Helmut Schmid Hinrich Schutze 75 0 0 22 May 2025
Large Language Models are Easily Confused: A Quantitative Metric, Security Implications and Typological Analysis Yiyi Chen Qiongxiu Li Russa Biswas Johannes Bjerva 107 4 0 17 Oct 2024
CiMaTe: Citation Count Prediction Effectively Leveraging the Main Text Jun Hirako Ryohei Sasano Koichi Takeda 85 2 0 06 Oct 2024
What is the Role of Small Models in the LLM Era: A Survey Lihu Chen Gaël Varoquaux ALM 201 32 0 10 Sep 2024
Selective Prompt Anchoring for Code Generation Yuan Tian Tianyi Zhang 213 3 0 17 Aug 2024
Understanding and Mitigating Language Confusion in LLMs Kelly Marchisio Wei-Yin Ko Alexandre Berard Théo Dehaze Sebastian Ruder 130 32 0 28 Jun 2024
Improving Language Model Integration for Neural Machine Translation Christian Herold Yingbo Gao Mohammad Zeineldeen Hermann Ney 59 2 0 08 Jun 2023
An Open Dataset and Model for Language Identification Laurie Burchell Alexandra Birch Nikolay Bogoychev Kenneth Heafield 56 36 0 23 May 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 182 152 0 28 Mar 2023
Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM Rachel Bawden François Yvon VLM LRM 81 65 0 03 Mar 2023
The unreasonable effectiveness of few-shot learning for machine translation Xavier Garcia Yamini Bansal Colin Cherry George F. Foster M. Krikun Fan Feng Melvin Johnson Orhan Firat 97 108 0 02 Feb 2023
Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Better David Dale Elena Voita Loïc Barrault Marta R. Costa-jussá HILM 210 73 0 16 Dec 2022
Prompting PaLM for Translation: Assessing Strategies and Performance David Vilar Markus Freitag Colin Cherry Jiaming Luo Viresh Ratnakar George F. Foster LRM 105 166 0 16 Nov 2022
Contrastive Decoding: Open-ended Text Generation as Optimization Xiang Lisa Li Ari Holtzman Daniel Fried Percy Liang Jason Eisner Tatsunori Hashimoto Luke Zettlemoyer M. Lewis 123 372 0 27 Oct 2022
Contrastive Search Is What You Need For Neural Text Generation Yixuan Su Nigel Collier 89 53 0 25 Oct 2022
Scaling Instruction-Finetuned Language Models Hyung Won Chung Le Hou Shayne Longpre Barret Zoph Yi Tay ... Jacob Devlin Adam Roberts Denny Zhou Quoc V. Le Jason W. Wei ReLM LRM 213 3,150 0 20 Oct 2022
What Do Compressed Multilingual Machine Translation Models Forget? Alireza Mohammadshahi Vassilina Nikoulina Alexandre Berard Caroline Brun James Henderson Laurent Besacier AI4CE 71 9 0 22 May 2022
High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics Markus Freitag David Grangier Qijun Tan Bowen Liang 112 97 0 17 Nov 2021
Finetuned Language Models Are Zero-Shot Learners Jason W. Wei Maarten Bosma Vincent Zhao Kelvin Guu Adams Wei Yu Brian Lester Nan Du Andrew M. Dai Quoc V. Le ALM UQCV 230 3,782 0 03 Sep 2021
SimCSE: Simple Contrastive Learning of Sentence Embeddings Tianyu Gao Xingcheng Yao Danqi Chen AILaw SSL 278 3,411 0 18 Apr 2021
The Curious Case of Hallucinations in Neural Machine Translation Vikas Raunak Arul Menezes Marcin Junczys-Dowmunt 208 194 0 14 Apr 2021
Subword Segmentation and a Single Bridge Language Affect Zero-Shot Neural Machine Translation Annette Rios Gonzales Mathias Müller Rico Sennrich 44 19 0 03 Nov 2020
Beyond English-Centric Multilingual Machine Translation Angela Fan Shruti Bhosale Holger Schwenk Zhiyi Ma Ahmed El-Kishky ... Vitaliy Liptchinsky Sergey Edunov Edouard Grave Michael Auli Armand Joulin LRM 83 857 0 21 Oct 2020
Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine Translation Bryan Eikema Wilker Aziz 80 135 0 20 May 2020
Simple, Scalable Adaptation for Neural Machine Translation Ankur Bapna N. Arivazhagan Orhan Firat AI4CE 113 417 0 18 Sep 2019
The Missing Ingredient in Zero-Shot Neural Machine Translation N. Arivazhagan Ankur Bapna Orhan Firat Roee Aharoni Melvin Johnson Wolfgang Macherey 81 117 0 17 Mar 2019
Multilingual NMT with a language-independent attention bridge Raúl Vázquez Alessandro Raganato Jörg Tiedemann Mathias Creutz 58 46 0 01 Nov 2018
A Call for Clarity in Reporting BLEU Scores Matt Post 179 2,998 0 23 Apr 2018
Six Challenges for Neural Machine Translation Philipp Koehn Rebecca Knowles AAML AIMat 377 1,225 0 12 Jun 2017
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Orhan Firat Kyunghyun Cho Yoshua Bengio LRM AIMat 273 627 0 06 Jan 2016