On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation

7 May 2020

Papers citing "On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation"

50 / 115 papers shown

Title
Sequence-level Large Language Model Training with Contrastive Preference Optimization Zhili Feng Dhananjay Ram Cole Hawkins Aditya Rawal Jinman Zhao Sheng Zha 62 0 0 23 Feb 2025
Few-shot LLM Synthetic Data with Distribution Matching Jiyuan Ren Zhaocheng Du Zhihao Wen Qinglin Jia Sunhao Dai Chuhan Wu Zhenhua Dong SyDa 87 0 0 09 Feb 2025
A Survey of Hallucination in Large Visual Language Models Wei Lan Wenyi Chen Qingfeng Chen Shirui Pan Huiyu Zhou Yi-Lun Pan LRM 30 4 0 20 Oct 2024
Coarse-to-Fine Highlighting: Reducing Knowledge Hallucination in Large Language Models Qitan Lv Jie Wang Hanzhu Chen Bin Li Yongdong Zhang Feng Wu HILM 28 3 0 19 Oct 2024
The Accuracy Paradox in RLHF: When Better Reward Models Don't Yield Better Language Models Yanjun Chen Dawei Zhu Yirong Sun Xinghao Chen Wei Zhang Xiaoyu Shen ALM 28 1 0 09 Oct 2024
Optimizing the Training Schedule of Multilingual NMT using Reinforcement Learning Alexis Allemann Àlex R. Atrio Andrei Popescu-Belis 28 0 0 08 Oct 2024
Better than Your Teacher: LLM Agents that learn from Privileged AI Feedback Sanjiban Choudhury Paloma Sodhi LLMAG 32 4 0 07 Oct 2024
LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations Hadas Orgad Michael Toker Zorik Gekhman Roi Reichart Idan Szpektor Hadas Kotek Yonatan Belinkov HILM AIFin 61 25 0 03 Oct 2024
Learning Harmonized Representations for Speculative Sampling Lefan Zhang Xiaodan Wang Yanhua Huang Ruiwen Xu 21 10 0 28 Aug 2024
Order Matters in Hallucination: Reasoning Order as Benchmark and Reflexive Prompting for Large-Language-Models Zikai Xie HILM LRM 61 5 0 09 Aug 2024
On the Evaluation Practices in Multilingual NLP: Can Machine Translation Offer an Alternative to Human Translations? Rochelle Choenni Sara Rajaee Christof Monz Ekaterina Shutova 39 1 0 20 Jun 2024
We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs Joseph Spracklen Raveen Wijewickrama A. H. M. N. Sakib Anindya Maiti Murtuza Jadliwala Murtuza Jadliwala 45 10 0 12 Jun 2024
On the Hallucination in Simultaneous Machine Translation M. Zhong Kehai Chen Zhengshan Xue Lemao Liu Mingming Yang Min Zhang HILM LRM 39 0 0 11 Jun 2024
Position: Cracking the Code of Cascading Disparity Towards Marginalized Communities G. Farnadi Mohammad Havaei Negar Rostamzadeh 37 2 0 03 Jun 2024
ProbGate at EHRSQL 2024: Enhancing SQL Query Generation Accuracy through Probabilistic Threshold Filtering and Error Handling Sangryul Kim Donghee Han Sehyun Kim 19 3 0 25 Apr 2024
Improving Factual Accuracy of Neural Table-to-Text Output by Addressing Input Problems in ToTTo Barkavi Sundararajan S. Sripada Ehud Reiter LMTD 32 1 0 05 Apr 2024
Language Models in Dialogue: Conversational Maxims for Human-AI Interactions Erik Miehling Manish Nagireddy P. Sattigeri Elizabeth M. Daly David Piorkowski John T. Richards ALM 42 11 0 22 Mar 2024
Successfully Guiding Humans with Imperfect Instructions by Highlighting Potential Errors and Suggesting Corrections Lingjun Zhao Khanh Nguyen Hal Daumé 37 1 0 26 Feb 2024
Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation Víctor M. Sánchez-Cartagena Miquel Espla-Gomis J. A. Pérez-Ortiz F. Sánchez-Martínez 33 4 0 29 Jan 2024
On the generalization capacity of neural networks during generic multimodal reasoning Takuya Ito Soham Dan Mattia Rigotti James Kozloski Murray Campbell LRM 37 2 0 26 Jan 2024
Benchmarking Large Language Models in Complex Question Answering Attribution using Knowledge Graphs Nan Hu Jiaoyan Chen Yike Wu Guilin Qi Sheng Bi Tongtong Wu Jeff Z. Pan HILM 37 8 0 26 Jan 2024
MAP's not dead yet: Uncovering true language model modes by conditioning away degeneracy Davis Yoshida Kartik Goyal Kevin Gimpel MoE 16 0 0 15 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 39 722 0 09 Nov 2023
CBSiMT: Mitigating Hallucination in Simultaneous Machine Translation with Weighted Prefix-to-Prefix Training Mengge Liu Wen Zhang Xiang Li Yanzhi Tian Yuhang Guo Jian Luan 000 Bin Wang Shuoying Chen 28 1 0 07 Nov 2023
TreeSwap: Data Augmentation for Machine Translation via Dependency Subtree Swapping Attila Nagy Dorina Lakatos Botond Barta Judit Ács 24 1 0 04 Nov 2023
Blending Reward Functions via Few Expert Demonstrations for Faithful and Accurate Knowledge-Grounded Dialogue Generation Wanyu Du Yangfeng Ji 24 1 0 02 Nov 2023
SoK: Memorization in General-Purpose Large Language Models Valentin Hartmann Anshuman Suri Vincent Bindschaedler David E. Evans Shruti Tople Robert West KELM LLMAG 18 20 0 24 Oct 2023
Hallucination Detection for Grounded Instruction Generation Lingjun Zhao Khanh Nguyen Hal Daumé HILM 36 7 0 23 Oct 2023
Unlikelihood Tuning on Negative Samples Amazingly Improves Zero-Shot Translation Junjie Yang Liang Ding Li Shen Matthieu Labeau Yibing Zhan Weifeng Liu Dacheng Tao VLM 28 4 0 28 Sep 2023
Chain-of-Verification Reduces Hallucination in Large Language Models S. Dhuliawala M. Komeili Jing Xu Roberta Raileanu Xian Li Asli Celikyilmaz Jason Weston LRM HILM 22 176 0 20 Sep 2023
Cognitive Mirage: A Review of Hallucinations in Large Language Models Hongbin Ye Tong Liu Aijia Zhang Wei Hua Weiqiang Jia HILM 48 76 0 13 Sep 2023
Zero-Resource Hallucination Prevention for Large Language Models Junyu Luo Cao Xiao Fenglong Ma HILM 29 16 0 06 Sep 2023
Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translation Keyu Chen Zhuang Di Mingchen Li J. M. Chang 22 3 0 06 Sep 2023
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models Yue Zhang Yafu Li Leyang Cui Deng Cai Lemao Liu ... Longyue Wang A. Luu Wei Bi Freda Shi Shuming Shi RALM LRM HILM 46 520 0 03 Sep 2023
ESRL: Efficient Sampling-based Reinforcement Learning for Sequence Generation Chenglong Wang Hang Zhou Yimin Hu Yi Huo Bei Li Tongran Liu Tong Xiao Jingbo Zhu 19 8 0 04 Aug 2023
Generative Models as a Complex Systems Science: How can we make sense of large language model behavior? Ari Holtzman Peter West Luke Zettlemoyer AI4CE 30 14 0 31 Jul 2023
Data Augmentation for Neural Machine Translation using Generative Language Model Seokjin Oh Su ah Lee Woohwan Jung SyDa 21 13 0 26 Jul 2023
Alleviating the Long-Tail Problem in Conversational Recommender Systems Zhipeng Zhao Kun Zhou Xiaolei Wang Wayne Xin Zhao Fan Pan Zhao Cao Ji-Rong Wen 26 11 0 21 Jul 2023
Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts Rebekka Hubert Artem Sokolov Stefan Riezler 19 1 0 17 Jul 2023
BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training Yiming Yan Tao Wang Chengqi Zhao Shujian Huang Jiajun Chen Mingxuan Wang 19 22 0 06 Jul 2023
Utility-Probability Duality of Neural Networks Bojun Huang Fei Yuan UQCV 27 1 0 24 May 2023
How Language Model Hallucinations Can Snowball Muru Zhang Ofir Press William Merrill Alisa Liu Noah A. Smith HILM LRM 82 253 0 22 May 2023
Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences Chaojun Wang Yang Liu Wai Lam 33 2 0 16 May 2023
Understanding and Bridging the Modality Gap for Speech Translation Qingkai Fang Yang Feng 27 25 0 15 May 2023
Automatic Evaluation of Attribution by Large Language Models Xiang Yue Boshi Wang Ziru Chen Kai Zhang Yu-Chuan Su Huan Sun ALM LRM HILM 33 54 0 10 May 2023
A Systematic Study of Knowledge Distillation for Natural Language Generation with Pseudo-Target Training Nitay Calderon Subhabrata Mukherjee Roi Reichart Amir Kantor 31 17 0 03 May 2023
Better Language Models of Code through Self-Improvement H. To Nghi D. Q. Bui Jingnan Guo T. Nguyen SyDa 39 15 0 02 Apr 2023
Elastic Weight Removal for Faithful and Abstractive Dialogue Generation Nico Daheim Nouha Dziri Mrinmaya Sachan Iryna Gurevych E. Ponti MoMe 34 30 0 30 Mar 2023
Hallucinations in Large Multilingual Translation Models Nuno M. Guerreiro Duarte M. Alves Jonas Waldendorf Barry Haddow Alexandra Birch Pierre Colombo André F.T. Martins VLM HILM LRM 35 140 0 28 Mar 2023
Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement Gavin Abercrombie Verena Rieser Dirk Hovy 54 16 0 25 Jan 2023