Learning Compact Metrics for MT

12 October 2021

Papers citing "Learning Compact Metrics for MT"

50 / 75 papers shown

Title
LITERA: An LLM Based Approach to Latin-to-English Translation Paul Rosu 23 0 0 14 Apr 2025
LLMs Can Achieve High-quality Simultaneous Machine Translation as Efficiently as Offline Biao Fu Minpeng Liao Kai Fan Chengxi Li Li Zhang Yidong Chen Xiaodong Shi OffRL 129 1 0 13 Apr 2025
Extend Adversarial Policy Against Neural Machine Translation via Unknown Token Wei Zou Shujian Huang Jiajun Chen AAML 73 0 0 21 Jan 2025
SciDQA: A Deep Reading Comprehension Dataset over Scientific Papers Shruti Singh Nandan Sarkar Arman Cohan 34 0 0 08 Nov 2024
Context-Informed Machine Translation of Manga using Multimodal Large Language Models Philip Lippmann Konrad Skublicki Joshua Tanner Shonosuke Ishiwatari Jie-jin Yang 33 0 0 04 Nov 2024
MetaMetrics-MT: Tuning Meta-Metrics for Machine Translation via Human Preference Calibration David Anugraha Garry Kuwanto Lucky Susanto Derry Wijaya Genta Indra Winata OSLM 40 2 0 01 Nov 2024
Diverse Sign Language Translation Xin Shen Lei Shen Shaozu Yuan Heming Du Haiyang Sun Xin Yu SLR 43 1 0 25 Oct 2024
Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics Stefano Perrella Lorenzo Proietti Pere-Lluís Huguet Cabot Edoardo Barba Roberto Navigli 21 3 0 07 Oct 2024
MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task Juraj Juraska Daniel Deutsch Mara Finkelstein Markus Freitag 39 14 0 04 Oct 2024
LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations Hadas Orgad Michael Toker Zorik Gekhman Roi Reichart Idan Szpektor Hadas Kotek Yonatan Belinkov HILM AIFin 61 25 0 03 Oct 2024
Reinforcement Learning without Human Feedback for Last Mile Fine-Tuning of Large Language Models Alec Solway ALM 42 0 0 29 Aug 2024
Improving Clinical Note Generation from Complex Doctor-Patient Conversation Yizhan Li Sifan Wu Christopher W. Smith Thomas Lo Bang Liu 34 3 0 26 Aug 2024
FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation Garrett Tanzer SLR VLM 34 2 0 24 Aug 2024
Plug, Play, and Fuse: Zero-Shot Joint Decoding via Word-Level Re-ranking Across Diverse Vocabularies Sai Koneru Matthias Huck M. Exel Jan Niehues 32 0 0 21 Aug 2024
Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines Yuchen Li Alexandre Kirchmeyer Aashay Mehta Yilong Qin Boris Dadachev Kishore Papineni Sanjiv Kumar Andrej Risteski 59 0 0 22 Jul 2024
Scaling Sign Language Translation Biao Zhang Garrett Tanzer Orhan Firat LRM VLM SLR 37 1 0 16 Jul 2024
Finetuning End-to-End Models for Estonian Conversational Spoken Language Translation Tiia Sildam Andra Velve Tanel Alumäe 48 0 0 04 Jul 2024
Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation Boxuan Lyu Hidetaka Kamigaito Kotaro Funakoshi Manabu Okumura 40 0 0 17 Jun 2024
Reconsidering Sentence-Level Sign Language Translation Garrett Tanzer Maximus Shengelia Ken Harrenstien David C. Uthus SLR 35 2 0 16 Jun 2024
Tell Me What's Next: Textual Foresight for Generic UI Representations Andrea Burns Kate Saenko Bryan A. Plummer LM&Ro AI4TS 36 4 0 12 Jun 2024
Evaluating Durability: Benchmark Insights into Multimodal Watermarking Jielin Qiu William Jongwon Han Xuandong Zhao Shangbang Long Christos Faloutsos Lei Li 65 1 0 06 Jun 2024
Faithful Chart Summarization with ChaTS-Pi Syrine Krichene Francesco Piccinno Fangyu Liu Julian Martin Eisenschlos 37 1 0 29 May 2024
G-DIG: Towards Gradient-based Diverse and High-quality Instruction Data Selection for Machine Translation Xingyuan Pan Luyang Huang Liyan Kang Zhicheng Liu Yu Lu Shanbo Cheng ALM 40 11 0 21 May 2024
What Have We Achieved on Non-autoregressive Translation? Yafu Li Huajian Zhang Jianhao Yan Yongjing Yin Yue Zhang 33 1 0 21 May 2024
Simultaneous Interpretation Corpus Construction by Large Language Models in Distant Language Pair Yusuke Sakai Mana Makinae Hidetaka Kamigaito Taro Watanabe 27 4 0 18 Apr 2024
Token-Efficient Leverage Learning in Large Language Models Yuanhao Zeng Min Wang Yihang Wang Yingxia Shao 37 0 0 01 Apr 2024
REFeREE: A REference-FREE Model-Based Metric for Text Simplification Yichen Huang Ekaterina Kochmar 52 1 0 26 Mar 2024
SnapNTell: Enhancing Entity-Centric Visual Question Answering with Retrieval Augmented Multimodal LLM Jielin Qiu Andrea Madotto Zhaojiang Lin Paul A. Crook Yongjun Xu Xin Luna Dong Christos Faloutsos Lei Li Babak Damavandi Seungwhan Moon 40 8 0 07 Mar 2024
Enabling Weak LLMs to Judge Response Reliability via Meta Ranking Zijun Liu Boqun Kou Peng Li Ming Yan Ji Zhang Fei Huang Yang Liu 32 2 0 19 Feb 2024
Open-ended VQA benchmarking of Vision-Language models by exploiting Classification datasets and their semantic hierarchy Simon Ging M. A. Bravo Thomas Brox VLM 43 11 0 11 Feb 2024
Hallucination Detection and Hallucination Mitigation: An Investigation Junliang Luo Tianyu Li Di Wu Michael R. M. Jenkin Steve Liu Gregory Dudek HILM LLMAG 44 22 0 16 Jan 2024
Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies Tom Kocmi Vilém Zouhar C. Federmann Matt Post 29 26 0 12 Jan 2024
POMP: Probability-driven Meta-graph Prompter for LLMs in Low-resource Unsupervised Neural Machine Translation Shilong Pan Zhiliang Tian Liang Ding Zhen Huang Zhihua Wen Dongsheng Li 37 2 0 11 Jan 2024
Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decoding Yuu Jinnai Kaito Ariu 29 8 0 05 Jan 2024
JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language Processing Shester Gueuwou Sophie Siake Colin Leong Mathias Müller SLR 37 11 0 16 Nov 2023
Model-Based Minimum Bayes Risk Decoding for Text Generation Yuu Jinnai Tetsuro Morimura Ukyo Honda Kaito Ariu Kenshi Abe 20 6 0 09 Nov 2023
Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks Yichen Huang Timothy Baldwin 22 2 0 01 Nov 2023
GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4 Tom Kocmi C. Federmann 30 73 0 21 Oct 2023
Enhancing Neural Machine Translation with Semantic Units Langlin Huang Shuhao Gu Zhuocheng Zhang Yang Feng 38 4 0 17 Oct 2023
Exploring Automatic Evaluation Methods based on a Decoder-based LLM for Text Generation Tomohito Kasahara Daisuke Kawahara 33 2 0 17 Oct 2023
xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection Nuno M. Guerreiro Ricardo Rei Daan van Stigt Luísa Coheur Pierre Colombo André F.T. Martins 48 112 0 16 Oct 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization Ondrej Skopek Rahul Aralikatte Sian Gooding Victor Carbune ELM 44 18 0 12 Oct 2023
It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk Amanda Bertsch Alex Xie Graham Neubig Matthew R. Gormley 40 31 0 02 Oct 2023
Segmentation-Free Streaming Machine Translation Javier Iranzo-Sánchez Jorge Iranzo-Sánchez Adria Giménez Jorge Civera Saiz A. Juan VOS 21 1 0 26 Sep 2023
Reranking for Natural Language Generation from Logical Forms: A Study based on Large Language Models Levon Haroutunian Zhuang Li Lucian Galescu Philip R. Cohen Raj Tumuluri Gholamreza Haffari LRM 26 1 0 21 Sep 2023
Time Travel in LLMs: Tracing Data Contamination in Large Language Models Shahriar Golchin Mihai Surdeanu 35 92 0 16 Aug 2023
This is not correct! Negation-aware Evaluation of Language Generation Systems Miriam Anschütz Diego Miguel Lozano Georg Groh 35 6 0 26 Jul 2023
Benchmarking Large Language Model Capabilities for Conditional Generation Joshua Maynez Priyanka Agrawal Sebastian Gehrmann ELM LM&MA 36 28 0 29 Jun 2023
YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpus David C. Uthus Garrett Tanzer Manfred Georg SLR 45 39 0 27 Jun 2023
FunQA: Towards Surprising Video Comprehension Binzhu Xie Sicheng Zhang Zitang Zhou Bo-wen Li Yuanhan Zhang Jack Hessel Jingkang Yang Ziwei Liu 39 20 0 26 Jun 2023