COMET: A Neural Framework for MT Evaluation

18 September 2020

Papers citing "COMET: A Neural Framework for MT Evaluation"

50 / 328 papers shown

Title
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality? Pei Zhang Baosong Yang Hao-Ran Wei Dayiheng Liu Kai Fan Luo Si Jun Xie 21 3 0 25 Nov 2022
Best- $k$ Search Algorithm for Neural Text Generation Jiacheng Xu Caiming Xiong Silvio Savarese Yingbo Zhou 37 5 0 22 Nov 2022
Operationalizing Specifications, In Addition to Test Sets for Evaluating Constrained Generative Models Vikas Raunak Matt Post Arul Menezes EGVM 35 0 0 19 Nov 2022
What Knowledge Is Needed? Towards Explainable Memory for kNN-MT Domain Adaptation Wenhao Zhu Shujian Huang Yunzhe Lv Xin Zheng Jiajun Chen 33 7 0 08 Nov 2022
Revisiting Grammatical Error Correction Evaluation and Beyond Peiyuan Gong Xuebo Liu Heyan Huang Min Zhang 34 16 0 03 Nov 2022
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question Alireza Mohammadshahi Thomas Scialom Majid Yazdani Pouya Yanki Angela Fan James Henderson Marzieh Saeidi 31 20 0 02 Nov 2022
Dialect-robust Evaluation of Generated Text Jiao Sun Thibault Sellam Elizabeth Clark Tu Vu Timothy Dozat Dan Garrette Aditya Siddhant Jacob Eisenstein Sebastian Gehrmann 28 19 0 02 Nov 2022
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Chantal Amrhein Nikita Moghe Liane Guillou ELM 39 22 0 27 Oct 2022
TRScore: A Novel GPT-based Readability Scorer for ASR Segmentation and Punctuation model evaluation and selection Piyush Behre S.S. Tan A. Shah Harini Kesavamoorthy Shuangyu Chang Fei Zuo C. Basoglu Sayan D. Pathak 21 0 0 27 Oct 2022
Contrastive Search Is What You Need For Neural Text Generation Yixuan Su Nigel Collier 25 50 0 25 Oct 2022
DEMETR: Diagnosing Evaluation Metrics for Translation Marzena Karpinska N. Raj Katherine Thai Yixiao Song Ankita Gupta Mohit Iyyer 29 38 0 25 Oct 2022
Focused Concatenation for Context-Aware Neural Machine Translation Lorenzo Lupo Marco Dinarelli Laurent Besacier 27 8 0 24 Oct 2022
Don't Discard Fixed-Window Audio Segmentation in Speech-to-Text Translation Chantal Amrhein Barry Haddow 38 8 0 24 Oct 2022
Bilingual Synchronization: Restoring Translational Relationships with Editing Operations Jitao Xu Josep Crego François Yvon 40 4 0 24 Oct 2022
On the Effectiveness of Automated Metrics for Text Generation Systems Pius von Daniken Jan Deriu Don Tuggener Mark Cieliebak 33 3 0 24 Oct 2022
Finding Memo: Extractive Memorization in Constrained Sequence Generation Tasks Vikas Raunak Arul Menezes 38 13 0 24 Oct 2022
A Textless Metric for Speech-to-Speech Comparison Laurent Besacier S. Ribeiro Olivier Galibert Ioan Calapodescu 38 5 0 21 Oct 2022
Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task Keqin Bao Boyi Deng Dayiheng Liu Baosong Yang Wenqiang Lei Xiangnan He Derek F.Wong Jun Xie 17 5 0 18 Oct 2022
Alibaba-Translate China's Submission for WMT 2022 Metrics Shared Task Boyi Deng Keqin Bao Dayiheng Liu Baosong Yang Derek F. Wong Lidia S. Chao Wenqiang Lei Jun Xie 30 9 0 18 Oct 2022
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation Tianxiang Sun Junliang He Xipeng Qiu Xuanjing Huang 24 44 0 14 Oct 2022
DICTDIS: Dictionary Constrained Disambiguation for Improved NMT Ayush Maheshwari Piyush Sharma P. Jyothi Ganesh Ramakrishnan 36 3 0 13 Oct 2022
SQuId: Measuring Speech Naturalness in Many Languages Thibault Sellam Ankur Bapna Joshua Camp Diana Mackinnon Ankur P. Parikh Jason Riesa 35 17 0 12 Oct 2022
Toxicity in Multilingual Machine Translation at Scale Marta R. Costa-jussá Eric Michael Smith C. Ropers Daniel Licht Jean Maillard Javier Ferrando Carlos Escolano 30 25 0 06 Oct 2022
Just ClozE! A Novel Framework for Evaluating the Factual Consistency Faster in Abstractive Summarization Yiyang Li Lei Li Marina Litvak N. Vanetik Dingxing Hu Yuze Li Yanquan Zhou HILM 40 0 0 06 Oct 2022
GAPX: Generalized Autoregressive Paraphrase-Identification X Yi Zhou Renyu Li Hayden Housen Ser-Nam Lim BDL 44 0 0 05 Oct 2022
Out-of-Distribution Detection and Selective Generation for Conditional Language Models Jie Jessie Ren Jiaming Luo Yao-Min Zhao Kundan Krishna Mohammad Saleh Balaji Lakshminarayanan Peter J. Liu OODD 75 98 0 30 Sep 2022
An Automatic Evaluation of the WMT22 General Machine Translation Task Benjamin Marie AIMat 18 2 0 28 Sep 2022
Approaching English-Polish Machine Translation Quality Assessment with Neural-based Methods Artur Nowakowski 21 0 0 22 Sep 2022
Rethinking Round-Trip Translation for Machine Translation Evaluation Terry Yue Zhuo Qiongkai Xu Xuanli He Trevor Cohn LRM 24 2 0 15 Sep 2022
CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task Ricardo Rei Marcos Vinícius Treviso Nuno M. Guerreiro Chrysoula Zerva Ana C. Farinha ... T. Glushkova Duarte M. Alves A. Lavie Luísa Coheur André F. T. Martins 60 144 0 13 Sep 2022
Adam Mickiewicz University at WMT 2022: NER-Assisted and Quality-Aware Neural Machine Translation Artur Nowakowski Gabriela Pałka Kamil Guttmann Miko Pokrywka 30 5 0 07 Sep 2022
Layer or Representation Space: What makes BERT-based Evaluation Metrics Robust? Doan Nam Long Vu N. Moosavi Steffen Eger 36 9 0 06 Sep 2022
Multi-Figurative Language Generation Huiyuan Lai Malvina Nissim 27 1 0 05 Sep 2022
Podcast Summary Assessment: A Resource for Evaluating Summary Assessment Methods Potsawee Manakul Mark Gales 15 5 0 28 Aug 2022
SelF-Eval: Self-supervised Fine-grained Dialogue Evaluation Longxuan Ma Ziyu Zhuang Weinan Zhang Mingda Li Ting Liu 29 4 0 17 Aug 2022
Building Multilingual Machine Translation Systems That Serve Arbitrary X-Y Translations Akiko Eriguchi Shufang Xie Tao Qin Hany Awadalla LRM 53 7 0 30 Jun 2022
Exploring Diversity in Back Translation for Low-Resource Machine Translation Laurie Burchell Alexandra Birch Kenneth Heafield 31 15 0 01 Jun 2022
Chunk-based Nearest Neighbor Machine Translation Pedro Henrique Martins Zita Marinho André F.T. Martins RALM 90 28 0 24 May 2022
Lack of Fluency is Hurting Your Translation Model J. Yoo Jaewoo Kang 23 0 0 24 May 2022
Understanding and Mitigating the Uncertainty in Zero-Shot Translation Wenxuan Wang Wenxiang Jiao Shuo Wang Zhaopeng Tu Michael R. Lyu UQLM 35 9 0 20 May 2022
Twist Decoding: Diverse Generators Guide Each Other Jungo Kasai Keisuke Sakaguchi Ronan Le Bras Hao Peng Ximing Lu Dragomir R. Radev Yejin Choi Noah A. Smith SyDa 27 4 0 19 May 2022
PreQuEL: Quality Estimation of Machine Translation Outputs in Advance Shachar Don-Yehiya Leshem Choshen Omri Abend 33 10 0 18 May 2022
Who Are We Talking About? Handling Person Names in Speech Translation Marco Gaido Matteo Negri Marco Turchi 23 7 0 13 May 2022
SubER: A Metric for Automatic Evaluation of Subtitle Quality P. Wilken P. Georgakopoulou E. Matusov 22 13 0 11 May 2022
Building Machine Translation Systems for the Next Thousand Languages Ankur Bapna Isaac Caswell Julia Kreutzer Orhan Firat D. Esch ... Apurva Shah Yanping Huang Zhehuai Chen Yonghui Wu Macduff Hughes 56 98 0 09 May 2022
Non-Autoregressive Machine Translation: It's Not as Fast as it Seems Jindvrich Helcl Barry Haddow Alexandra Birch 27 20 0 04 May 2022
Quality-Aware Decoding for Neural Machine Translation Patrick Fernandes António Farinhas Ricardo Rei José G. C. de Souza Perez Ogayo Graham Neubig André F. T. Martins 41 57 0 02 May 2022
Semantically Informed Slang Interpretation Zhewei Sun R. Zemel Yang Xu 28 7 0 02 May 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 30 9 0 29 Apr 2022
Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code Daniel Deutsch Dan Roth AI4CE 45 2 0 29 Apr 2022