Disentangling Uncertainty in Machine Translation Evaluation

13 April 2022

Papers citing "Disentangling Uncertainty in Machine Translation Evaluation"

31 / 31 papers shown

Title
Dense Uncertainty Estimation Jing Zhang Yuchao Dai Mochu Xiang Deng-Ping Fan Peyman Moghadam Mingyi He Christian J. Walder Kaihao Zhang Mehrtash Harandi Nick Barnes UQCV BDL 73 11 0 13 Oct 2021
Uncertainty-Aware Machine Translation Evaluation T. Glushkova Chrysoula Zerva Ricardo Rei André F.T. Martins UQLM 101 43 0 13 Sep 2021
To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation Tom Kocmi C. Federmann Roman Grundkiewicz Marcin Junczys-Dowmunt Hitokazu Matsushita Arul Menezes 73 205 0 22 Jul 2021
On the Practicality of Deterministic Epistemic Uncertainty Janis Postels Mattia Segu Tao Sun Luca Sieber Luc Van Gool Feng Yu Federico Tombari UQCV 66 60 0 01 Jul 2021
Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation Markus Freitag George F. Foster David Grangier Viresh Ratnakar Qijun Tan Wolfgang Macherey 139 382 0 29 Apr 2021
DEUP: Direct Epistemic Uncertainty Prediction Salem Lahlou Moksh Jain Hadi Nekoei V. Butoi Paul Bertin Jarrid Rector-Brooks Maksym Korablyov Yoshua Bengio PER UQLM UQCV UD 240 84 0 16 Feb 2021
Towards More Fine-grained and Reliable NLP Performance Prediction Zihuiwen Ye Pengfei Liu Jinlan Fu Graham Neubig 58 33 0 10 Feb 2021
Know Your Limits: Uncertainty Estimation with ReLU Classifiers Fails at Reliable OOD Detection Dennis Ulmer Giovanni Cina OODD 78 32 0 09 Dec 2020
TransQuest: Translation Quality Estimation with Cross-lingual Transformers Tharindu Ranasinghe Constantin Orasan R. Mitkov ViT 46 109 0 01 Nov 2020
Unbabel's Participation in the WMT20 Metrics Shared Task Ricardo Rei Craig Alan Stewart Catarina Farinha A. Lavie 32 79 0 29 Oct 2020
Rethinking embedding coupling in pre-trained language models Hyung Won Chung Thibault Févry Henry Tsai Melvin Johnson Sebastian Ruder 144 141 0 24 Oct 2020
Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task Thibault Sellam Amy Pu Hyung Won Chung Sebastian Gehrmann Qijun Tan Markus Freitag Dipanjan Das Ankur P. Parikh VLM 36 37 0 08 Oct 2020
COMET: A Neural Framework for MT Evaluation Ricardo Rei Craig Alan Stewart Ana C. Farinha A. Lavie 102 1,075 0 18 Sep 2020
Regression Prior Networks A. Malinin Sergey Chervontsev Ivan Provilkov Mark Gales BDL UQCV 49 37 0 20 Jun 2020
Unsupervised Quality Estimation for Neural Machine Translation M. Fomicheva Shuo Sun Lisa Yankovskaya Frédéric Blain Francisco Guzmán Mark Fishel Nikolaos Aletras Vishrav Chaudhary Lucia Specia UQLM 80 198 0 21 May 2020
Reassessing Claims of Human Parity and Super-Human Performance in Machine Translation at WMT 2019 Antonio Toral 44 43 0 12 May 2020
Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing Brian Thompson Matt Post LRM 47 190 0 30 Apr 2020
BLEU might be Guilty but References are not Innocent Markus Freitag David Grangier Isaac Caswell 37 148 0 13 Apr 2020
BLEURT: Learning Robust Metrics for Text Generation Thibault Sellam Dipanjan Das Ankur P. Parikh 77 1,472 0 09 Apr 2020
Learning to Predict Error for MRI Reconstruction Shi Hu Nicola Pezzotti Max Welling UQCV 24 14 0 13 Feb 2020
What Kind of Language Is Hard to Language-Model? Sabrina J. Mielke Ryan Cotterell Kyle Gorman Brian Roark Jason Eisner 63 78 0 11 Jun 2019
Ensemble Distribution Distillation A. Malinin Bruno Mlodozeniec Mark Gales UQCV 58 232 0 30 Apr 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 245 5,668 0 21 Apr 2019
OpenKiwi: An Open Source Framework for Quality Estimation Fabio Kepler Jonay Trénous Marcos Vinícius Treviso M. Vera André F. T. Martins 38 130 0 22 Feb 2019
Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networks Guotai Wang Wenqi Li Michael Aertsen Jan Deprest Sebastien Ourselin Tom Vercauteren UQCV MedIm OOD 134 588 0 19 Jul 2018
Direct Uncertainty Prediction for Medical Second Opinions M. Raghu Katy Blumer Rory Sayres Ziad Obermeyer Robert D. Kleinberg S. Mullainathan Jon M. Kleinberg OOD UD 75 136 0 04 Jul 2018
Accurate Uncertainties for Deep Learning Using Calibrated Regression Volodymyr Kuleshov Nathan Fenner Stefano Ermon BDL UQCV 162 626 0 01 Jul 2018
What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? Alex Kendall Y. Gal BDL OOD UD UQCV PER 319 4,667 0 15 Mar 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 581 5,748 0 05 Dec 2016
Multilingual Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Models and Auxiliary Loss Barbara Plank Anders Søgaard Yoav Goldberg 47 408 0 19 Apr 2016
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 564 9,233 0 06 Jun 2015