Title
Open-World Evaluation for Retrieving Diverse Perspectives Hung-Ting Chen Eunsol Choi 37 0 0 26 Sep 2024
SQUARE: Automatic Question Answering Evaluation using Multiple Positive and Negative References Matteo Gabburo Siddhant Garg Rik Koncel-Kedziorski Alessandro Moschitti 29 1 0 21 Sep 2023
A Survey for Efficient Open Domain Question Answering Qin Zhang Shan Chen Dongkuan Xu Qingqing Cao Xiaojun Chen Trevor Cohn Meng Fang 33 33 0 15 Nov 2022
Efficiently Controlling Multiple Risks with Pareto Testing Bracha Laufer-Goldshtein Adam Fisch Regina Barzilay Tommi Jaakkola 38 16 0 14 Oct 2022
Improving Question Answering with Generation of NQ-like Questions Saptarashmi Bandyopadhyay Shraman Pal Hao-Li Zou Abhranil Chandra Jordan L. Boyd-Graber 27 1 0 12 Oct 2022
Investigating the Failure Modes of the AUC metric and Exploring Alternatives for Evaluating Systems in Safety Critical Applications Swaroop Mishra Anjana Arunkumar Chitta Baral 35 0 0 10 Oct 2022
Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering Shamane Siriwardhana Rivindu Weerasekera Elliott Wen Tharindu Kaluarachchi R. Rana Suranga Nanayakkara VLM 25 161 0 06 Oct 2022
Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements Leandro von Werra Lewis Tunstall A. Thakur A. Luccioni Tristan Thrush ... Julien Chaumond Margaret Mitchell Alexander M. Rush Thomas Wolf Douwe Kiela ELM 27 24 0 30 Sep 2022
Are We There Yet? A Decision Framework for Replacing Term Based Retrieval with Dense Retrieval Systems Sebastian Hofstatter Nick Craswell Bhaskar Mitra Hamed Zamani Allan Hanbury 43 5 0 26 Jun 2022
Evaluation of Semantic Answer Similarity Metrics Farida Mustafazade Peter F. Ebbinghaus 13 2 0 25 Jun 2022
'Tis but Thy Name: Semantic Question Answering Evaluation with 11M Names for 1M Entities Albert Huang 16 0 0 28 Feb 2022
Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation Jannis Bulian Christian Buck Wojciech Gajewski Benjamin Boerschinger Tal Schuster 33 44 0 15 Feb 2022
A Survey on Model Compression and Acceleration for Pretrained Language Models Canwen Xu Julian McAuley 30 58 0 15 Feb 2022
In Situ Answer Sentence Selection at Web-scale Zeyu Zhang Thuy Vu Alessandro Moschitti 38 4 0 16 Jan 2022
BEAMetrics: A Benchmark for Language Generation Evaluation Evaluation Thomas Scialom Felix Hill 28 7 0 18 Oct 2021
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline Xiangyang Liu Tianxiang Sun Junliang He Jiawen Wu Lingling Wu Xinyu Zhang Hao Jiang Bo Zhao Xuanjing Huang Xipeng Qiu ELM 28 46 0 13 Oct 2021
SituatedQA: Incorporating Extra-Linguistic Contexts into QA Michael J.Q. Zhang Eunsol Choi RALM 34 137 0 13 Sep 2021
What's in a Name? Answer Equivalence For Open-Domain Question Answering Chenglei Si Chen Zhao Jordan L. Boyd-Graber 159 35 0 11 Sep 2021
Efficient Nearest Neighbor Language Models Junxian He Graham Neubig Taylor Berg-Kirkpatrick RALM 195 103 0 09 Sep 2021
Highly Parallel Autoregressive Entity Linking with Discriminative Correction Nicola De Cao Wilker Aziz Ivan Titov 54 35 0 08 Sep 2021
Semantic Answer Similarity for Evaluating Question Answering Models Julian Risch Timo Moller Julian Gutsch M. Pietsch ELM 32 67 0 13 Aug 2021
One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval Akari Asai Xinyan Velocity Yu Jungo Kasai Hannaneh Hajishirzi RALM LRM 27 70 0 26 Jul 2021
A Discussion on Building Practical NLP Leaderboards: The Case of Machine Translation Sebastin Santy Prasanta Bhattacharya LLMAG 33 2 0 11 Jun 2021
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them Patrick Lewis Yuxiang Wu Linqing Liu Pasquale Minervini Heinrich Küttler Aleksandra Piktus Pontus Stenetorp Sebastian Riedel RALM 40 229 0 13 Feb 2021
Distilling Knowledge from Reader to Retriever for Question Answering Gautier Izacard Edouard Grave RALM 185 253 0 08 Dec 2020
Posterior Differential Regularization with f-divergence for Improving Model Robustness Hao Cheng Xiaodong Liu L. Pereira Yaoliang Yu Jianfeng Gao 250 31 0 23 Oct 2020
Generation-Augmented Retrieval for Open-domain Question Answering Yuning Mao Pengcheng He Xiaodong Liu Yelong Shen Jianfeng Gao Jiawei Han Weizhu Chen RALM 42 238 0 17 Sep 2020
Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets Patrick Lewis Pontus Stenetorp Sebastian Riedel OOD ELM 24 184 0 06 Aug 2020