v1v2v3 (latest)

RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question

2 November 2022

Alireza Mohammadshahi

Angela Fan

Papers citing "RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question"

50 / 74 papers shown

Title
Context Selection and Rewriting for Video-based Educational Question Generation Mengxia Yu Bang Nguyen Olivia Zino Meng Jiang 154 0 0 28 Apr 2025
A Practical Toolkit for Multilingual Question and Answer Generation Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados SyDa 75 14 0 27 May 2023
An Empirical Comparison of LM-based Question and Answer Generation Methods Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados 68 20 0 26 May 2023
SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages Alireza Mohammadshahi Vassilina Nikoulina Alexandre Berard Caroline Brun James Henderson Laurent Besacier VLM MoE LRM 84 20 0 20 Oct 2022
Generative Language Models for Paragraph-Level Question Generation Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados ELM 55 48 0 08 Oct 2022
What Do Compressed Multilingual Machine Translation Models Forget? Alireza Mohammadshahi Vassilina Nikoulina Alexandre Berard Caroline Brun James Henderson Laurent Besacier AI4CE 84 9 0 22 May 2022
Quiz Design Task: Helping Teachers Create Quizzes with Automated Question Generation Philippe Laban Chien-Sheng Wu Lidiya Murakhovs'ka Wenhao Liu Caiming Xiong AI4Ed 56 23 0 03 May 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang Bang Liu Siliang Tang Lingfei Wu 77 9 0 29 Apr 2022
UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Training Daniel Khashabi Yeganeh Kordi Hannaneh Hajishirzi 91 67 0 23 Feb 2022
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization Alexander R. Fabbri Chien-Sheng Wu Wenhao Liu Caiming Xiong HILM 94 218 0 16 Dec 2021
MixQG: Neural Question Generation with Mixed Answer Types Lidiya Murakhovs'ka Chien-Sheng Wu Philippe Laban Tong Niu Wenhao Liu Caiming Xiong 78 48 0 15 Oct 2021
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation Mingkai Deng Bowen Tan Zhengzhong Liu Eric Xing Zhiting Hu 40 73 0 14 Sep 2021
mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Dataset L. Bonifacio Vitor Jeronymo Hugo Queiroz Abonizio Israel Campiotti Marzieh Fadaee R. Lotufo Rodrigo Nogueira 101 113 0 31 Aug 2021
QACE: Asking Questions to Evaluate an Image Caption Hwanhee Lee Thomas Scialom Seunghyun Yoon Franck Dernoncourt Kyomin Jung CoGe 73 19 0 28 Aug 2021
BARTScore: Evaluating Generated Text as Text Generation Weizhe Yuan Graham Neubig Pengfei Liu 137 849 0 22 Jun 2021
PROST: Physical Reasoning of Objects through Space and Time Stéphane Aroca-Ouellette Cory Paik Alessandro Roncone Katharina Kann LRM 72 49 0 07 Jun 2021
Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting Yi Cheng Siyao Li Bang Liu Ruihui Zhao Sujian Li Chenghua Lin Yefeng Zheng 122 40 0 25 May 2021
Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling Alireza Mohammadshahi James Henderson 67 12 0 15 Apr 2021
Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluation Clément Rebuffel Thomas Scialom Laure Soulier Benjamin Piwowarski Sylvain Lamprier Jacopo Staiano Geoffrey Scoutheeten Patrick Gallinari 73 32 0 15 Apr 2021
QuestEval: Summarization Asks for Fact-based Evaluation Thomas Scialom Paul-Alexis Dray Patrick Gallinari Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano Alex Jinpeng Wang HILM 71 276 0 23 Mar 2021
OneStop QAMaker: Extract Question-Answer Pairs from Text in a One-Stop Approach Shaobo Cui Xintong Bao Xinxing Zu Yangyang Guo Zhongzhou Zhao Ji Zhang Haiqing Chen RALM 41 15 0 24 Feb 2021
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies Mor Geva Daniel Khashabi Elad Segal Tushar Khot Dan Roth Jonathan Berant RALM 351 737 0 06 Jan 2021
MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics Anthony Chen Gabriel Stanovsky Sameer Singh Matt Gardner 89 51 0 07 Oct 2020
COMET: A Neural Framework for MT Evaluation Ricardo Rei Craig Alan Stewart Ana C. Farinha A. Lavie 152 1,098 0 18 Sep 2020
Measuring Massive Multitask Language Understanding Dan Hendrycks Collin Burns Steven Basart Andy Zou Mantas Mazeika Basel Alomair Jacob Steinhardt ELM RALM 187 4,577 0 07 Sep 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 169 2,761 0 05 Jun 2020
Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing Brian Thompson Matt Post LRM 60 190 0 30 Apr 2020
Semantic Graphs for Generating Deep Questions Liangming Pan Yuxi Xie Yansong Feng Tat-Seng Chua Min-Yen Kan 89 95 0 27 Apr 2020
BLEURT: Learning Robust Metrics for Text Generation Thibault Sellam Dipanjan Das Ankur P. Parikh 108 1,506 0 09 Apr 2020
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries Alex Jinpeng Wang Kyunghyun Cho M. Lewis HILM 86 483 0 08 Apr 2020
Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement Alireza Mohammadshahi James Henderson 81 34 0 29 Mar 2020
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages Peng Qi Yuhao Zhang Yuhui Zhang Jason Bolton Christopher D. Manning AI4TS 260 1,698 0 16 Mar 2020
Training Question Answering Models From Synthetic Data Raul Puri Ryan Spring M. Patwary Mohammad Shoeybi Bryan Catanzaro ELM 81 160 0 22 Feb 2020
ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning Weihao Yu Zihang Jiang Yanfei Dong Jiashi Feng LRM 134 254 0 11 Feb 2020
Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension Max Bartolo A. Roberts Johannes Welbl Sebastian Riedel Pontus Stenetorp AAML 119 175 0 02 Feb 2020
PIQA: Reasoning about Physical Commonsense in Natural Language Yonatan Bisk Rowan Zellers Ronan Le Bras Jianfeng Gao Yejin Choi OOD LRM 192 1,847 0 26 Nov 2019
Graph-to-Graph Transformer for Transition-based Dependency Parsing Alireza Mohammadshahi James Henderson AI4CE 26 26 0 08 Nov 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 266 10,880 0 29 Oct 2019
QASC: A Dataset for Question Answering via Sentence Composition Tushar Khot Peter Clark Michal Guerquin Peter Alexander Jansen Ashish Sabharwal CoGe 81 330 0 25 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 506 20,376 0 23 Oct 2019
Aligning Multilingual Word Embeddings for Cross-Modal Retrieval Task Alireza Mohammadshahi R. Lebret Karl Aberer 36 11 0 08 Oct 2019
Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering Shiyue Zhang Joey Tianyi Zhou 77 140 0 13 Sep 2019
PubMedQA: A Dataset for Biomedical Research Question Answering Qiao Jin Bhuwan Dhingra Zhengping Liu William W. Cohen Xinghua Lu 404 914 0 13 Sep 2019
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance Wei Zhao Maxime Peyrard Fei Liu Yang Gao Christian M. Meyer Steffen Eger 194 602 0 05 Sep 2019
Answers Unite! Unsupervised Metrics for Reinforced Summarization Models Thomas Scialom Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 76 150 0 04 Sep 2019
Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoning Lifu Huang Ronan Le Bras Chandra Bhagavatula Yejin Choi AIMat RALM LRM 118 459 0 31 Aug 2019
Reasoning Over Paragraph Effects in Situations Kevin Lin Oyvind Tafjord Peter Clark Matt Gardner 90 115 0 16 Aug 2019
Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoning Pradeep Dasigi Nelson F. Liu Ana Marasović Noah A. Smith Matt Gardner RALM 75 174 0 16 Aug 2019
TWEETQA: A Social Media Focused Question Answering Dataset Wenhan Xiong Jiawei Wu Hong Wang Vivek Kulkarni Mo Yu Shiyu Chang Xiaoxiao Guo William Yang Wang 77 78 0 14 Jul 2019
HEAD-QA: A Healthcare Dataset for Complex Reasoning David Vilares Carlos Gómez-Rodríguez 63 83 0 11 Jun 2019