Does the Generator Mind its Contexts? An Analysis of Generative Model Faithfulness under Context Transfer

22 February 2024

Baotian Hu

Lifeng Shang

Papers citing "Does the Generator Mind its Contexts? An Analysis of Generative Model Faithfulness under Context Transfer"

31 / 31 papers shown

Title
Temporal Knowledge Question Answering via Abstract Reasoning Induction Ziyang Chen Dongfang Li Xiang Zhao Baotian Hu Min Zhang LRM 49 16 0 15 Nov 2023
RealTime QA: What's the Answer Right Now? Jungo Kasai Keisuke Sakaguchi Yoichi Takahashi Ronan Le Bras Akari Asai Xinyan Velocity Yu Dragomir R. Radev Noah A. Smith Yejin Choi Kentaro Inui KELM 113 192 0 27 Jul 2022
StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models Adam Livska Tomávs Kovciský E. Gribovskaya Tayfun Terzi Eren Sezener ... Susannah Young Ellen Gilsenan-McMahon Sophia Austin Phil Blunsom Angeliki Lazaridou KELM 284 100 0 23 May 2022
On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models? Nouha Dziri Sivan Milton Mo Yu Osmar Zaiane Siva Reddy HILM 42 193 0 17 Apr 2022
Probing Factually Grounded Content Transfer with Factual Ablation Peter West Chris Quirk Michel Galley Yejin Choi HILM 63 9 0 18 Mar 2022
Read before Generate! Faithful Long Form Question Answering with Machine Reading Dan Su Xiaoguang Li Jindi Zhang Lifeng Shang Xin Jiang Qun Liu Pascale Fung HILM 55 61 0 01 Mar 2022
A Survey on Retrieval-Augmented Text Generation Huayang Li Yixuan Su Deng Cai Yan Wang Lemao Liu RALM 106 209 0 02 Feb 2022
New Methods & Metrics for LFQA tasks Suchismit Mahapatra V. Blagojević P. Bertorello Prasanna Kumar 42 2 0 26 Dec 2021
Training Dynamics for Text Summarization Models Tanya Goyal Jiacheng Xu Junjie Li Greg Durrett 99 30 0 15 Oct 2021
SituatedQA: Incorporating Extra-Linguistic Contexts into QA Michael J.Q. Zhang Eunsol Choi RALM 73 151 0 13 Sep 2021
Entity-Based Knowledge Conflicts in Question Answering Shayne Longpre Kartik Perisetla Anthony Chen Nikhil Ramesh Chris DuBois Sameer Singh HILM 320 257 0 10 Sep 2021
ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collections Jiexin Wang Adam Jatowt Masatoshi Yoshikawa 79 35 0 08 Sep 2021
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization Faisal Ladhak Esin Durmus He He Claire Cardie Kathleen McKeown 49 65 0 31 Aug 2021
A Dataset for Answering Time-Sensitive Questions Wenhu Chen Xinyi Wang Wenjie Wang 89 126 0 13 Aug 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics Artidoro Pagnoni Vidhisha Balachandran Yulia Tsvetkov HILM 260 310 0 27 Apr 2021
$$Q^{2}$: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering$ $Q^{2}$ : Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering Or Honovich Leshem Choshen Roee Aharoni Ella Neeman Idan Szpektor Omri Abend HILM 57 139 0 16 Apr 2021
The Curious Case of Hallucinations in Neural Machine Translation Vikas Raunak Arul Menezes Marcin Junczys-Dowmunt 177 194 0 14 Apr 2021
Hurdles to Progress in Long-form Question Answering Kalpesh Krishna Aurko Roy Mohit Iyyer 56 197 0 10 Mar 2021
On Faithfulness and Factuality in Abstractive Summarization Joshua Maynez Shashi Narayan Bernd Bohnet Ryan T. McDonald HILM 77 1,031 0 02 May 2020
AmbigQA: Answering Ambiguous Open-domain Questions Sewon Min Julian Michael Hannaneh Hajishirzi Luke Zettlemoyer 89 314 0 22 Apr 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 384 42,299 0 03 Dec 2019
Domain Robustness in Neural Machine Translation Mathias Müller Annette Rios Gonzales Rico Sennrich 55 95 0 08 Nov 2019
Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports Yuhao Zhang Derek Merck E. Tsai Christopher D. Manning C. Langlotz MedIm HILM 54 185 0 06 Nov 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 219 10,792 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 377 20,053 0 23 Oct 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 283 5,764 0 21 Apr 2019
Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategies Max Grusky Mor Naaman Yoav Artzi 84 555 0 30 Apr 2018
Learning to Extract Coherent Summary via Deep Reinforcement Learning Yuxiang Wu Baotian Hu AI4TS 38 170 0 19 Apr 2018
Diversity driven Attention Model for Query-based Abstractive Summarization Preksha Nema Mitesh Khapra Anirban Laha Balaraman Ravindran 69 169 0 26 Apr 2017
LCSTS: A Large Scale Chinese Short Text Summarization Dataset Baotian Hu Qingcai Chen Fangze Zhu 72 339 0 19 Jun 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.5K 149,842 0 22 Dec 2014