Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation

18 April 2021

Robin Jia

Douwe Kiela

Papers citing "Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation"

50 / 74 papers shown

Title
SWE-Synth: Synthesizing Verifiable Bug-Fix Data to Enable Large Language Models in Resolving Real-World Bugs Minh V.T. Pham Huy N. Phan Hoang N. Phan Cuong Le Chi T. Nguyen Nghi D. Q. Bui SyDa 29 0 0 20 Apr 2025
Cancer-Myth: Evaluating AI Chatbot on Patient Questions with False Presuppositions Wang Zhu Tianqi Chen Ching Ying Lin Jade Law Mazen Jizzini Jorge J. Nieva Ruishan Liu Robin Jia 39 0 0 15 Apr 2025
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 40 108 0 10 Apr 2025
LightDefense: A Lightweight Uncertainty-Driven Defense against Jailbreaks via Shifted Token Distribution Zhuoran Yang Jie Peng Zhen Tan Tianlong Chen Yanyong Zhang AAML 44 0 0 02 Apr 2025
Single-pass Detection of Jailbreaking Input in Large Language Models Leyla Naz Candogan Yongtao Wu Elias Abad Rocamora Grigorios G. Chrysos V. Cevher AAML 51 0 0 24 Feb 2025
Does Training on Synthetic Data Make Models Less Robust? Lingze Zhang Ellie Pavlick SyDa 89 0 0 11 Feb 2025
SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains Ran Xu Hui Liu Sreyashi Nag Zhenwei Dai Yaochen Xie ... Chen Luo Yang Li Joyce C. Ho Carl Yang Qi He RALM 73 8 0 28 Jan 2025
Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyond Shanshan Han 87 1 0 09 Oct 2024
Towards Robust Extractive Question Answering Models: Rethinking the Training Methodology Son Quoc Tran Matt Kretchmar OOD 19 0 0 29 Sep 2024
Assessing Brittleness of Image-Text Retrieval Benchmarks from Vision-Language Models Perspective Mariya Hendriksen Shuo Zhang R. Reinanda Mohamed Yahya Edgar Meij Maarten de Rijke 54 0 0 21 Jul 2024
An Empirical Comparison of Generative Approaches for Product Attribute-Value Identification Kassem Sabeh Robert Litschko Mouna Kacimi Barbara Plank J. Gamper 32 3 0 01 Jul 2024
QOG:Question and Options Generation based on Language Model Jincheng Zhou 34 2 0 18 Jun 2024
MirrorCheck: Efficient Adversarial Defense for Vision-Language Models Samar Fares Klea Ziu Toluwani Aremu N. Durasov Martin Takáč Pascal Fua Karthik Nandakumar Ivan Laptev VLM AAML 40 4 0 13 Jun 2024
QLSC: A Query Latent Semantic Calibrator for Robust Extractive Question Answering Ouyang Sheng Jianzong Wang Yong Zhang Zhitao Li Ziqi Liang Xulong Zhang Ning Cheng Jing Xiao 24 0 0 30 Apr 2024
Protecting Your LLMs with Information Bottleneck Zichuan Liu Zefan Wang Linjie Xu Jinyu Wang Lei Song Tianchun Wang Chunlin Chen Wei Cheng Jiang Bian KELM AAML 64 15 0 22 Apr 2024
Improving Adversarial Data Collection by Supporting Annotators: Lessons from GAHD, a German Hate Speech Dataset Janis Goldzycher Paul Röttger Gerold Schneider AAML 29 8 0 28 Mar 2024
Specification Overfitting in Artificial Intelligence Benjamin Roth Pedro Henrique Luz de Araujo Yuxi Xia Saskia Kaltenbrunner Christoph Korab 58 0 0 13 Mar 2024
Concept-aware Data Construction Improves In-context Learning of Language Models Michal Štefánik Marek Kadlcík Petr Sojka 54 0 0 08 Mar 2024
Partially Recentralization Softmax Loss for Vision-Language Models Robustness Hao Wang Xin Zhang Jinzhe Jiang Yaqian Zhao Chen Li AAML 27 0 0 06 Feb 2024
Domain Adaptation of Multilingual Semantic Search -- Literature Review Anna Bringmann Anastasia Zhukova VLM 41 0 0 05 Feb 2024
How the Advent of Ubiquitous Large Language Models both Stymie and Turbocharge Dynamic Adversarial Question Generation Yoo Yeon Sung Ishani Mondal Jordan L. Boyd-Graber 30 0 0 20 Jan 2024
Hallucination Augmented Recitations for Language Models Abdullatif Köksal Renat Aksitov Chung-Ching Chang HILM 45 5 0 13 Nov 2023
A Lightweight Method to Generate Unanswerable Questions in English Vagrant Gautam Miaoran Zhang Dietrich Klakow 9 1 0 30 Oct 2023
Robust Training for Conversational Question Answering Models with Reinforced Reformulation Generation Magdalena Kaiser Rishiraj Saha Roy Gerhard Weikum 24 3 0 20 Oct 2023
ASSERT: Automated Safety Scenario Red Teaming for Evaluating the Robustness of Large Language Models Alex Mei Sharon Levy William Y. Wang AAML 36 7 0 14 Oct 2023
Jailbreaking Black Box Large Language Models in Twenty Queries Patrick Chao Alexander Robey Yan Sun Hamed Hassani George J. Pappas Eric Wong AAML 59 572 0 12 Oct 2023
No Offense Taken: Eliciting Offensiveness from Language Models Anugya Srivastava Rahul Ahuja Rohith Mukku 14 3 0 02 Oct 2023
Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges Vinay Samuel Houda Aynaou Arijit Ghosh Chowdhury Karthik Venkat Ramanan Aman Chadha SyDa 33 7 0 21 Sep 2023
Generative Data Augmentation using LLMs improves Distributional Robustness in Question Answering Arijit Ghosh Chowdhury Aman Chadha OOD 16 3 0 03 Sep 2023
Explore, Establish, Exploit: Red Teaming Language Models from Scratch Stephen Casper Jason Lin Joe Kwon Gatlen Culp Dylan Hadfield-Menell AAML 8 83 0 15 Jun 2023
PromptAttack: Probing Dialogue State Trackers with Adversarial Prompts Xiangjue Dong Yun He Ziwei Zhu James Caverlee AAML 33 7 0 07 Jun 2023
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework Yangyi Chen Hongcheng Gao Ganqu Cui Lifan Yuan Dehan Kong ... Longtao Huang H. Xue Zhiyuan Liu Maosong Sun Heng Ji AAML ELM 27 6 0 29 May 2023
Query-Efficient Black-Box Red Teaming via Bayesian Optimization Deokjae Lee JunYeong Lee Jung-Woo Ha Jin-Hwa Kim Sang-Woo Lee Hwaran Lee Hyun Oh Song AAML 24 23 0 27 May 2023
A Practical Toolkit for Multilingual Question and Answer Generation Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados SyDa 26 13 0 27 May 2023
Entailment as Robust Self-Learner Jiaxin Ge Hongyin Luo Yoon Kim James R. Glass 42 3 0 26 May 2023
An Empirical Comparison of LM-based Question and Answer Generation Methods Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados 25 20 0 26 May 2023
On Evaluating Adversarial Robustness of Large Vision-Language Models Yunqing Zhao Tianyu Pang Chao Du Xiao Yang Chongxuan Li Ngai-man Cheung Min-Bin Lin VLM AAML MLLM 33 166 0 26 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 37 2 0 23 May 2023
Concept-aware Training Improves In-context Learning Ability of Language Models Michal Štefánik Marek Kadlcík KELM LRM 38 0 0 23 May 2023
Attributable and Scalable Opinion Summarization Tom Hosking Hao Tang Mirella Lapata 33 8 0 19 May 2023
SCENE: Self-Labeled Counterfactuals for Extrapolating to Negative Examples Deqing Fu Ameya Godbole Robin Jia 27 8 0 13 May 2023
Resources and Few-shot Learners for In-context Learning in Slavic Languages Michal vStefánik Marek Kadlcík Piotr Gramacki Petr Sojka 29 3 0 04 Apr 2023
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex Terry Yue Zhuo Zhuang Li Yujin Huang Fatemeh Shiri Weiqing Wang Gholamreza Haffari Yuan-Fang Li AAML 34 54 0 30 Jan 2023
Can Large Language Models Change User Preference Adversarially? Varshini Subhash AAML 37 8 0 05 Jan 2023
Defending Against Disinformation Attacks in Open-Domain Question Answering Orion Weller Aleem Khan Nathaniel Weir Dawn J Lawrie Benjamin Van Durme AAML 76 4 0 20 Dec 2022
Can In-context Learners Learn a Reasoning Concept from Demonstrations? Michal Tefnik Marek Kadlcík LRM 13 5 0 03 Dec 2022
A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering Matthew Maufe James Ravenscroft Rob Procter Maria Liakata 26 3 0 30 Nov 2022
Consecutive Question Generation via Dynamic Multitask Learning Yun Li Sujian Li Xing Shi LRM 24 2 0 16 Nov 2022
QAmeleon: Multilingual QA with Only 5 Examples Priyanka Agrawal Chris Alberti Fantine Huot Joshua Maynez Ji Ma Sebastian Ruder Kuzman Ganchev Dipanjan Das Mirella Lapata 15 28 0 15 Nov 2022
NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering Tengxun Zhang Hongfei Xu Josef van Genabith Deyi Xiong Hongying Zan AIMat LRM 24 5 0 07 Nov 2022