Do Explanations make VQA Models more Predictable to a Human?

29 October 2018

Arjun Chandrasekaran

Viraj Prabhu

Deshraj Yadav

Prithvijit Chattopadhyay

Devi Parikh

FAtt

ArXiv PDF HTML

Papers citing "Do Explanations make VQA Models more Predictable to a Human?"

28 / 28 papers shown

Title
Reasoning Models Don't Always Say What They Think Yanda Chen Joe Benton Ansh Radhakrishnan Jonathan Uesato Carson E. Denison ... Vlad Mikulik Samuel R. Bowman Jan Leike Jared Kaplan E. Perez ReLM LRM 68 14 1 08 May 2025
Convincing Rationales for Visual Question Answering Reasoning Kun Li G. Vosselman Michael Ying Yang 44 1 0 06 Feb 2024
Do Models Explain Themselves? Counterfactual Simulatability of Natural Language Explanations Yanda Chen Ruiqi Zhong Narutatsu Ri Chen Zhao He He Jacob Steinhardt Zhou Yu Kathleen McKeown LRM 34 47 0 17 Jul 2023
Quantifying the Intrinsic Usefulness of Attributional Explanations for Graph Neural Networks with Artificial Simulatability Studies Jonas Teufel Luca Torresi Pascal Friederich FAtt 34 1 0 25 May 2023
In Search of Verifiability: Explanations Rarely Enable Complementary Performance in AI-Advised Decision Making Raymond Fok Daniel S. Weld 24 61 0 12 May 2023
Patchwork Learning: A Paradigm Towards Integrative Analysis across Diverse Biomedical Data Sources Suraj Rajendran Weishen Pan M. Sabuncu Yong Chen Jiayu Zhou Fei Wang 57 14 0 10 May 2023
Are Human Explanations Always Helpful? Towards Objective Evaluation of Human Natural Language Explanations Bingsheng Yao Prithviraj Sen Lucian Popa James A. Hendler Dakuo Wang XAI ELM FAtt 25 10 0 04 May 2023
Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations Max Schemmer Niklas Kühl Carina Benz Andrea Bartos G. Satzger 21 98 0 04 Feb 2023
Tensions Between the Proxies of Human Values in AI Teresa Datta D. Nissani Max Cembalest Akash Khanna Haley Massa John P. Dickerson 34 2 0 14 Dec 2022
Use-Case-Grounded Simulations for Explanation Evaluation Valerie Chen Nari Johnson Nicholay Topin Gregory Plumb Ameet Talwalkar FAtt ELM 22 24 0 05 Jun 2022
A Meta-Analysis of the Utility of Explainable Artificial Intelligence in Human-AI Decision-Making Max Schemmer Patrick Hemmer Maximilian Nitsche Niklas Kühl Michael Vossing 29 56 0 10 May 2022
Learning to Scaffold: Optimizing Model Explanations for Teaching Patrick Fernandes Marcos Vinícius Treviso Danish Pruthi André F. T. Martins Graham Neubig FAtt 25 22 0 22 Apr 2022
Calibrating Trust of Multi-Hop Question Answering Systems with Decompositional Probes Kaige Xie Sarah Wiegreffe Mark O. Riedl ReLM 24 12 0 16 Apr 2022
Should I Follow AI-based Advice? Measuring Appropriate Reliance in Human-AI Decision-Making Max Schemmer Patrick Hemmer Niklas Kühl Carina Benz G. Satzger 19 56 0 14 Apr 2022
Interpreting Language Models with Contrastive Explanations Kayo Yin Graham Neubig MILM 23 77 0 21 Feb 2022
Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies Vivian Lai Chacha Chen Q. V. Liao Alison Smith-Renner Chenhao Tan 33 186 0 21 Dec 2021
Explain, Edit, and Understand: Rethinking User Study Design for Evaluating Model Explanations Siddhant Arora Danish Pruthi Norman M. Sadeh William W. Cohen Zachary Chase Lipton Graham Neubig FAtt 40 38 0 17 Dec 2021
Teaching Humans When To Defer to a Classifier via Exemplars Hussein Mozannar Arvindmani Satyanarayan David Sontag 36 43 0 22 Nov 2021
Can Explanations Be Useful for Calibrating Black Box Models? Xi Ye Greg Durrett FAtt 24 25 0 14 Oct 2021
Improving Human Sequential Decision-Making with Reinforcement Learning Hamsa Bastani Osbert Bastani W. Sinchaisri HAI OffRL 20 12 0 19 Aug 2021
A Review on Explainability in Multimodal Deep Neural Nets Gargi Joshi Rahee Walambe K. Kotecha 29 140 0 17 May 2021
VisQA: X-raying Vision and Language Reasoning in Transformers Theo Jaunet Corentin Kervadec Romain Vuillemot G. Antipov M. Baccouche Christian Wolf 19 26 0 02 Apr 2021
The Impact of Explanations on AI Competency Prediction in VQA Kamran Alipour Arijit Ray Xiaoyu Lin J. Schulze Yi Yao Giedrius Burachas 27 9 0 02 Jul 2020
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance Gagan Bansal Tongshuang Wu Joyce Zhou Raymond Fok Besmira Nushi Ece Kamar Marco Tulio Ribeiro Daniel S. Weld 42 581 0 26 Jun 2020
A Study on Multimodal and Interactive Explanations for Visual Question Answering Kamran Alipour J. Schulze Yi Yao Avi Ziskind Giedrius Burachas 32 27 0 01 Mar 2020
From Recognition to Cognition: Visual Commonsense Reasoning Rowan Zellers Yonatan Bisk Ali Farhadi Yejin Choi LRM BDL OCL ReLM 53 866 0 27 Nov 2018
On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detection Vivian Lai Chenhao Tan 29 373 0 19 Nov 2018
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering Yash Goyal Tejas Khot D. Summers-Stay Dhruv Batra Devi Parikh CoGe 125 3,126 0 02 Dec 2016