Analyzing the Behavior of Visual Question Answering Models

23 June 2016

Devi Parikh

Papers citing "Analyzing the Behavior of Visual Question Answering Models"

50 / 188 papers shown

Title
Interpretable Neural Computation for Real-World Compositional Visual Question Answering Ruixue Tang Chao Ma CoGe 19 2 0 10 Oct 2020
A Multimodal Memes Classification: A Survey and Open Research Issues Tariq Habib Afridi A. Alam Muhammad Numan Khan Jawad Khan Young-Koo Lee 29 35 0 17 Sep 2020
Uncovering Hidden Challenges in Query-Based Video Moment Retrieval Mayu Otani Yuta Nakashima Esa Rahtu J. Heikkilä 21 74 0 01 Sep 2020
Visual Question Answering on Image Sets Ankan Bansal Yuting Zhang Rama Chellappa CoGe 16 40 0 27 Aug 2020
Not all Failure Modes are Created Equal: Training Deep Neural Networks for Explicable (Mis)Classification Alberto Olmo Sailik Sengupta S. Kambhampati 28 6 0 26 Jun 2020
Neuro-Symbolic Visual Reasoning: Disentangling "Visual" from "Reasoning" Saeed Amizadeh Hamid Palangi Oleksandr Polozov Yichen Huang K. Koishida NAI LRM 39 58 0 20 Jun 2020
Exploring Weaknesses of VQA Models through Attribution Driven Insights Shaunak Halbe 18 2 0 11 Jun 2020
Estimating semantic structure for the VQA answer space Corentin Kervadec G. Antipov M. Baccouche Christian Wolf 26 4 0 10 Jun 2020
Roses Are Red, Violets Are Blue... but Should Vqa Expect Them To? Corentin Kervadec G. Antipov M. Baccouche Christian Wolf OOD 18 88 0 09 Jun 2020
Counterfactual VQA: A Cause-Effect Look at Language Bias Yulei Niu Kaihua Tang Hanwang Zhang Zhiwu Lu Xiansheng Hua Ji-Rong Wen CML 56 395 0 08 Jun 2020
CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning Alessandro Suglia Ioannis Konstas Andrea Vanzo E. Bastianelli Desmond Elliott Stella Frank Oliver Lemon 37 16 0 03 Jun 2020
The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes Douwe Kiela Hamed Firooz Aravind Mohan Vedanuj Goswami Amanpreet Singh Pratik Ringshia Davide Testuggine 45 580 0 10 May 2020
What is Learned in Visually Grounded Neural Syntax Acquisition Noriyuki Kojima Hadar Averbuch-Elor Alexander M. Rush Yoav Artzi 11 20 0 04 May 2020
Mind the Trade-off: Debiasing NLU Models without Degrading the In-distribution Performance Prasetya Ajie Utama N. Moosavi Iryna Gurevych OODD 12 124 0 01 May 2020
STARC: Structured Annotations for Reading Comprehension Yevgeni Berzak J. Malmaud R. Levy 11 22 0 30 Apr 2020
Look at the First Sentence: Position Bias in Question Answering Miyoung Ko Jinhyuk Lee Hyunjae Kim Gangwoo Kim Jaewoo Kang FaML OOD 27 100 0 30 Apr 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 55 1,991 0 16 Apr 2020
Understanding Knowledge Gaps in Visual Question Answering: Implications for Gap Identification and Testing Goonmeet Bajaj Bortik Bandyopadhyay Daniela Schmidt Pranav Maneriker Christopher Myers Srinivasan Parthasarathy 28 1 0 08 Apr 2020
What do Models Learn from Question Answering Datasets? Priyanka Sen Amir Saffari RALM ELM 18 74 0 07 Apr 2020
Generating Rationales in Visual Question Answering Hammad A. Ayyubi Md. Mehrab Tanjim Julian McAuley G. Cottrell LRM 22 5 0 04 Apr 2020
Counterfactual Samples Synthesizing for Robust Visual Question Answering Long Chen Xin Yan Jun Xiao Hanwang Zhang Shiliang Pu Yueting Zhuang OOD AAML 154 290 0 14 Mar 2020
Stress Test Evaluation of Transformer-based Models in Natural Language Understanding Tasks Carlos Aspillaga Andrés Carvallo Vladimir Araujo ELM 47 31 0 14 Feb 2020
CLOSURE: Assessing Systematic Generalization of CLEVR Models Dzmitry Bahdanau H. D. Vries Timothy J. O'Donnell Shikhar Murty Philippe Beaudoin Yoshua Bengio Aaron Courville NAI 13 90 0 12 Dec 2019
Exposing and Correcting the Gender Bias in Image Captioning Datasets and Models Shruti Bhargava David A. Forsyth FaML 19 49 0 02 Dec 2019
A Free Lunch in Generating Datasets: Building a VQG and VQA System with Attention and Humans in the Loop Jihyeon Janel Lee S. Arora 7 1 0 30 Nov 2019
Unlearn Dataset Bias in Natural Language Inference by Fitting the Residual He He Sheng Zha Haohan Wang 22 197 0 28 Aug 2019
Answering Questions about Data Visualizations using Efficient Bimodal Fusion Kushal Kafle Robik Shrestha Brian L. Price Scott D. Cohen Christopher Kanan 25 58 0 05 Aug 2019
Learning by Abstraction: The Neural State Machine Drew A. Hudson Christopher D. Manning NAI OCL 16 258 0 09 Jul 2019
RUBi: Reducing Unimodal Biases in Visual Question Answering Rémi Cadène Corentin Dancette H. Ben-younes Matthieu Cord Devi Parikh CML 19 369 0 24 Jun 2019
Adversarial Regularization for Visual Question Answering: Strengths, Shortcomings, and Side Effects Gabriel Grand Yonatan Belinkov 21 68 0 20 Jun 2019
Exact and Consistent Interpretation of Piecewise Linear Models Hidden behind APIs: A Closed Form Solution Zicun Cong Lingyang Chu Lanjun Wang X. Hu J. Pei 230 5 0 17 Jun 2019
Quantifying and Alleviating the Language Prior Problem in Visual Question Answering Yangyang Guo Zhiyong Cheng Liqiang Nie Yebin Liu Yinglong Wang Mohan Kankanhalli 22 36 0 13 May 2019
Challenges and Prospects in Vision and Language Research Kushal Kafle Robik Shrestha Christopher Kanan 22 41 0 19 Apr 2019
SIMCO: SIMilarity-based object COunting Marco Godi Christian Joppi Andrea Giachetti Marco Cristani 3DPC 14 0 0 15 Apr 2019
Answer Them All! Toward Universal Visual Question Answering Models Robik Shrestha Kushal Kafle Christopher Kanan 25 82 0 01 Mar 2019
From Visual to Acoustic Question Answering Jerome Abdelnour G. Salvi Jean Rouat 24 3 0 28 Feb 2019
GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question Answering Drew A. Hudson Christopher D. Manning CoGe NAI 24 137 0 25 Feb 2019
Saliency Learning: Teaching the Model Where to Pay Attention Reza Ghaeini Xiaoli Z. Fern Hamed Shahbazi Prasad Tadepalli FAtt XAI 29 30 0 22 Feb 2019
Cycle-Consistency for Robust Visual Question Answering Meet Shah Xinlei Chen Marcus Rohrbach Devi Parikh OOD 25 185 0 15 Feb 2019
Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded Ramprasaath R. Selvaraju Stefan Lee Yilin Shen Hongxia Jin Shalini Ghosh Larry Heck Dhruv Batra Devi Parikh FAtt VLM 19 252 0 11 Feb 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 69 1,214 0 04 Feb 2019
The meaning of "most" for visual question answering models A. Kuhnle Ann A. Copestake 10 4 0 31 Dec 2018
From FiLM to Video: Multi-turn Question Answering with Multi-modal Context T. Nguyen Shikhar Sharma Hannes Schulz Layla El Asri 15 33 0 17 Dec 2018
CLEAR: A Dataset for Compositional Language and Elementary Acoustic Reasoning Jerome Abdelnour G. Salvi Jean Rouat 14 14 0 26 Nov 2018
VQA with no questions-answers training B. Vatashsky S. Ullman 41 12 0 20 Nov 2018
Explicit Bias Discovery in Visual Question Answering Models Varun Manjunatha Nirat Saini L. Davis CML FAtt 19 92 0 19 Nov 2018
Towards Governing Agent's Efficacy: Action-Conditional $β$ -VAE for Deep Transparent Reinforcement Learning John Yang Gyujeong Lee Minsung Hyun Simyung Chang Nojun Kwak 29 3 0 11 Nov 2018
Do Explanations make VQA Models more Predictable to a Human? Arjun Chandrasekaran Viraj Prabhu Deshraj Yadav Prithvijit Chattopadhyay Devi Parikh FAtt 92 97 0 29 Oct 2018
Understand, Compose and Respond - Answering Visual Questions by a Composition of Abstract Procedures B. Vatashsky S. Ullman CoGe 26 1 0 25 Oct 2018
Improving Context Modelling in Multimodal Dialogue Generation Shubham Agarwal Ondrej Dusek Ioannis Konstas Verena Rieser 40 19 0 20 Oct 2018