Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning

18 August 2022

Papers citing "Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning"

43 / 43 papers shown

Title
Fine-Grained Bias Exploration and Mitigation for Group-Robust Classification Miaoyun Zhao Qiang Zhang C. Li 31 0 0 11 May 2025
VISLIX: An XAI Framework for Validating Vision Models with Slice Discovery and Analysis Xinyuan Yan Xiwei Xuan Jorge Henrique Piazentin Ono Jiajing Guo V. Mohanty Shekar Arvind Kumar Liang Gou Bei Wang Liu Ren 42 0 0 06 May 2025
Classifier-to-Bias: Toward Unsupervised Automatic Bias Detection for Visual Classifiers Quentin Guimard Moreno DÍncà Massimiliano Mancini Elisa Ricci SSL 72 0 0 29 Apr 2025
Detecting Systematic Weaknesses in Vision Models along Predefined Human-Understandable Dimensions Sujan Sai Gannamaneni Rohil Prakash Rao Michael Mock Maram Akila Stefan Wrobel AAML 147 0 0 17 Feb 2025
Improving Object Detection by Modifying Synthetic Data with Explainable AI Nitish Mital Simon Malzard Richard Walters Celso M. De Melo Raghuveer Rao Victoria Nockles 80 0 0 02 Dec 2024
Interactive Visual Assessment for Text-to-Image Generation Models Xiaoyue Mi Fan Tang Juan Cao Qiang Sheng Ziyao Huang Peng Li Yi Liu Tong-Yee Lee EGVM 71 0 0 23 Nov 2024
GIFT: A Framework for Global Interpretable Faithful Textual Explanations of Vision Classifiers Éloi Zablocki Valentin Gerard Amaia Cardiel Eric Gaussier Matthieu Cord Eduardo Valle 79 0 0 23 Nov 2024
Learning Where to Edit Vision Transformers Yunqiao Yang Long-Kai Huang Shengzhuang Chen Kede Ma Ying Wei KELM 30 1 0 04 Nov 2024
Explaining an image classifier with a generative model conditioned by uncertainty Adrien Le Coz Stéphane Herbin Faouzi Adjed 39 0 0 02 Oct 2024
Visual Data Diagnosis and Debiasing with Concept Graphs Rwiddhi Chakraborty Yinong Wang Jialu Gao Runkai Zheng Cheng Zhang Fernando de la Torre 37 2 0 26 Sep 2024
Are Pose Estimators Ready for the Open World? STAGE: Synthetic Data Generation Toolkit for Auditing 3D Human Pose Estimators Nikita Kister István Sárándi Anna Khoreva Gerard Pons-Moll 49 0 0 28 Aug 2024
Say My Name: a Model's Bias Discovery Framework Massimiliano Ciranni Luca Molinaro C. Barbano A. Fiandrotti Vittorio Murino Vito Paolo Pastore Enzo Tartaglione 32 3 0 18 Aug 2024
Model editing for distribution shifts in uranium oxide morphological analysis Davis Brown Cody Nizinski Madelyn Shapiro Corey Fallon Tianzhixi Yin Henry Kvinge Jonathan Tu 40 0 0 22 Jul 2024
Unveiling Glitches: A Deep Dive into Image Encoding Bugs within CLIP Ayush Ranjan Daniel Wen Karthik Bhat 26 0 0 30 Jun 2024
Reinforcing Pre-trained Models Using Counterfactual Images Xiang Li Ren Togo Keisuke Maeda Takahiro Ogawa Miki Haseyama 33 1 0 19 Jun 2024
Efficient Exploration of Image Classifier Failures with Bayesian Optimization and Text-to-Image Models Adrien Le Coz Houssem Ouertatani Stéphane Herbin Faouzi Adjed 26 0 0 26 Apr 2024
Identification of Fine-grained Systematic Errors via Controlled Scene Generation Valentyn Boreiko Matthias Hein J. H. Metzen 35 1 0 10 Apr 2024
Distributionally Generative Augmentation for Fair Facial Attribute Classification Fengda Zhang Qianpei He Kun Kuang Jiashuo Liu Long Chen Chao-Xiang Wu Jun Xiao Hanwang Zhang CVBM 42 8 0 11 Mar 2024
Benchmarking Segmentation Models with Mask-Preserved Attribute Editing Zijin Yin Kongming Liang Bing Li Zhanyu Ma Jun Guo VLM 41 2 0 02 Mar 2024
Lifelong Benchmarks: Efficient Model Evaluation in an Era of Rapid Progress Ameya Prabhu Vishaal Udandarao Philip H. S. Torr Matthias Bethge Adel Bibi Samuel Albanie 39 5 0 29 Feb 2024
Clarify: Improving Model Robustness With Natural Language Corrections Yoonho Lee Michelle S. Lam Helena Vasconcelos Michael S. Bernstein Chelsea Finn 33 6 0 06 Feb 2024
The Journey, Not the Destination: How Data Guides Diffusion Models Kristian Georgiev Joshua Vendrow Hadi Salman Sung Min Park Aleksander Madry 16 20 0 11 Dec 2023
Identifying and Mitigating Model Failures through Few-shot CLIP-aided Diffusion Generation Atoosa Malemir Chegini S. Feizi VLM 40 4 0 09 Dec 2023
Error Discovery by Clustering Influence Embeddings Fulton Wang Julius Adebayo Sarah Tan Diego Garcia-Olano Narine Kokhlikyan 21 3 0 07 Dec 2023
Probing clustering in neural network representations Thao Nguyen Simon Kornblith 32 1 0 14 Nov 2023
Effective Human-AI Teams via Learned Natural Language Rules and Onboarding Hussein Mozannar Jimin J Lee Dennis L. Wei P. Sattigeri Subhro Das David Sontag 41 11 0 02 Nov 2023
Targeted Image Data Augmentation Increases Basic Skills Captioning Robustness Valentin Barriere Felipe del Rio Andres Carvallo De Ferari Carlos Aspillaga Eugenio Herrera-Berg Cristian Buc Calderon DiffM 27 0 0 27 Sep 2023
Identifying Systematic Errors in Object Detectors with the SCROD Pipeline Valentyn Boreiko Matthias Hein J. H. Metzen 31 6 0 23 Sep 2023
ASPIRE: Language-Guided Data Augmentation for Improving Robustness Against Spurious Correlations Sreyan Ghosh Chandra Kiran Reddy Evuru Sonal Kumar Utkarsh Tyagi Sakshi Singh Sanjoy Chowdhury Dinesh Manocha OOD 30 1 0 19 Aug 2023
Identifying Interpretable Subspaces in Image Representations N. Kalibhat S. Bhardwaj Bayan Bruss Hamed Firooz Maziar Sanjabi S. Feizi FAtt 42 26 0 20 Jul 2023
Mass-Producing Failures of Multimodal Systems with Language Models Shengbang Tong Erik Jones Jacob Steinhardt 41 33 0 21 Jun 2023
Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms Nari Johnson Ángel Alexander Cabrera Gregory Plumb Ameet Talwalkar 31 13 0 13 Jun 2023
LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images Viraj Prabhu Sriram Yenamandra Prithvijit Chattopadhyay Judy Hoffman 22 37 0 30 May 2023
Spawrious: A Benchmark for Fine Control of Spurious Correlation Biases Aengus Lynch G. Dovonon Jean Kaddour Ricardo M. A. Silva 189 30 0 09 Mar 2023
Identification of Systematic Errors of Image Classifiers on Rare Subgroups J. H. Metzen Robin Hutmacher N. G. Hua Valentyn Boreiko Dan Zhang AAML VLM 61 19 0 09 Mar 2023
Dataset Interfaces: Diagnosing Model Failures Using Controllable Counterfactual Generation Joshua Vendrow Saachi Jain Logan Engstrom A. Madry OOD 17 34 0 15 Feb 2023
Discovering and Mitigating Visual Biases through Keyword Explanation Younghyun Kim Sangwoo Mo Minkyu Kim Kyungmin Lee Jaeho Lee Jinwoo Shin 40 32 0 26 Jan 2023
Adaptive Testing of Computer Vision Models Irena Gao Gabriel Ilharco Scott M. Lundberg Marco Tulio Ribeiro VLM 17 42 0 06 Dec 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 23 124 0 27 Jul 2022
Towards a More Rigorous Science of Blindspot Discovery in Image Classification Models Gregory Plumb Nari Johnson Ángel Alexander Cabrera Ameet Talwalkar 34 5 0 08 Jul 2022
Robust Feature-Level Adversaries are Interpretability Tools Stephen Casper Max Nadeau Dylan Hadfield-Menell Gabriel Kreiman AAML 45 27 0 07 Oct 2021
Constructing Unrestricted Adversarial Examples with Generative Models Yang Song Rui Shu Nate Kushman Stefano Ermon GAN AAML 185 302 0 21 May 2018
Adversarial examples in the physical world Alexey Kurakin Ian Goodfellow Samy Bengio SILM AAML 287 5,837 0 08 Jul 2016