LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images

30 May 2023

Viraj Prabhu

Sriram Yenamandra

Prithvijit Chattopadhyay

Judy Hoffman

ArXiv PDF HTML

Papers citing "LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images"

35 / 35 papers shown

Title
Towards Assessing Deep Learning Test Input Generators Seif Mzoughi Ahmed Hajyahmed Mohamed Elshafei Foutse Khomh anb Diego Elias Costa D. Costa AAML 37 0 0 03 Apr 2025
Leveraging Vision-Language Foundation Models to Reveal Hidden Image-Attribute Relationships in Medical Imaging Amar Kumar Anita Kriz Barak Pertzov Tal Arbel MedIm 56 0 0 30 Mar 2025
PRISM: High-Resolution & Precise Counterfactual Medical Image Generation using Language-guided Stable Diffusion Amar Kumar Anita Kriz Mohammad Havaei Tal Arbel MedIm 49 2 0 28 Feb 2025
Learning Counterfactual Outcomes Under Rank Preservation Peng Wu Haoxuan Li Chunyuan Zheng Yan Zeng Jiawei Chen Yang Liu Ruocheng Guo Kaipeng Zhang 70 0 0 10 Feb 2025
Triplet Synthesis For Enhancing Composed Image Retrieval via Counterfactual Image Generation Kenta Uesugi Naoki Saito Keisuke Maeda Takahiro Ogawa Miki Haseyama 41 0 0 22 Jan 2025
GIFT: A Framework for Global Interpretable Faithful Textual Explanations of Vision Classifiers Éloi Zablocki Valentin Gerard Amaia Cardiel Eric Gaussier Matthieu Cord Eduardo Valle 81 0 0 23 Nov 2024
Semi-Truths: A Large-Scale Dataset of AI-Augmented Images for Evaluating Robustness of AI-Generated Image detectors Anisha Pal Julia Kruk Mansi Phute Manognya Bhattaram Diyi Yang Duen Horng Chau Judy Hoffman AAML 47 2 0 12 Nov 2024
LLM-Assisted Red Teaming of Diffusion Models through "Failures Are Fated, But Can Be Faded" Som Sagar Aditya Taparia Ransalu Senanayake 20 0 0 22 Oct 2024
Unsupervised Model Diagnosis Yinong Wang Eileen Li Jinqi Luo Zhaoning Wang Fernando de la Torre AAML 32 1 0 08 Oct 2024
Visual Data Diagnosis and Debiasing with Concept Graphs Rwiddhi Chakraborty Yinong Wang Jialu Gao Runkai Zheng Cheng Zhang Fernando de la Torre 37 2 0 26 Sep 2024
Linking in Style: Understanding learned features in deep learning models Maren H. Wehrheim Pamela Osuna-Vargas Matthias Kaschube GAN 31 0 0 25 Sep 2024
Are Pose Estimators Ready for the Open World? STAGE: Synthetic Data Generation Toolkit for Auditing 3D Human Pose Estimators Nikita Kister István Sárándi Anna Khoreva Gerard Pons-Moll 49 0 0 28 Aug 2024
Finding Patterns in Ambiguity: Interpretable Stress Testing in the Decision~Boundary Ines Gomes Luís F. Teixeira Jan N. van Rijn Carlos Soares André Restivo Luís Cunha Moisés Santos FAtt 32 1 0 12 Aug 2024
DEPICT: Diffusion-Enabled Permutation Importance for Image Classification Tasks Sarah Jabbour Gregory Kondas Ella Kazerooni Michael Sjoding David Fouhey Jenna Wiens FAtt DiffM 47 1 0 19 Jul 2024
Evaluating Model Bias Requires Characterizing its Mistakes Isabela Albuquerque Jessica Schrouff David Warde-Farley Ali Taylan Cemgil Sven Gowal Olivia Wiles 47 2 0 15 Jul 2024
Contrast Sets for Evaluating Language-Guided Robot Policies Abrar Anwar Rohan Gupta Jesse Thomason 32 3 0 19 Jun 2024
Reinforcing Pre-trained Models Using Counterfactual Images Xiang Li Ren Togo Keisuke Maeda Takahiro Ogawa Miki Haseyama 33 1 0 19 Jun 2024
Failures Are Fated, But Can Be Faded: Characterizing and Mitigating Unwanted Behaviors in Large-Scale Vision and Language Models Som Sagar Aditya Taparia Ransalu Senanayake 37 10 0 11 Jun 2024
Global Counterfactual Directions Bartlomiej Sobieski P. Biecek DiffM 58 5 0 18 Apr 2024
Evolving Interpretable Visual Classifiers with Large Language Models Mia Chiquier Utkarsh Mall Carl Vondrick VLM 30 10 0 15 Apr 2024
ImageNet-D: Benchmarking Neural Network Robustness on Diffusion Synthetic Object Chenshuang Zhang Fei Pan Junmo Kim In So Kweon Chengzhi Mao 49 9 1 27 Mar 2024
ObjectCompose: Evaluating Resilience of Vision-Based Models on Object-to-Background Compositional Changes H. Malik Muhammad Huzaifa Muzammal Naseer Salman Khan Fahad Shahbaz Khan DiffM 40 2 0 07 Mar 2024
Benchmarking Segmentation Models with Mask-Preserved Attribute Editing Zijin Yin Kongming Liang Bing Li Zhanyu Ma Jun Guo VLM 41 2 0 02 Mar 2024
RadEdit: stress-testing biomedical vision models via diffusion image editing Fernando Pérez-García Sam Bond-Taylor Pedro P. Sanchez B. V. Breugel Daniel Coelho De Castro ... M. Lungren A. Nori Javier Alvarez-Valle Ozan Oktay Maximilian Ilse MedIm 43 8 0 20 Dec 2023
Reliability in Semantic Segmentation: Can We Use Synthetic Data? Thibaut Loiseau Tuan-Hung Vu Mickaël Chen Patrick Pérez Matthieu Cord UQCV 26 12 0 14 Dec 2023
GeNIe: Generative Hard Negative Images Through Diffusion Soroush Abbasi Koohpayegani Anuj Singh K. Navaneet Hadi Jamali Rad Hamed Pirsiavash VLM DiffM 21 4 0 05 Dec 2023
ASPIRE: Language-Guided Data Augmentation for Improving Robustness Against Spurious Correlations Sreyan Ghosh Chandra Kiran Reddy Evuru Sonal Kumar Utkarsh Tyagi Sakshi Singh Sanjoy Chowdhury Dinesh Manocha OOD 30 1 0 19 Aug 2023
Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructions Juncheng Li Kaihang Pan Zhiqi Ge Minghe Gao Wei Ji Wenqiao Zhang Tat-Seng Chua Siliang Tang Hanwang Zhang Yueting Zhuang MLLM 32 68 0 08 Aug 2023
Efficient Large-Scale Visual Representation Learning And Evaluation Eden Dolev A. Awad Denisa Roberts Zahra Ebrahimzadeh Marcin Mejran Vaibhav Malpani Mahir Yavuz 35 0 0 22 May 2023
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models Seulki Park Daeho Um Hajung Yoon Sanghyuk Chun Sangdoo Yun Jin Young Choi 38 2 0 21 Apr 2023
End-to-End Diffusion Latent Optimization Improves Classifier Guidance Bram Wallace Akash Gokul Stefano Ermon Nikhil Naik 124 70 0 23 Mar 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 313 11,953 0 04 Mar 2022
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,781 0 24 Feb 2021
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 282 10,354 0 12 Dec 2018
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 296 39,198 0 01 Sep 2014