ObjectCompose: Evaluating Resilience of Vision-Based Models on Object-to-Background Compositional Changes

7 March 2024

H. Malik

Muhammad Huzaifa

Muzammal Naseer

Salman Khan

Fahad Shahbaz Khan

DiffM

ArXiv PDF HTML

Papers citing "ObjectCompose: Evaluating Resilience of Vision-Based Models on Object-to-Background Compositional Changes"

37 / 37 papers shown

Title
LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images Viraj Prabhu Sriram Yenamandra Prithvijit Chattopadhyay Judy Hoffman 56 41 0 30 May 2023
ImageNet-E: Benchmarking Neural Network Robustness via Attribute Editing Xiaodan Li YueFeng Chen Yao Zhu Shuhui Wang Rong Zhang Hui Xue 55 24 0 30 Mar 2023
EVA-CLIP: Improved Training Techniques for CLIP at Scale Quan-Sen Sun Yuxin Fang Ledell Yu Wu Xinlong Wang Yue Cao CLIP VLM 129 493 0 27 Mar 2023
Assessing Neural Network Robustness via Adversarial Pivotal Tuning Peter Ebert Christensen Vésteinn Snaebjarnarson Andrea Dittadi Serge Belongie Sagie Benaim AAML 45 1 0 17 Nov 2022
MaPLe: Multi-modal Prompt Learning Muhammad Uzair Khattak H. Rasheed Muhammad Maaz Salman Khan Fahad Shahbaz Khan VPVLM VLM 251 565 0 06 Oct 2022
Part-Based Models Improve Adversarial Robustness Chawin Sitawarin Kornrapat Pongmala Yizheng Chen Nicholas Carlini David Wagner 63 12 0 15 Sep 2022
Prompt-to-Prompt Image Editing with Cross Attention Control Amir Hertz Ron Mokady J. Tenenbaum Kfir Aberman Yael Pritch Daniel Cohen-Or DiffM 157 1,765 0 02 Aug 2022
Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Survey Abhijith Sharma Yijun Bian Phil Munz Apurva Narayan VLM AAML 58 20 0 16 Jun 2022
Patch-Fool: Are Vision Transformers Always Robust Against Adversarial Perturbations? Y. Fu Shunyao Zhang Shan-Hung Wu Cheng Wan Yingyan Lin AAML 43 67 0 16 Mar 2022
A ConvNet for the 2020s Zhuang Liu Hanzi Mao Chaozheng Wu Christoph Feichtenhofer Trevor Darrell Saining Xie ViT 154 5,158 0 10 Jan 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 388 15,454 0 20 Dec 2021
Palette: Image-to-Image Diffusion Models Chitwan Saharia William Chan Huiwen Chang Chris A. Lee Jonathan Ho Tim Salimans David J. Fleet Mohammad Norouzi DiffM VLM 471 1,630 0 10 Nov 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 466 2,394 0 02 Sep 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 432 21,392 0 25 Mar 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 367 6,757 0 23 Dec 2020
Denoising Diffusion Implicit Models Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 231 7,350 0 06 Oct 2020
Do Adversarially Robust ImageNet Models Transfer Better? Hadi Salman Andrew Ilyas Logan Engstrom Ashish Kapoor Aleksander Madry 62 424 0 16 Jul 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo D. Song Jacob Steinhardt Justin Gilmer OOD 320 1,732 0 29 Jun 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 372 13,025 0 26 May 2020
Achieving Robustness in the Wild via Adversarial Mixing with Disentangled Representations Sven Gowal Chongli Qin Po-Sen Huang taylan. cemgil Krishnamurthy Dvijotham Timothy A. Mann Pushmeet Kohli AAML OOD 67 57 0 06 Dec 2019
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt D. Song OODD 195 1,469 0 16 Jul 2019
On the Transfer of Inductive Bias from Simulation to the Real World: a New Disentanglement Dataset Muhammad Waleed Gondal Manuel Wüthrich Ðorðe Miladinovic Francesco Locatello M. Breidt V. Volchkov J. Akpo Olivier Bachem Bernhard Schölkopf Stefan Bauer OOD DRL 87 138 0 07 Jun 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 606 4,777 0 13 May 2019
Not Using the Car to See the Sidewalk: Quantifying and Controlling the Effects of Context in Classification and Segmentation Rakshith Shetty Bernt Schiele Mario Fritz 53 83 0 17 Dec 2018
Strike (with) a Pose: Neural Networks Are Easily Fooled by Strange Poses of Familiar Objects Michael A. Alcorn Melvin Johnson Zhitao Gong Chengfei Wang Long Mai Naveen Ari Stella Laurenzo 82 299 0 28 Nov 2018
AutoAugment: Learning Augmentation Policies from Data E. D. Cubuk Barret Zoph Dandelion Mané Vijay Vasudevan Quoc V. Le 118 1,771 0 24 May 2018
Constructing Unrestricted Adversarial Examples with Generative Models Yang Song Rui Shu Nate Kushman Stefano Ermon GAN AAML 211 306 0 21 May 2018
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 273 9,759 0 25 Oct 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 294 12,060 0 19 Jun 2017
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning Justin Johnson B. Hariharan Laurens van der Maaten Li Fei-Fei C. L. Zitnick Ross B. Girshick CoGe 289 2,374 0 20 Dec 2016
Adversarial Machine Learning at Scale Alexey Kurakin Ian Goodfellow Samy Bengio AAML 467 3,140 0 04 Nov 2016
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 277 19,981 0 07 Oct 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 760 36,781 0 25 Aug 2016
ShapeNet: An Information-Rich 3D Model Repository Angel X. Chang Thomas Funkhouser Leonidas Guibas Pat Hanrahan Qi-Xing Huang ... Shuran Song Hao Su Jianxiong Xiao L. Yi Feng Yu 3DV 155 5,522 0 09 Dec 2015
Explaining and Harnessing Adversarial Examples Ian Goodfellow Jonathon Shlens Christian Szegedy AAML GAN 264 19,045 0 20 Dec 2014
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 398 43,619 0 01 May 2014
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 261 14,912 1 21 Dec 2013