v1v2v3 (latest)

CleanCLIP: Mitigating Data Poisoning Attacks in Multimodal Contrastive Learning

6 March 2023

ArXiv (abs)PDF HTML Github (36★)

Papers citing "CleanCLIP: Mitigating Data Poisoning Attacks in Multimodal Contrastive Learning"

33 / 33 papers shown

Title
Defending Multimodal Backdoored Models by Repulsive Visual Prompt Tuning Zhifang Zhang Shuo He Bingquan Shen Lei Feng Lei Feng AAML 112 1 0 29 Dec 2024
DeDe: Detecting Backdoor Samples for SSL Encoders via Decoders Sizai Hou Songze Li Duanyi Yao AAML 178 0 0 25 Nov 2024
Threats, Attacks, and Defenses in Machine Unlearning: A Survey Ziyao Liu Huanyi Ye Chen Chen Yongsen Zheng K. Lam AAML MU 95 31 0 20 Mar 2024
Detecting Backdoors in Pre-trained Encoders Shiwei Feng Guanhong Tao Shuyang Cheng Guangyu Shen Xiangzhe Xu Yingqi Liu Kaiyuan Zhang Shiqing Ma Xiangyu Zhang 108 51 0 23 Mar 2023
Not All Poisons are Created Equal: Robust Training against Data Poisoning Yu Yang Tianwei Liu Baharan Mirzasoleiman AAML 47 38 0 18 Oct 2022
BackdoorBench: A Comprehensive Benchmark of Backdoor Learning Baoyuan Wu Hongrui Chen Ruotong Wang Zihao Zhu Shaokui Wei Danni Yuan Chaoxiao Shen ELM AAML 90 144 0 25 Jun 2022
Flamingo: a Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac Jeff Donahue Pauline Luc Antoine Miech Iain Barr ... Mikolaj Binkowski Ricardo Barreira Oriol Vinyals Andrew Zisserman Karen Simonyan MLLM VLM 385 3,542 0 29 Apr 2022
Backdoor Defense via Decoupling the Training Process Kunzhe Huang Yiming Li Baoyuan Wu Zhan Qin Kui Ren AAML FedML 56 193 0 05 Feb 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong Guosheng Lin MLLM BDL VLM CLIP 539 4,360 0 28 Jan 2022
A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision Ajinkya Tejankar Maziar Sanjabi Bichen Wu Saining Xie Madian Khabsa Hamed Pirsiavash Hamed Firooz VLM 62 18 0 27 Dec 2021
SLIP: Self-supervision meets Language-Image Pre-training Norman Mu Alexander Kirillov David Wagner Saining Xie VLM CLIP 141 490 0 23 Dec 2021
Anti-Backdoor Learning: Training Clean Models on Poisoned Data Yige Li X. Lyu Nodens Koren Lingjuan Lyu Yue Liu Xingjun Ma OnRL 73 334 0 22 Oct 2021
Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm Yangguang Li Feng Liang Lichen Zhao Yufeng Cui Wanli Ouyang Jing Shao F. Yu Junjie Yan VLM CLIP 145 453 0 11 Oct 2021
Adversarial Unlearning of Backdoors via Implicit Hypergradient Yi Zeng Si-An Chen Won Park Z. Morley Mao Ming Jin R. Jia AAML 122 176 0 07 Oct 2021
BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learning Jinyuan Jia Yupei Liu Neil Zhenqiang Gong SILM SSL 91 159 0 01 Aug 2021
Poisoning and Backdooring Contrastive Learning Nicholas Carlini Andreas Terzis 58 166 0 17 Jun 2021
Backdoor Attacks on Self-Supervised Learning Aniruddha Saha Ajinkya Tejankar Soroush Abbasi Koohpayegani Hamed Pirsiavash SSL AAML 50 109 0 21 May 2021
CLIPScore: A Reference-free Evaluation Metric for Image Captioning Jack Hessel Ari Holtzman Maxwell Forbes Ronan Le Bras Yejin Choi CLIP 139 1,561 0 18 Apr 2021
Rethinking the Backdoor Attacks' Triggers: A Frequency Perspective Yi Zeng Won Park Z. Morley Mao R. Jia AAML 48 215 0 07 Apr 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 445 3,856 0 11 Feb 2021
Input-Aware Dynamic Backdoor Attack A. Nguyen Anh Tran AAML 74 431 0 16 Oct 2020
Backdoor Learning: A Survey Yiming Li Yong Jiang Zhifeng Li Shutao Xia AAML 122 604 0 17 Jul 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo Basel Alomair Jacob Steinhardt Justin Gilmer OOD 340 1,740 0 29 Jun 2020
Label-Consistent Backdoor Attacks Alexander Turner Dimitris Tsipras Aleksander Madry AAML 68 389 0 05 Dec 2019
Robust Anomaly Detection and Backdoor Attack Detection Via Differential Privacy Min Du R. Jia Basel Alomair AAML 72 176 0 16 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 204 12,085 0 13 Nov 2019
Learning Robust Global Representations by Penalizing Local Predictive Power Haohan Wang Songwei Ge Eric Xing Zachary Chase Lipton OOD 122 962 0 29 May 2019
Do ImageNet Classifiers Generalize to ImageNet? Benjamin Recht Rebecca Roelofs Ludwig Schmidt Vaishaal Shankar OOD SSeg VLM 113 1,715 0 13 Feb 2019
A new Backdoor Attack in CNNs by training set corruption without label poisoning Mauro Barni Kassem Kallas B. Tondi AAML 110 356 0 12 Feb 2019
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks Jason W. Wei Kai Zou 110 1,957 0 31 Jan 2019
Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning Xinyun Chen Chang-rui Liu Yue Liu Kimberly Lu Basel Alomair AAML SILM 143 1,840 0 15 Dec 2017
BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain Tianyu Gu Brendan Dolan-Gavitt S. Garg SILM 127 1,772 0 22 Aug 2017
Representation Learning: A Review and New Perspectives Yoshua Bengio Aaron Courville Pascal Vincent OOD SSL 264 12,439 0 24 Jun 2012