Sim-CLIP: Unsupervised Siamese Adversarial Fine-Tuning for Robust and
Semantically-Rich Vision-Language Models

Sim-CLIP: Unsupervised Siamese Adversarial Fine-Tuning for Robust and Semantically-Rich Vision-Language Models

20 July 2024

Md Zarif Hossain

Papers citing "Sim-CLIP: Unsupervised Siamese Adversarial Fine-Tuning for Robust and Semantically-Rich Vision-Language Models"

6 / 6 papers shown

Title
Jailbreak Attacks and Defenses against Multimodal Generative Models: A Survey Xuannan Liu Xing Cui Peipei Li Zekun Li Huaibo Huang Shuhan Xia Miaoxuan Zhang Yueying Zou Ran He AAML 65 6 0 14 Nov 2024
Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks Md Zarif Hossain Ahmed Imteaj AAML VLM 40 3 0 11 Sep 2024
TriplePlay: Enhancing Federated Learning with CLIP for Non-IID Data and Resource Efficiency Ahmed Imteaj Md Zarif Hossain Saika Zaman Abdur R. Shahid VLM 21 1 0 09 Sep 2024
On the Adversarial Robustness of Multi-Modal Foundation Models Christian Schlarmann Matthias Hein AAML 107 85 0 21 Aug 2023
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 314 5,775 0 29 Apr 2021
Gradient-based Adversarial Attacks against Text Transformers Chuan Guo Alexandre Sablayrolles Hervé Jégou Douwe Kiela SILM 98 227 0 15 Apr 2021