Towards Calibrated Robust Fine-Tuning of Vision-Language Models

Towards Calibrated Robust Fine-Tuning of Vision-Language Models

3 November 2023

Alexander G. Hauptmann

Papers citing "Towards Calibrated Robust Fine-Tuning of Vision-Language Models"

17 / 17 papers shown

Title
Bayesian Principles Improve Prompt Learning In Vision-Language Models Mingyu Kim Jongwoo Ko Mijung Park VLM 43 0 0 19 Apr 2025
UCDR-Adapter: Exploring Adaptation of Pre-Trained Vision-Language Models for Universal Cross-Domain Retrieval Haoyu Jiang Zhi-Qi Cheng Gabriel Moreira Jiawen Zhu Jingdong Sun Bukun Ren Jun-Yan He Qi Dai Xian-Sheng Hua VLM 90 0 0 14 Dec 2024
Dual Risk Minimization: Towards Next-Level Robustness in Fine-tuning Zero-Shot Models Kaican Li Weiyan Xie Yongxiang Huang Didan Deng Lanqing Hong Zechao Li Ricardo Silva N. Zhang 74 0 0 29 Nov 2024
Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detection Geng Yu Jianing Zhu Jiangchao Yao Bo Han OODD 51 0 0 05 Nov 2024
MoTE: Reconciling Generalization with Specialization for Visual-Language to Video Knowledge Transfer Minghao Zhu Zhengpu Wang Mengxian Hu Ronghao Dang Xiao Lin Xun Zhou Chengju Liu Qijun Chen 39 1 0 14 Oct 2024
Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models Shuoyuan Wang Yixuan Li Hongxin Wei VLM 54 2 0 03 Oct 2024
DaWin: Training-free Dynamic Weight Interpolation for Robust Adaptation Changdae Oh Yixuan Li Kyungwoo Song Sangdoo Yun Dongyoon Han OOD MoMe 45 4 0 03 Oct 2024
Improving Network Interpretability via Explanation Consistency Evaluation Hefeng Wu Hao Jiang Keze Wang Ziyi Tang Xianghuan He Liang Lin FAtt AAML 36 0 0 08 Aug 2024
A Survey on Safe Multi-Modal Learning System Tianyi Zhao Liangliang Zhang Yao Ma Lu Cheng 60 9 0 08 Feb 2024
Open-Vocabulary Calibration for Fine-tuned CLIP Shuoyuan Wang Jindong Wang Guoqing Wang Bob Zhang Kaiyang Zhou Hongxin Wei VLM 33 5 0 07 Feb 2024
Trainable Projected Gradient Method for Robust Fine-tuning Junjiao Tian Xiaoliang Dai Chih-Yao Ma Zecheng He Yen-Cheng Liu Z. Kira 59 30 0 19 Mar 2023
What does a platypus look like? Generating customized prompts for zero-shot image classification Sarah M Pratt Ian Covert Rosanne Liu Ali Farhadi VLM 131 212 0 07 Sep 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong Guosheng Lin MLLM BDL VLM CLIP 392 4,154 0 28 Jan 2022
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 348 2,271 0 02 Sep 2021
Unleashing the Power of Contrastive Self-Supervised Visual Models via Contrast-Regularized Fine-Tuning Yifan Zhang Bryan Hooi Dapeng Hu Jian Liang Jiashi Feng 79 64 0 12 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 331 3,708 0 11 Feb 2021
Domain-Adversarial Training of Neural Networks Yaroslav Ganin E. Ustinova Hana Ajakan Pascal Germain Hugo Larochelle François Laviolette M. Marchand Victor Lempitsky GAN OOD 177 9,342 0 28 May 2015