v1v2v3v4 (latest)

Open-Vocabulary Calibration for Fine-tuned CLIP

7 February 2024

ArXiv (abs)PDF HTML Github (13★)

Papers citing "Open-Vocabulary Calibration for Fine-tuned CLIP"

23 / 23 papers shown

Title
Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models Shuoyuan Wang Yixuan Li Hongxin Wei VLM 120 2 0 03 Oct 2024
A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP) Weijie Tu Weijian Deng Tom Gedeon UQCV VLM 46 35 0 12 Feb 2024
Towards Calibrated Robust Fine-Tuning of Vision-Language Models Changdae Oh Hyesu Lim Mijoo Kim Dongyoon Han Junhyeok Park Euiseog Jeong Alexander G. Hauptmann Zhi-Qi Cheng Kyungwoo Song VLM 70 18 0 03 Nov 2023
Proximity-Informed Calibration for Deep Neural Networks Miao Xiong Ailin Deng Pang Wei Koh Jiaying Wu Shen Li Jianqing Xu Bryan Hooi UQCV 151 15 0 07 Jun 2023
Enabling Calibration In The Zero-Shot Inference of Large Vision-Language Models Will LeVine Benjamin Pikus P. Raj Fernando Amat Gil VLM UQCV 41 12 0 11 Mar 2023
I2MVFormer: Large Language Model Generated Multi-View Document Supervision for Zero-Shot Image Classification Muhammad Ferjad Naeem Muhammad Gul Zain Ali Khan Yongqin Xian Muhammad Zeshan Afzal D. Stricker Luc Van Gool F. Tombari VLM 65 56 0 05 Dec 2022
Sample-dependent Adaptive Temperature Scaling for Improved Calibration Thomas Joy Francesco Pinto Ser-Nam Lim Philip Torr P. Dokania UQCV 68 34 0 13 Jul 2022
Robust Calibration with Multi-domain Temperature Scaling Yaodong Yu Stephen Bates Yi-An Ma Michael I. Jordan OOD UQCV 73 35 0 06 Jun 2022
A Simple Approach to Improve Single-Model Deep Uncertainty via Distance-Awareness J. Liu Shreyas Padhy Jie Jessie Ren Zi Lin Yeming Wen Ghassen Jerfel Zachary Nado Jasper Snoek Dustin Tran Balaji Lakshminarayanan UQCV BDL 217 51 0 01 May 2022
Out-of-Distribution Detection with Deep Nearest Neighbors Yiyou Sun Yifei Ming Xiaojin Zhu Yixuan Li OODD 200 529 0 13 Apr 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 141 1,354 0 10 Mar 2022
Scaling Up Vision-Language Pre-training for Image Captioning Xiaowei Hu Zhe Gan Jianfeng Wang Zhengyuan Yang Zicheng Liu Yumao Lu Lijuan Wang MLLM VLM 137 250 0 24 Nov 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 502 2,409 0 02 Sep 2021
Revisiting the Calibration of Modern Neural Networks Matthias Minderer Josip Djolonga Rob Romijnders F. Hubis Xiaohua Zhai N. Houlsby Dustin Tran Mario Lucic UQCV 100 367 0 15 Jun 2021
Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibration Christian Tomani Daniel Cremers Florian Buettner UQCV 52 36 0 24 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 456 3,893 0 11 Feb 2021
Mitigating Bias in Calibration Error Estimation Rebecca Roelofs Nicholas Cain Jonathon Shlens Michael C. Mozer 75 95 0 15 Dec 2020
Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learning Jize Zhang B. Kailkhura T. Y. Han UQCV 87 227 0 16 Mar 2020
To Trust Or Not To Trust A Classifier Heinrich Jiang Been Kim Melody Y. Guan Maya R. Gupta UQCV 179 473 0 30 May 2018
EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification P. Helber B. Bischke Andreas Dengel Damian Borth 152 1,828 0 31 Aug 2017
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 141 2,686 0 14 Nov 2013
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 126 2,269 0 21 Jun 2013
UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild K. Soomro Amir Zamir M. Shah CLIP VGen 160 6,164 0 03 Dec 2012