Robust Calibration of Large Vision-Language Adapters

18 July 2024

Balamurali Murugesan

Julio Silva-Rodríguez

Jose Dolz

Papers citing "Robust Calibration of Large Vision-Language Adapters"

26 / 26 papers shown

Title
Technical report on label-informed logit redistribution for better domain generalization in low-shot classification with foundation models Behraj Khan T. Syed 395 1 0 29 Jan 2025
Understanding and Mitigating Miscalibration in Prompt Tuning for Vision-Language Models Shuoyuan Wang Yixuan Li Hongxin Wei VLM 83 2 0 03 Oct 2024
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models Julio Silva-Rodríguez Sina Hajimiri Ismail Ben Ayed Jose Dolz VLM 53 32 0 20 Dec 2023
MaPLe: Multi-modal Prompt Learning Muhammad Uzair Khattak H. Rasheed Muhammad Maaz Salman Khan Fahad Shahbaz Khan VPVLM VLM 248 544 0 06 Oct 2022
Effective Adaptation in Multi-Task Co-Training for Unified Autonomous Driving Xiwen Liang Yangxin Wu Jianhua Han Hang Xu Chunjing Xu Xiaodan Liang 62 35 0 19 Sep 2022
Sample-dependent Adaptive Temperature Scaling for Improved Calibration Thomas Joy Francesco Pinto Ser-Nam Lim Philip Torr P. Dokania UQCV 50 33 0 13 Jul 2022
Mitigating Neural Network Overconfidence with Logit Normalization Hongxin Wei Renchunzi Xie Hao-Ran Cheng Lei Feng Bo An Yixuan Li OODD 212 277 0 19 May 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 104 662 0 21 Feb 2022
The Devil is in the Margin: Margin-based Label Smoothing for Network Calibration Bingyuan Liu Ismail Ben Ayed Adrian Galdran Jose Dolz UQCV 50 68 0 30 Nov 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 222 1,011 0 09 Oct 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 457 2,340 0 02 Sep 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 315 10,099 0 17 Jun 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 773 28,659 0 26 Feb 2021
Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibration Christian Tomani Daniel Cremers Florian Buettner UQCV 44 34 0 24 Feb 2021
Constrained Optimization to Train Neural Networks on Critical and Under-Represented Classes Sara Sangalli Ertunc Erdil A. Hoetker O. Donati E. Konukoglu AI4CE 39 28 0 21 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 407 3,778 0 11 Feb 2021
Physics-constrained Deep Learning of Multi-zone Building Thermal Dynamics Ján Drgoňa Aaron Tuor V. Chandan D. Vrabie AI4CE 46 117 0 11 Nov 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo D. Song Jacob Steinhardt Justin Gilmer OOD 287 1,715 0 29 Jun 2020
Calibrating Deep Neural Networks using Focal Loss Jishnu Mukhoti Viveka Kulharia Amartya Sanyal Stuart Golodetz Philip Torr P. Dokania UQCV 81 454 0 21 Feb 2020
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt D. Song OODD 188 1,454 0 16 Jul 2019
When Does Label Smoothing Help? Rafael Müller Simon Kornblith Geoffrey E. Hinton UQCV 161 1,931 0 06 Jun 2019
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift Yaniv Ovadia Emily Fertig Jie Jessie Ren Zachary Nado D. Sculley Sebastian Nowozin Joshua V. Dillon Balaji Lakshminarayanan Jasper Snoek UQCV 148 1,677 0 06 Jun 2019
Learning Robust Global Representations by Penalizing Local Predictive Power Haohan Wang Songwei Ge Eric Xing Zachary Chase Lipton OOD 94 951 0 29 May 2019
Imposing Hard Constraints on Deep Networks: Promises and Limitations Pablo Márquez-Neila Mathieu Salzmann Pascal Fua PINN UQCV 116 140 0 07 Jun 2017
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 636 27,231 0 02 Dec 2015
Fine-Grained Visual Classification of Aircraft Subhransu Maji Esa Rahtu Arno Solin Matthew Blaschko Andrea Vedaldi 105 2,227 0 21 Jun 2013