CRoFT: Robust Fine-Tuning with Concurrent Optimization for OOD Generalization and Open-Set OOD Detection

26 May 2024

Xinbing Wang

Papers citing "CRoFT: Robust Fine-Tuning with Concurrent Optimization for OOD Generalization and Open-Set OOD Detection"

50 / 56 papers shown

Title
Domain Aligned CLIP for Few-shot Classification Muhammad Waleed Gondal Jochen Gast Inigo Alonso Ruiz Richard Droste Tommaso Macri Suren Kumar Luitpold Staudigl VLM 46 12 0 15 Nov 2023
Towards Effective Semantic OOD Detection in Unseen Domains: A Domain Generalization Perspective Haoliang Wang Chen Zhao Yunhui Guo Kai Jiang Feng Chen 73 3 0 18 Sep 2023
Understanding Hessian Alignment for Domain Generalization S. Hemati Guojun Zhang A. Estiri Xi Chen 41 11 0 22 Aug 2023
Unsupervised Prototype Adapter for Vision-Language Models Yi Zhang Ce Zhang Xue-mei Hu Z. He VLM 59 4 0 22 Aug 2023
AD-CLIP: Adapting Domains in Prompt Space Using CLIP Mainak Singha Harsh Pal Ankit Jha Biplab Banerjee VLM 50 52 0 10 Aug 2023
Improving Zero-Shot Generalization for CLIP with Synthesized Prompts Ziyi Wang Jian Liang Ran He Nana Xu Zilei Wang Tien-Ping Tan VLM 73 51 0 14 Jul 2023
Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detection Haoyue Bai Gregory H. Canal Xuefeng Du Jeongyeol Kwon Robert D. Nowak Yixuan Li OODD 47 46 0 15 Jun 2023
Vita-CLIP: Video and text adaptive CLIP via Multimodal Prompting Syed Talal Wasim Muzammal Naseer Salman Khan Fahad Shahbaz Khan M. Shah VLM VPVLM 67 76 0 06 Apr 2023
Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection Shilong Liu Zhaoyang Zeng Tianhe Ren Feng Li Hao Zhang ... Chun-yue Li Jianwei Yang Hang Su Jun Zhu Lei Zhang ObjD 168 1,893 0 09 Mar 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 391 4,465 0 30 Jan 2023
Finetune like you pretrain: Improved finetuning of zero-shot vision models Sachin Goyal Ananya Kumar Sankalp Garg Zico Kolter Aditi Raghunathan CLIP VLM 95 144 0 01 Dec 2022
Context-Aware Robust Fine-Tuning Xiaofeng Mao YueFeng Chen Xiaojun Jia Rong Zhang Hui Xue Zhao Li VLM CLIP 58 25 0 29 Nov 2022
Boosting Out-of-distribution Detection with Typical Features Yao Zhu YueFeng Chen Chuanlong Xie Xiaodan Li Rong Zhang Hui Xue Xiang Tian Bolun Zheng Yao-wu Chen OODD 103 51 0 09 Oct 2022
POEM: Out-of-Distribution Detection with Posterior Sampling Yifei Ming Ying Fan Yixuan Li OODD 63 116 0 28 Jun 2022
Prompt-aligned Gradient for Prompt Tuning Beier Zhu Yulei Niu Yucheng Han Yuehua Wu Hanwang Zhang VLM 235 279 0 30 May 2022
CyCLIP: Cyclic Contrastive Language-Image Pretraining Shashank Goel Hritik Bansal S. Bhatia Ryan Rossi Vishwa Vinay Aditya Grover CLIP VLM 239 135 0 28 May 2022
Out-of-Distribution Detection with Deep Nearest Neighbors Yiyou Sun Yifei Ming Xiaojin Zhu Yixuan Li OODD 152 505 0 13 Apr 2022
Unsupervised Prompt Learning for Vision-Language Models Hao Huang Jack Chu Fangyun Wei VPVLM MLLM VLM 73 132 0 07 Apr 2022
ViM: Out-Of-Distribution with Virtual-logit Matching Haoqi Wang Zhizhong Li Xue Jiang Wayne Zhang OODD 47 325 0 21 Mar 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 90 1,323 0 10 Mar 2022
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time Mitchell Wortsman Gabriel Ilharco S. Gadre Rebecca Roelofs Raphael Gontijo-Lopes ... Hongseok Namkoong Ali Farhadi Y. Carmon Simon Kornblith Ludwig Schmidt MoMe 112 953 1 10 Mar 2022
Training OOD Detectors in their Natural Habitats Julian Katz-Samuels Julia B. Nakhleh Robert D. Nowak Yixuan Li OODD 42 91 0 07 Feb 2022
SLIP: Self-supervision meets Language-Image Pre-training Norman Mu Alexander Kirillov David Wagner Saining Xie VLM CLIP 119 485 0 23 Dec 2021
ReAct: Out-of-distribution Detection With Rectified Activations Yiyou Sun Chuan Guo Yixuan Li OODD 73 467 0 24 Nov 2021
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 75 56 0 08 Nov 2021
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling Renrui Zhang Rongyao Fang Wei Zhang Peng Gao Kunchang Li Jifeng Dai Yu Qiao Hongsheng Li VLM 254 390 0 06 Nov 2021
Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm Yangguang Li Feng Liang Lichen Zhao Yufeng Cui Wanli Ouyang Jing Shao F. Yu Junjie Yan VLM CLIP 137 450 0 11 Oct 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 218 1,011 0 09 Oct 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 457 2,340 0 02 Sep 2021
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li Ramprasaath R. Selvaraju Akhilesh Deepak Gotmare Shafiq Joty Caiming Xiong Guosheng Lin FaML 159 1,915 0 16 Jul 2021
The Evolution of Out-of-Distribution Robustness Throughout Fine-Tuning Anders Andreassen Yasaman Bahri Behnam Neyshabur Rebecca Roelofs OOD OODD 61 80 0 30 Jun 2021
Generalized Few-Shot Object Detection without Forgetting Zhibo Fan Yuchen Ma Zeming Li Jian Sun VLM ObjD 96 169 0 20 May 2021
OpenGAN: Open-Set Recognition via Open Data Generation Shu Kong Deva Ramanan 62 215 0 07 Apr 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 760 28,659 0 26 Feb 2021
SWAD: Domain Generalization by Seeking Flat Minima Junbum Cha Sanghyuk Chun Kyungjae Lee Han-Cheol Cho Seunghyun Park Yunsung Lee Sungrae Park MoMe 273 441 0 17 Feb 2021
Unsupervised Energy-based Out-of-distribution Detection using Stiefel-Restricted Kernel Machine F. Tonin Arun Pandey Panagiotis Patrinos Johan A. K. Suykens OODD 72 14 0 16 Feb 2021
Few-Shot Learning for Road Object Detection Anay Majee Kshitij Agrawal A. Subramanian 104 21 0 29 Jan 2021
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 343 1,950 0 31 Dec 2020
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 163 1,418 0 14 Dec 2020
Energy-based Out-of-distribution Detection Weitang Liu Xiaoyun Wang John Douglas Owens Yixuan Li OODD 232 1,332 0 08 Oct 2020
In Search of Lost Domain Generalization Ishaan Gulrajani David Lopez-Paz OOD 61 1,129 0 02 Jul 2020
The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization Dan Hendrycks Steven Basart Norman Mu Saurav Kadavath Frank Wang ... Samyak Parajuli Mike Guo D. Song Jacob Steinhardt Justin Gilmer OOD 276 1,715 0 29 Jun 2020
Hybrid Models for Open Set Recognition Hongjie Zhang Ang Li Jie Guo Yanwen Guo BDL 115 185 0 27 Mar 2020
Conditional Gaussian Distribution Learning for Open Set Recognition Xin Sun Zhen Yang Chi Zhang Guohao Peng K. Ling BDL UQCV 176 217 0 19 Mar 2020
Causality matters in medical imaging Daniel Coelho De Castro Ian Walker Ben Glocker CML 36 341 0 17 Dec 2019
Revisiting Fine-tuning for Few-shot Learning Akihiro Nakamura Tatsuya Harada 79 52 0 01 Oct 2019
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt D. Song OODD 188 1,454 0 16 Jul 2019
Learning Robust Global Representations by Penalizing Local Predictive Power Haohan Wang Songwei Ge Eric Xing Zachary Chase Lipton OOD 88 951 0 29 May 2019
Do ImageNet Classifiers Generalize to ImageNet? Benjamin Recht Rebecca Roelofs Ludwig Schmidt Vaishaal Shankar OOD SSeg VLM 93 1,693 0 13 Feb 2019
Recent Advances in Open Set Recognition: A Survey Chuanxing Geng Sheng-Jun Huang Songcan Chen BDL ObjD 100 763 0 21 Nov 2018