Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution

21 February 2022

Papers citing "Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution"

50 / 492 papers shown

Title
FOCoOp: Enhancing Out-of-Distribution Robustness in Federated Prompt Learning for Vision-Language Models Xinting Liao Weiming Liu Jiaming Qian Pengyang Zhou Jiahe Xu Wenjie Wang Chaochao Chen Xiaolin Zheng Tat-Seng Chua FedML OODD VLM 37 0 0 19 Jun 2025
Multi-Scale Finetuning for Encoder-based Time Series Foundation Models Zhongzheng Qiao Chenghao Liu Y. Zhang Ming Jin Quang Pham Qingsong Wen P.N. Suganthan Xudong Jiang Savitha Ramasamy AI4TS AI4CE 20 0 0 17 Jun 2025
LARGO: Low-Rank Regulated Gradient Projection for Robust Parameter Efficient Fine-Tuning Haotian Zhang Liu Liu Baosheng Yu Jiayan Qiu Yanwei Ren Xianglong Liu 21 0 0 14 Jun 2025
Curriculum-Guided Layer Scaling for Language Model Pretraining Karanpartap Singh Neil Band Ehsan Adeli ALM LRM 30 0 0 13 Jun 2025
Beyond Overconfidence: Foundation Models Redefine Calibration in Deep Neural Networks Achim Hekler Lukas Kuhn Florian Buettner UQCV 77 0 0 11 Jun 2025
Merging Smarter, Generalizing Better: Enhancing Model Merging on OOD Data Bingjie Zhang Hongkang Li Changlong Shi Guowei Rong He Zhao Dongsheng Wang Dandan Guo Meng Wang MoMe 56 0 0 10 Jun 2025
Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directions Kun Zhang Le Wu Kui Yu Guangyi Lv Dacao Zhang AAML ELM 26 0 0 08 Jun 2025
Exploring Visual Prompting: Robustness Inheritance and Beyond Qi Li Liangzhi Li Zhouqiang Jiang Bowen Wang Keke Tang VPVLM VLM 25 0 0 07 Jun 2025
CAtCh: Cognitive Assessment through Cookie Thief Joseph T Colonel Carolyn Hagler Guiselle Wismer Laura Curtis Jacqueline Becker Juan Wisnivesky Alex Federman Gaurav Pandey 18 0 0 07 Jun 2025
Robust Few-Shot Vision-Language Model Adaptation Hanxin Wang Tian Liu Shu Kong VLM 121 0 0 05 Jun 2025
AetherVision-Bench: An Open-Vocabulary RGB-Infrared Benchmark for Multi-Angle Segmentation across Aerial and Ground Perspectives Aniruddh Sikdar Aditya Gandhamal Suresh Sundaram VLM 53 0 0 04 Jun 2025
OV-COAST: Cost Aggregation with Optimal Transport for Open-Vocabulary Semantic Segmentation Aditya Gandhamal Aniruddh Sikdar Suresh Sundaram OT 84 0 0 04 Jun 2025
Understanding Overadaptation in Supervised Fine-Tuning: The Role of Ensemble Methods Yifan Hao Xingyuan Pan Hanning Zhang Chenlu Ye Boyao Wang Tong Zhang 90 0 0 02 Jun 2025
MoCA: Multi-modal Cross-masked Autoencoder for Digital Health Measurements Howon Ryu Y. Chen Yacun Wang Andrea Z. LaCroix Chongzhi Di L. Natarajan Yu Wang Jingjing Zou 26 0 0 02 Jun 2025
Proxy-FDA: Proxy-based Feature Distribution Alignment for Fine-tuning Vision Foundation Models without Forgetting Chen Huang Skyler Seto Hadi Pouransari Mehrdad Farajtabar Raviteja Vemulapalli Fartash Faghri Oncel Tuzel B. Theobald Josh Susskind CLL 48 0 0 30 May 2025
Minifinetuning: Low-Data Generation Domain Adaptation through Corrective Self-Distillation Peter Belcak Greg Heinrich Jan Kautz Pavlo Molchanov ALM 25 0 0 30 May 2025
FRAMES-VQA: Benchmarking Fine-Tuning Robustness across Multi-Modal Shifts in Visual Question Answering Chengyue Huang Brisa Maneechotesuwan Shivang Chopra Z. Kira AAML 50 0 0 27 May 2025
Asymmetric Duos: Sidekicks Improve Uncertainty Tim G. Zhou Evan Shelhamer Geoff Pleiss UQCV 56 0 0 24 May 2025
TNG-CLIP:Training-Time Negation Data Generation for Negation Awareness of CLIP Yuliang Cai Jesse Thomason Mohammad Rostami VLM 27 0 0 24 May 2025
ReqBrain: Task-Specific Instruction Tuning of LLMs for AI-Assisted Requirements Generation Mohammad Kasra Habib Daniel Graziotin Stefan Wagner 194 0 0 23 May 2025
Self-Boost via Optimal Retraining: An Analysis via Approximate Message Passing Adel Javanmard Rudrajit Das Alessandro Epasto Vahab Mirrokni 107 0 0 21 May 2025
StarFT: Robust Fine-tuning of Zero-shot Models via Spuriosity Alignment Younghyun Kim Jongheon Jeong Sangkyung Kwak Kyungmin Lee Juho Lee Jinwoo Shin 63 0 0 19 May 2025
Improving Out-of-Domain Robustness with Targeted Augmentation in Frequency and Pixel Spaces Ruoqi Wang Haitao Wang Shaojie Guo Qiong Luo OOD 79 0 0 18 May 2025
Improving Fairness in LLMs Through Testing-Time Adversaries Isabela Pereira Gregio Ian Pons Anna Helena Reali Costa Artur Jordao AAML 93 0 0 17 May 2025
Training Strategies for Efficient Embodied Reasoning William Chen Suneel Belkhale Suvir Mirchandani Oier Mees Danny Driess Karl Pertsch Sergey Levine OffRL LRM 95 0 0 13 May 2025
Heterogeneous Data Game: Characterizing the Model Competition Across Multiple Data Sources Renzhe Xu Kun Wang Bo Li 69 0 0 12 May 2025
Safety Pretraining: Toward the Next Generation of Safe AI Pratyush Maini Sachin Goyal Dylan Sam Alex Robey Yash Savani Yiding Jiang Andy Zou Zacharcy C. Lipton J. Zico Kolter 218 5 0 23 Apr 2025
Locate 3D: Real-World Object Localization via Self-Supervised Learning in 3D Sergio Arnaud Paul Mcvay Ada Martin Arjun Majumdar Krishna Murthy Jatavallabhula ... Nicolas Ballas Mido Assran Oleksandr Maksymets Aravind Rajeswaran Franziska Meier 3DPC 81 2 0 19 Apr 2025
LIFT+: Lightweight Fine-Tuning for Long-Tail Learning Jiang-Xin Shi Tong Wei Yu-Feng Li 57 0 0 17 Apr 2025
PCM-SAR: Physics-Driven Contrastive Mutual Learning for SAR Classification Pengfei Wang Hao Zheng Zhigang Hu Aikun Xu Meiguang Zheng Liu Yang 44 0 0 13 Apr 2025
Bayesian Cross-Modal Alignment Learning for Few-Shot Out-of-Distribution Generalization Lin Zhu Yifeng Yang Zichao Nie Yuan Gao VLM 89 0 0 13 Apr 2025
Query-based Knowledge Transfer for Heterogeneous Learning Environments Norah Alballa Wenxuan Zhang Ziquan Liu A. Abdelmoniem Mohamed Elhoseiny Marco Canini 192 0 0 12 Apr 2025
Overcoming Vocabulary Constraints with Pixel-level Fallback Jonas F. Lotz Hendra Setiawan Stephan Peitz Yova Kementchedjhieva 98 1 0 02 Apr 2025
Domain Guidance: A Simple Transfer Approach for a Pre-trained Diffusion Model Jincheng Zhong Xiangcheng Zhang Jianmin Wang Mingsheng Long 84 1 0 02 Apr 2025
Fair Sufficient Representation Learning Xueyu Zhou Chun Yin IP Jian Huang FaML 72 0 0 29 Mar 2025
IAP: Improving Continual Learning of Vision-Language Models via Instance-Aware Prompting Hao Fu Hanbin Zhao Jiahua Dong Chao Zhang Chao Zhang Hui Qian CLL VLM 139 2 0 26 Mar 2025
Efficient Continual Adaptation of Pretrained Robotic Policy with Online Meta-Learned Adapters Ruiqi Zhu Endong Sun Guanhe Huang Oya Celiktutan CLL OnRL 135 0 0 24 Mar 2025
Not Only Text: Exploring Compositionality of Visual Representations in Vision-Language Models Davide Berasi Matteo Farina Massimiliano Mancini Elisa Ricci Nicola Strisciuglio CoGe 109 0 0 21 Mar 2025
Unified Enhancement of the Generalization and Robustness of Language Models via Bi-Stage Optimization Yizhou Sun Juan Yin Juan Zhao Fan Zhang Yongheng Liu Hongji Chen 62 0 0 19 Mar 2025
On the Robustness Tradeoff in Fine-Tuning Kunyang Li Jean-Charles Noirot Ferrand Ryan Sheatsley Blaine Hoak Yohan Beugin Eric Pauley Patrick McDaniel 91 0 0 19 Mar 2025
Keeping Representation Similarity in Finetuning for Medical Image Analysis Wenqiang Zu Shenghao Xie Hao Chen Yiming Liang Lei Ma MedIm OOD 139 0 0 10 Mar 2025
Statistical Deficiency for Task Inclusion Estimation Loïc Fosse Frédéric Béchet Benoit Favre Géraldine Damnati Gwénolé Lecorvé Maxime Darrin Philippe Formont Pablo Piantanida 528 0 0 07 Mar 2025
Efficient Algorithms for Verifying Kruskal Rank in Sparse Linear Regression and Related Applications Fengqin Zhou 121 6 0 06 Mar 2025
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model Wenke Huang Jian Liang Xianda Guo Yiyang Fang Guancheng Wan ... Bin Yang He Li Jiawei Shao Mang Ye Di Lin OffRL LRM MLLM KELM VLM 161 4 0 06 Mar 2025
Generalizable Prompt Learning of CLIP: A Brief Overview Fangming Cui Yonggang Zhang Xuan Wang Xule Wang Liang Xiao VPVLM VLM 522 1 0 03 Mar 2025
A Guide to Failure in Machine Learning: Reliability and Robustness from Foundations to Practice Eric Heim Oren Wright David Shriver OOD FaML 130 0 0 01 Mar 2025
Mixtraining: A Better Trade-Off Between Compute and Performance Zexin Li Jiancheng Zhang Yufei Li Yinglun Zhu Cong Liu 71 0 0 26 Feb 2025
Feature Space Perturbation: A Panacea to Enhanced Transferability Estimation Prafful Kumar Khoba Zijian Wang Chetan Arora Mahsa Baktashmotlagh AAML 133 0 0 23 Feb 2025
Directional Gradient Projection for Robust Fine-Tuning of Foundation Models Chengyue Huang Junjiao Tian Brisa Maneechotesuwan Shivang Chopra Z. Kira 175 2 0 21 Feb 2025
NExT-Mol: 3D Diffusion Meets 1D Language Modeling for 3D Molecule Generation Zhiyuan Liu Yanchen Luo Han Huang Enzhi Zhang Changhao Nai Sihang Li Yaorui Shi Xiang Wang Kenji Kawaguchi Tat-Seng Chua 198 4 0 18 Feb 2025