Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution

21 February 2022

Papers citing "Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution"

50 / 492 papers shown

Title
Adapting to Distribution Shift by Visual Domain Prompt Generation Zhixiang Chi Li Gu Tao Zhong Huan Liu Yuanhao Yu Konstantinos N Plataniotis Yang Wang VLM OOD 96 10 0 05 May 2024
Decoupling Feature Extraction and Classification Layers for Calibrated Neural Networks Mikkel Jordahn Pablo Olmos 99 1 0 02 May 2024
Lazy Layers to Make Fine-Tuned Diffusion Models More Traceable Haozhe Liu Wentian Zhang Bing Li Bernard Ghanem Jürgen Schmidhuber DiffM WIGM AAML 81 1 0 01 May 2024
Transitive Vision-Language Prompt Learning for Domain Generalization Liyuan Wang Yan Jin Zhen Chen Jinlin Wu Mengke Li Yang Lu Hanzi Wang VLM VPVLM LRM 117 0 0 29 Apr 2024
Towards Incremental Learning in Large Language Models: A Critical Review M. Jovanovic Peter Voss ELM CLL KELM 116 5 0 28 Apr 2024
SemEval-2024 Task 9: BRAINTEASER: A Novel Task Defying Common Sense Yifan Jiang Filip Ilievski Kaixin Ma LRM 112 30 0 22 Apr 2024
Incremental Residual Concept Bottleneck Models Chenming Shang Shiji Zhou Hengyuan Zhang Xinzhe Ni Yujiu Yang Yuwang Wang 118 18 0 13 Apr 2024
Understanding Multimodal Deep Neural Networks: A Concept Selection View Chenming Shang Hengyuan Zhang Hao Wen Yujiu Yang 94 5 0 13 Apr 2024
Probing the 3D Awareness of Visual Foundation Models Mohamed El Banani Amit Raj Kevis-Kokitsi Maninis Abhishek Kar Yuanzhen Li Michael Rubinstein Deqing Sun Leonidas Guibas Justin Johnson Varun Jampani 101 86 0 12 Apr 2024
Anchor-based Robust Finetuning of Vision-Language Models Jinwei Han Zhiwen Lin Zhongyi Sun Yingguo Gao Ke Yan Shouhong Ding Yuan Gao Gui-Song Xia VLM 117 6 0 09 Apr 2024
Unified Multi-modal Diagnostic Framework with Reconstruction Pre-training and Heterogeneity-combat Tuning Yupei Zhang Li Pan Qiushi Yang Tan Li Zhen Chen 91 1 0 09 Apr 2024
Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generation R. Ajwani Zining Zhu Jonathan Rose Frank Rudzicz 46 1 0 08 Apr 2024
Test-Time Training for Depression Detection Sri Harsha Dumpala Chandramouli Shama Sastry Rudolf Uher Sageev Oore 103 0 0 07 Apr 2024
Mixture of Low-rank Experts for Transferable AI-Generated Image Detection Zihan Liu Hanyi Wang Yaoyu Kang Shilin Wang MoE 98 13 0 07 Apr 2024
Lipsum-FT: Robust Fine-Tuning of Zero-Shot Models Using Random Text Guidance G. Nam Byeongho Heo Juho Lee VLM 73 7 0 01 Apr 2024
Model Stock: All we need is just a few fine-tuned models Dong-Hwan Jang Sangdoo Yun Dongyoon Han OODD MoMe 103 45 0 28 Mar 2024
CLAP4CLIP: Continual Learning with Probabilistic Finetuning for Vision-Language Models Saurav Jha Dong Gong Lina Yao CLIP VLM 152 11 0 28 Mar 2024
Knowledge-guided Machine Learning: Current Trends and Future Prospects Anuj Karpatne X. Jia Vipin Kumar 103 12 0 24 Mar 2024
Towards Low-Energy Adaptive Personalization for Resource-Constrained Devices Yushan Huang Josh Millar Yuxuan Long Yuchen Zhao Hamed Haddadi 103 0 0 23 Mar 2024
FairerCLIP: Debiasing CLIP's Zero-Shot Predictions using Functions in RKHSs Sepehr Dehdashtian Lan Wang Vishnu Boddeti VLM 89 15 0 22 Mar 2024
FissionFusion: Fast Geometric Generation and Hierarchical Souping for Medical Image Analysis Santosh Sanjeev Nuren Zhaksylyk Ibrahim Almakky Anees Ur Rehman Hashmi Mohammad Areeb Qazi Mohammad Yaqub 133 3 0 20 Mar 2024
S-JEPA: towards seamless cross-dataset transfer through dynamic spatial attention Pierre Guetschel Thomas Moreau Michael Tangermann 68 9 0 18 Mar 2024
MedMerge: Merging Models for Effective Transfer Learning to Medical Imaging Tasks Ibrahim Almakky Santosh Sanjeev Anees Ur Rehman Hashmi Mohammad Areeb Qazi Mohammad Yaqub Mohammad Yaqub FedML MoMe 149 4 0 18 Mar 2024
Securely Fine-tuning Pre-trained Encoders Against Adversarial Examples Ziqi Zhou Minghui Li Wei Liu Shengshan Hu Yechao Zhang Wei Wan Lulu Xue Leo Yu Zhang Dezhong Yao Hai Jin SILM AAML 114 11 0 16 Mar 2024
Model Reprogramming Outperforms Fine-tuning on Out-of-distribution Data in Text-Image Encoders Andrew Geng Pin-Yu Chen OODD 85 1 0 16 Mar 2024
Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models Yu-Chu Yu Chi-Pin Huang Jr-Jen Chen Kai-Po Chang Yung-Hsuan Lai Fu-En Yang Yu-Chiang Frank Wang CLL VLM 97 9 0 14 Mar 2024
Bridging Domains with Approximately Shared Features Ziliang Samuel Zhong Xiang Pan Qi Lei OOD 98 2 0 11 Mar 2024
Towards In-Vehicle Multi-Task Facial Attribute Recognition: Investigating Synthetic Data and Vision Foundation Models Esmaeil Seraj Walter Talamonti 49 0 0 10 Mar 2024
Tell, Don't Show!: Language Guidance Eases Transfer Across Domains in Images and Videos Tarun Kalluri Bodhisattwa Prasad Majumder Manmohan Chandraker VLM 80 5 0 08 Mar 2024
AFreeCA: Annotation-Free Counting for All Adrian dÁlessandro Ali Mahdavi-Amiri Ghassan Hamarneh DiffM 80 4 0 07 Mar 2024
Applied Causal Inference Powered by ML and AI Victor Chernozhukov Christian Hansen Nathan Kallus Martin Spindler Vasilis Syrgkanis CML 84 32 0 04 Mar 2024
A Survey on Evaluation of Out-of-Distribution Generalization Han Yu Jiashuo Liu Xingxuan Zhang Jiayun Wu Peng Cui OOD 101 9 0 04 Mar 2024
One Prompt Word is Enough to Boost Adversarial Robustness for Pre-trained Vision-Language Models Lin Li Haoyan Guan Jianing Qiu Michael W. Spratling AAML VLM VPVLM 99 24 0 04 Mar 2024
Feature Alignment: Rethinking Efficient Active Learning via Proxy in the Context of Pre-trained Models Ziting Wen Oscar Pizarro Stefan B. Williams 62 0 0 02 Mar 2024
Fine-tuning with Very Large Dropout Jianyu Zhang Léon Bottou 134 2 0 01 Mar 2024
Ask Your Distribution Shift if Pre-Training is Right for You Benjamin Cohen-Wang Joshua Vendrow Aleksander Madry OOD 94 3 0 29 Feb 2024
Effective Two-Stage Knowledge Transfer for Multi-Entity Cross-Domain Recommendation Jianyu Guan Zongming Yin Tianyi Zhang Leihui Chen Yin Zhang Fei Huang Jufeng Chen Shuguang Han 56 1 0 29 Feb 2024
On the Convergence of Differentially-Private Fine-tuning: To Linearly Probe or to Fully Fine-tune? Shuqi Ke Charlie Hou Giulia Fanti Sewoong Oh 81 4 0 29 Feb 2024
Asymmetry in Low-Rank Adapters of Foundation Models Jiacheng Zhu Kristjan Greenewald Kimia Nadjahi Haitz Sáez de Ocáriz Borde Rickard Brüel-Gabrielsson Leshem Choshen Marzyeh Ghassemi Mikhail Yurochkin Justin Solomon 116 39 0 26 Feb 2024
StochCA: A Novel Approach for Exploiting Pretrained Models with Cross-Attention SeungWon Seo Suho Lee Sangheum Hwang 78 0 0 25 Feb 2024
Fine-Grained Detoxification via Instance-Level Prefixes for Large Language Models Xin Yi Linlin Wang Xiaoling Wang Liang He MoMe 83 1 0 23 Feb 2024
Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking Nikhil Prakash Tamar Rott Shaham Tal Haklay Yonatan Belinkov David Bau 99 67 0 22 Feb 2024
Embedding Compression for Teacher-to-Student Knowledge Transfer Yiwei Ding Alexander Lerch 48 1 0 09 Feb 2024
LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views Yuji Roh Qingyun Liu Huan Gui Zhe Yuan Yujin Tang ... Liang Liu Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao 138 2 0 07 Feb 2024
Enhancing Compositional Generalization via Compositional Feature Alignment Haoxiang Wang Haozhe Si Huajie Shao Han Zhao 115 2 0 05 Feb 2024
Cross-modality debiasing: using language to mitigate sub-population shifts in imaging Yijiang Pang Hoang Bao Jiayu Zhou 93 0 0 02 Feb 2024
How Useful is Continued Pre-Training for Generative Unsupervised Domain Adaptation? Rheeya Uppaal Yixuan Li Junjie Hu 146 6 0 31 Jan 2024
Exploring the Transferability of a Foundation Model for Fundus Images: Application to Hypertensive Retinopathy Julio Silva-Rodríguez Jihed Chelbi Waziha Kabir H. Chakor Jose Dolz Ismail Ben Ayed Riadh Kobbi MedIm 129 1 0 27 Jan 2024
BayesPrompt: Prompting Large-Scale Pre-Trained Language Models on Few-shot Inference via Debiased Domain Abstraction Jiangmeng Li Fei Song Yifan Jin Jingyao Wang Changwen Zheng Gang Hua Hui Xiong VLM 126 4 0 25 Jan 2024
LanDA: Language-Guided Multi-Source Domain Adaptation Zhenbin Wang Lei Zhang Lituan Wang Minjuan Zhu 87 10 0 25 Jan 2024