Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution

21 February 2022

Papers citing "Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution"

50 / 492 papers shown

Title
Oops, I Sampled it Again: Reinterpreting Confidence Intervals in Few-Shot Learning Raphael Lafargue Luke Smith Franck Vermet Mathias Löwe Ian Reid Vincent Gripon Jack Valmadre 82 0 0 04 Sep 2024
Leveraging Large Language Models for Wireless Symbol Detection via In-Context Learning Momin Abbas Koushik Kar Tianyi Chen 99 6 0 28 Aug 2024
Mitigating Noise Detriment in Differentially Private Federated Learning with Model Pre-training Huitong Jin Yipeng Zhou Laizhong Cui Quan Z. Sheng AI4CE 72 0 0 18 Aug 2024
Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability Jiri Hron Laura J. Culp Gamaleldin F. Elsayed Rosanne Liu Ben Adlam ... T. Warkentin Lechao Xiao Kelvin Xu Jasper Snoek Simon Kornblith 58 1 0 14 Aug 2024
BadMerging: Backdoor Attacks Against Model Merging Jinghuai Zhang Jianfeng Chi Zheng Li Kunlin Cai Yang Zhang Yuan Tian MoMe FedML AAML 112 18 0 14 Aug 2024
Efficient and Versatile Robust Fine-Tuning of Zero-shot Models Sungyeon Kim Boseung Jeong Donghyun Kim Suha Kwak VLM 88 3 0 11 Aug 2024
On the Generalization of Preference Learning with DPO Shawn Im Yixuan Li 75 2 0 06 Aug 2024
AdaCBM: An Adaptive Concept Bottleneck Model for Explainable and Accurate Diagnosis T. Chowdhury Vu Minh Hieu Phan Kewen Liao Minh-Son To Yutong Xie Anton Van Den Hengel Johan Verjans Zhibin Liao 40 2 0 04 Aug 2024
Category-Extensible Out-of-Distribution Detection via Hierarchical Context Descriptions Kai-Chun Liu Zhihang Fu Chao Chen Sheng Jin Ze Chen Mingyuan Tao Rongxin Jiang Jieping Ye VLM OODD 106 5 0 23 Jul 2024
Test-Time Low Rank Adaptation via Confidence Maximization for Zero-Shot Generalization of Vision-Language Models Raza Imam Hanan Gani Muhammad Huzaifa Karthik Nandakumar VLM 76 4 0 22 Jul 2024
Craft: Cross-modal Aligned Features Improve Robustness of Prompt Tuning Jingchen Sun Rohan Sharma Vishnu Suresh Lokhande Changyou Chen 105 0 0 22 Jul 2024
Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalization Jiajun Hu Jian Zhang Lei Qi Yinghuan Shi Yang Gao OOD 74 6 0 21 Jul 2024
FANTAstic SEquences and Where to Find Them: Faithful and Efficient API Call Generation through State-tracked Constrained Decoding and Reranking Zhuoer Wang Leonardo F. R. Ribeiro Alexandros Papangelis Rohan Mukherjee Tzu-Yen Wang Xinyan Zhao Arijit Biswas James Caverlee A. Metallinou 74 0 0 18 Jul 2024
Robust Calibration of Large Vision-Language Adapters Balamurali Murugesan Julio Silva-Rodríguez Ismail Ben Ayed Jose Dolz OODD VLM 97 9 0 18 Jul 2024
A Closer Look at Benchmarking Self-Supervised Pre-training with Image Classification Markus Marks Manuel Knott Neehar Kondapaneni Elijah Cole T. Defraeye Fernando Pérez-Cruz Pietro Perona SSL 125 5 0 16 Jul 2024
Seq-to-Final: A Benchmark for Tuning from Sequential Distributions to a Final Time Point Christina X. Ji Ahmed M. Alaa David Sontag OOD 69 0 0 12 Jul 2024
Real-Time Anomaly Detection and Reactive Planning with Large Language Models Rohan Sinha Amine Elhafsi Christopher Agia Matthew Foutter Edward Schmerling Marco Pavone OffRL LRM 94 32 0 11 Jul 2024
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI Yang Liu Weixing Chen Yongjie Bai Xiaodan Liang Guanbin Li Wen Gao Liang Lin LM&Ro SyDa AI4CE 155 70 0 09 Jul 2024
Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning Yijun Dong Hoang Phan Xiang Pan Qi Lei 155 6 0 08 Jul 2024
Understanding the Role of Invariance in Transfer Learning Till Speicher Vedant Nanda Krishna P. Gummadi SSL OOD 85 1 0 05 Jul 2024
Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Models Yuyan Chen Qiang Fu Ge Fan Lun Du Jian-Guang Lou Shi Han Dongmei Zhang Zhixu Li Yanghua Xiao MoE 79 17 0 04 Jul 2024
Fully Fine-tuned CLIP Models are Efficient Few-Shot Learners Mushui Liu Bozheng Li Yunlong Yu VLM CLIP 43 3 0 04 Jul 2024
SAFT: Towards Out-of-Distribution Generalization in Fine-Tuning Bac Nguyen Stefan Uhlich Fabien Cardinaux Lukas Mauch Marzieh Edraki Aaron Courville OODD CLL VLM 131 5 0 03 Jul 2024
Macroeconomic Forecasting with Large Language Models Andrea Carriero Davide Pettenuzzo Shubhranshu Shekhar 115 5 0 01 Jul 2024
Less Forgetting for Better Generalization: Exploring Continual-learning Fine-tuning Methods for Speech Self-supervised Representations Salah Zaiem Titouan Parcollet S. Essid CLL 95 4 0 30 Jun 2024
Accuracy on the wrong line: On the pitfalls of noisy data for out-of-distribution generalisation Amartya Sanyal Yaxi Hu Yaodong Yu Yian Ma Yixin Wang Bernhard Schölkopf OODD 83 2 0 27 Jun 2024
Learning Modality Knowledge Alignment for Cross-Modality Transfer Wenxuan Ma Shuang Li Lincan Cai Jingxuan Kang 81 2 0 27 Jun 2024
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning Yifan Yang Kai Zhen Ershad Banijamal Athanasios Mouchtaris Zheng Zhang 71 9 0 26 Jun 2024
WARP: On the Benefits of Weight Averaged Rewarded Policies Alexandre Ramé Johan Ferret Nino Vieillard Robert Dadashi Léonard Hussenot Pierre-Louis Cedoz Pier Giuseppe Sessa Sertan Girgin Arthur Douillard Olivier Bachem 134 23 0 24 Jun 2024
Few-Shot Recognition via Stage-Wise Retrieval-Augmented Finetuning Tian Liu Huixin Zhang Shubham Parashar Shu Kong 85 2 0 17 Jun 2024
Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs Rui Yang Ruomeng Ding Yong Lin Huan Zhang Tong Zhang 122 62 0 14 Jun 2024
Comparison of fine-tuning strategies for transfer learning in medical image classification Ana Davila Jacinto Colan Yasuhisa Hasegawa 80 24 0 14 Jun 2024
ProFeAT: Projected Feature Adversarial Training for Self-Supervised Learning of Robust Representations Sravanti Addepalli Priyam Dey R. Venkatesh Babu 88 0 0 09 Jun 2024
Domain Generalization Guided by Large-Scale Pre-Trained Priors Zongbin Wang Bin Pan Shiyu Shen Tianyang Shi Zhenwei Shi AI4CE 123 0 0 09 Jun 2024
Regularized Training with Generated Datasets for Name-Only Transfer of Vision-Language Models Minho Park S. Park Jooyeol Yun Jaegul Choo VLM 80 0 0 08 Jun 2024
DiNeR: a Large Realistic Dataset for Evaluating Compositional Generalization ChenGang Hu Xiao Liu Yansong Feng CoGe 75 1 0 07 Jun 2024
Feature contamination: Neural networks learn uncorrelated features and fail to generalize Tianren Zhang Chujie Zhao Guanyu Chen Yizhou Jiang Feng Chen OOD MLT OODD 181 6 0 05 Jun 2024
Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning Jacob Mitchell Springer Vaishnavh Nagarajan Aditi Raghunathan 120 6 0 30 May 2024
Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective Akiyoshi Tomihari Issei Sato 70 4 0 27 May 2024
Feature Protection For Out-of-distribution Generalization Lu Tan Huei Zhou Yinxiang Huang Zeming Zheng Yujiu Yang OODD 76 0 0 25 May 2024
Quantifying the Gain in Weak-to-Strong Generalization Moses Charikar Chirag Pabbaraju Kirankumar Shiragur ELM 118 23 0 24 May 2024
What Variables Affect Out-Of-Distribution Generalization in Pretrained Models? Md Yousuf Harun Kyungbok Lee Jhair Gallardo Giri Krishnan Christopher Kanan 103 6 0 23 May 2024
A Comprehensive Overview of Large Language Models (LLMs) for Cyber Defences: Opportunities and Directions Mohammed Hassanin Nour Moustafa 83 32 0 23 May 2024
Unified Neural Backdoor Removal with Only Few Clean Samples through Unlearning and Relearning Nay Myat Min Long H. Pham Jun Sun MU AAML 118 0 0 23 May 2024
LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate A. Fuller Daniel G. Kyrollos Yousef Yassin James R. Green 109 3 0 22 May 2024
Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised Learning Kai Gan Tong Wei 83 15 0 20 May 2024
Wearable Sensor-Based Few-Shot Continual Learning on Hand Gestures for Motor-Impaired Individuals via Latent Embedding Exploitation Riyad Bin Rafiq Weishi Shi Mark V. Albert 89 1 0 14 May 2024
MoVL:Exploring Fusion Strategies for the Domain-Adaptive Application of Pretrained Models in Medical Imaging Tasks Haijiang Tian Jingkun Yue Xiaohong Liu Guoxing Yang Zeyu Jiang Guangyu Wang VLM MedIm 104 0 0 13 May 2024
Robust and Explainable Fine-Grained Visual Classification with Transfer Learning: A Dual-Carriageway Framework Zheming Zuo Joseph Smith Jonathan Stonehouse Boguslaw Obara 88 2 0 09 May 2024
Model Inversion Robustness: Can Transfer Learning Help? Sy-Tuyen Ho Koh Jun Hao Keshigeyan Chandrasegaran Ngoc-Bao Nguyen Ngai-Man Cheung 85 11 0 09 May 2024