Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution

21 February 2022

Papers citing "Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution"

50 / 492 papers shown

Title
The Risk of Federated Learning to Skew Fine-Tuning Features and Underperform Out-of-Distribution Robustness Mengyao Du Miao Zhang Yuwen Pu Kai Xu Shouling Ji Quanjun Yin 86 1 0 25 Jan 2024
Enhancing In-context Learning via Linear Probe Calibration Momin Abbas Yi Zhou Parikshit Ram Nathalie Baracaldo Horst Samulowitz Theodoros Salonidis Tianyi Chen 114 14 0 22 Jan 2024
WARM: On the Benefits of Weight Averaged Reward Models Alexandre Ramé Nino Vieillard Léonard Hussenot Robert Dadashi Geoffrey Cideron Olivier Bachem Johan Ferret 179 104 0 22 Jan 2024
Stability Plasticity Decoupled Fine-tuning For Few-shot end-to-end Object Detection Yuantao Yin Ping Yin 65 0 0 20 Jan 2024
Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads Tianle Cai Yuhong Li Zhengyang Geng Hongwu Peng Jason D. Lee De-huai Chen Tri Dao 189 314 0 19 Jan 2024
AutoFT: Learning an Objective for Robust Fine-Tuning Caroline Choi Yoonho Lee Annie S. Chen Allan Zhou Aditi Raghunathan Chelsea Finn OOD 111 0 0 18 Jan 2024
HCVP: Leveraging Hierarchical Contrastive Visual Prompt for Domain Generalization Guanglin Zhou Zhongyi Han Shiming Chen Erdun Gao Liming Zhu Tongliang Liu Lina Yao Kun Zhang 96 3 0 18 Jan 2024
Signed-Prompt: A New Approach to Prevent Prompt Injection Attacks Against LLM-Integrated Applications Xuchen Suo AAML SILM 98 32 0 15 Jan 2024
Connect Later: Improving Fine-tuning for Robustness with Targeted Augmentations Helen Qu Sang Michael Xie 89 5 0 08 Jan 2024
Preserving Silent Features for Domain Generalization Chujie Zhao Tianren Zhang Feng Chen 95 0 0 06 Jan 2024
Incorporating Geo-Diverse Knowledge into Prompting for Increased Geographical Robustness in Object Recognition Kyle Buettner Sina Malakouti Xiang Lorraine Li Adriana Kovashka 128 3 0 03 Jan 2024
Self-supervised learning for skin cancer diagnosis with limited training data Hamish Haggerty Rohitash Chandra 57 4 0 01 Jan 2024
Mixture Data for Training Cannot Ensure Out-of-distribution Generalization Songming Zhang Yuxiao Luo Qizhou Wang Haoang Chi Xiaofeng Chen Bo Han Jinyan Li OODD 95 0 0 25 Dec 2023
On the Benefits of Public Representations for Private Transfer Learning under Distribution Shift Pratiksha Thaker Amrith Rajagopal Setlur Zhiwei Steven Wu Virginia Smith 91 2 0 24 Dec 2023
PERP: Rethinking the Prune-Retrain Paradigm in the Era of LLMs Max Zimmer Megi Andoni Christoph Spiegel Sebastian Pokutta VLM 177 10 0 23 Dec 2023
Meta Transfer of Self-Supervised Knowledge: Foundation Model in Action for Post-Traumatic Epilepsy Prediction Wenhui Cui H. Akrami Ganning Zhao Anand A. Joshi Richard M. Leahy 24 4 0 21 Dec 2023
A Closer Look at the Few-Shot Adaptation of Large Vision-Language Models Julio Silva-Rodríguez Sina Hajimiri Ismail Ben Ayed Jose Dolz VLM 71 34 0 20 Dec 2023
ProS: Prompting-to-simulate Generalized knowledge for Universal Cross-Domain Retrieval Kaipeng Fang Jingkuan Song Lianli Gao Pengpeng Zeng Zhi-Qi Cheng Xiyao Li Hengtao Shen VLM 69 11 0 19 Dec 2023
LaViP:Language-Grounded Visual Prompts Nilakshan Kunananthaseelan Jing Zhang Mehrtash Harandi VLM 67 0 0 18 Dec 2023
Gradient-based Parameter Selection for Efficient Fine-Tuning Zhi Zhang Qizhe Zhang Zijun Gao Renrui Zhang Ekaterina Shutova Shiji Zhou Shanghang Zhang 123 21 0 15 Dec 2023
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision Collin Burns Pavel Izmailov Jan Hendrik Kirchner Bowen Baker Leo Gao ... Adrien Ecoffet Manas Joglekar Jan Leike Ilya Sutskever Jeff Wu ELM 131 297 0 14 Dec 2023
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis Yafei Hu Quanting Xie Vidhi Jain Jonathan M Francis Jay Patrikar ... Xiaolong Wang Sebastian A. Scherer Z. Kira Fei Xia Yonatan Bisk LM&Ro AI4CE 129 74 0 14 Dec 2023
Initialization Matters for Adversarial Transfer Learning Andong Hua Jindong Gu Zhiyu Xue Nicholas Carlini Eric Wong Yao Qin AAML 85 8 0 10 Dec 2023
Open Domain Generalization with a Single Network by Regularization Exploiting Pre-trained Features Inseop Chung Kiyoon Yoo Nojun Kwak VLM 97 0 0 08 Dec 2023
Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentation Zhixiang Wei Lin Chen Yi Jin Xiaoxiao Ma Tianle Liu Pengyang Lin Ben Wang H. Chen Jinjin Zheng 101 48 0 07 Dec 2023
RoAST: Robustifying Language Models via Adversarial Perturbation with Selective Training Jaehyung Kim Yuning Mao Rui Hou Hanchao Yu Davis Liang Pascale Fung Qifan Wang Fuli Feng Lifu Huang Madian Khabsa AAML 60 4 0 07 Dec 2023
Complementary Benefits of Contrastive Learning and Self-Training Under Distribution Shift Saurabh Garg Amrith Rajagopal Setlur Zachary Chase Lipton Sivaraman Balakrishnan Virginia Smith Aditi Raghunathan SSL 74 9 0 06 Dec 2023
Effectively Fine-tune to Improve Large Multimodal Models for Radiology Report Generation Yuzhe Lu Sungmin Hong Yash Shah Panpan Xu LM&MA MedIm 64 7 0 03 Dec 2023
An Empirical Study of Automated Mislabel Detection in Real World Vision Datasets Maya Srikanth Jeremy Irvin Brian Wesley Hill Felipe Godoy Ishan Sabane Andrew Y. Ng 98 2 0 02 Dec 2023
Rethinking the Domain Gap in Near-infrared Face Recognition Michail Tarasiou Jiankang Deng Stefanos Zafeiriou 70 1 0 01 Dec 2023
Spacewalk-18: A Benchmark for Multimodal and Long-form Procedural Video Understanding in Novel Domains Rohan Myer Krishnan Zitian Tang Zhiqiu Yu Chen Sun 152 2 0 30 Nov 2023
A Simple Recipe for Language-guided Domain Generalized Segmentation Mohammad Fahes Tuan-Hung Vu Andrei Bursuc Patrick Pérez Raoul de Charette VLM 91 14 0 29 Nov 2023
RankFeat&RankWeight: Rank-1 Feature/Weight Removal for Out-of-distribution Detection Yue Song N. Sebe Wei Wang OODD 81 2 0 23 Nov 2023
A Multi-Center Study on the Adaptability of a Shared Foundation Model for Electronic Health Records L. Guo Jason Alan Fries E. Steinberg Scott L. Fleming Keith Morse Catherine Aftandilian J. Posada Nigam Shah L. Sung OOD 107 21 0 20 Nov 2023
Large Pre-trained time series models for cross-domain Time series analysis tasks Harshavardhan Kamarthi B. A. Prakash VLM AI4TS 117 12 0 19 Nov 2023
Towards Robust and Accurate Visual Prompting Qi Li Liangzhi Li Zhouqiang Jiang Bowen Wang VPVLM VLM 64 3 0 18 Nov 2023
Language Semantic Graph Guided Data-Efficient Learning Wenxuan Ma Shuang Li Lincan Cai Jingxuan Kang 98 4 0 15 Nov 2023
PEMS: Pre-trained Epidemic Time-series Models Harshavardhan Kamarthi B. A. Prakash AI4TS 102 2 0 14 Nov 2023
The Fairness Stitch: Unveiling the Potential of Model Stitching in Neural Network De-Biasing Modar Sulaiman Kallol Roy 65 0 0 06 Nov 2023
Robust Fine-Tuning of Vision-Language Models for Domain Generalization Kevin Vogt-Lowell Noah Lee Theodoros Tsiligkaridis Marc Vaillant VLM 79 4 0 03 Nov 2023
Towards Calibrated Robust Fine-Tuning of Vision-Language Models Changdae Oh Hyesu Lim Mijoo Kim Dongyoon Han Junhyeok Park Euiseog Jeong Alexander G. Hauptmann Zhi-Qi Cheng Kyungwoo Song VLM 108 18 0 03 Nov 2023
Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization Jameel Hassan Hanan Gani Noor Hussein Muhammad Uzair Khattak Muzammal Naseer Fahad Shahbaz Khan Salman Khan VLM OOD 131 68 0 02 Nov 2023
Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data Cheng-Hao Tu Hong-You Chen Zheda Mai Shitian Zhao Vardaan Pahuja Tanya Berger-Wolf Song Gao Charles V. Stewart Yu-Chuan Su Wei-Lun Chao CLL 84 6 0 02 Nov 2023
Better with Less: A Data-Active Perspective on Pre-Training Graph Neural Networks Jiarong Xu Renhong Huang Xin Jiang Yuxuan Cao Carl Yang Chunping Wang Yang Yang AI4CE 119 15 0 02 Nov 2023
Invariant-Feature Subspace Recovery: A New Class of Provable Domain Generalization Algorithms Haoxiang Wang Gargi Balasubramaniam Haozhe Si Bo Li Han Zhao OOD 79 2 0 02 Nov 2023
Fast Trainable Projection for Robust Fine-Tuning Junjiao Tian Yen-Cheng Liu James Seale Smith Z. Kira OOD 93 14 0 29 Oct 2023
Unlocking the Potential of Prompt-Tuning in Bridging Generalized and Personalized Federated Learning Wenlong Deng Christos Thrampoulidis Xiaoxiao Li 132 12 0 27 Oct 2023
PockEngine: Sparse and Efficient Fine-tuning in a Pocket Ligeng Zhu Lanxiang Hu Ji Lin Wei-Chen Wang Wei-Ming Chen Chuang Gan Song Han 49 22 0 26 Oct 2023
Fine tuning Pre trained Models for Robustness Under Noisy Labels Sumyeong Ahn Sihyeon Kim Jongwoo Ko SeYoung Yun AAML NoLa 121 8 0 24 Oct 2023
SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understanding Haoxiang Wang Pavan Kumar Anasosalu Vasu Fartash Faghri Raviteja Vemulapalli Mehrdad Farajtabar Sachin Mehta Mohammad Rastegari Oncel Tuzel Hadi Pouransari VLM 128 72 0 23 Oct 2023