Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution

21 February 2022

Papers citing "Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution"

50 / 492 papers shown

Title
Substance or Style: What Does Your Image Embedding Know? Cyrus Rashtchian Charles Herrmann Chun-Sung Ferng Ayan Chakrabarti Dilip Krishnan Deqing Sun Da-Cheng Juan Andrew Tomkins 57 6 0 10 Jul 2023
Advances and Challenges in Meta-Learning: A Technical Review Anna Vettoruzzo Mohamed-Rafik Bouguelia Joaquin Vanschoren Thorsteinn Rögnvaldsson K. Santosh OffRL 96 78 0 10 Jul 2023
Text Descriptions are Compressive and Invariant Representations for Visual Learning Zhili Feng Anna Bair J. Zico Kolter VLM 48 6 0 10 Jul 2023
T-MARS: Improving Visual Representations by Circumventing Text Feature Learning Pratyush Maini Sachin Goyal Zachary Chase Lipton J. Zico Kolter Aditi Raghunathan VLM 83 35 0 06 Jul 2023
Becoming self-instruct: introducing early stopping criteria for minimal instruct tuning Waseem Alshikh Manhal Daaboul K. Goddard Brock Imel Kiran Kamble Parikshit Kulkarni M. Russak ALM 13 13 0 05 Jul 2023
Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias Yue Yu Yuchen Zhuang Jieyu Zhang Yu Meng Alexander Ratner Ranjay Krishna Jiaming Shen Chao Zhang ALM 108 236 0 28 Jun 2023
Differentially Private Video Activity Recognition Zelun Luo Yuliang Zou Yijin Yang Zane Durante De-An Huang Zhiding Yu Chaowei Xiao L. Fei-Fei Anima Anandkumar PICV 85 5 0 27 Jun 2023
A Collaborative Transfer Learning Framework for Cross-domain Recommendation Wei Emma Zhang Peng Zhang Bo Zhang Xingxing Wang Dong Wang 60 18 0 26 Jun 2023
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn OOD 101 5 0 19 Jun 2023
Neural Priming for Sample-Efficient Adaptation Matthew Wallingford Vivek Ramanujan Alex Fang Aditya Kusupati Roozbeh Mottaghi Aniruddha Kembhavi Ludwig Schmidt Ali Farhadi VLM 189 15 0 16 Jun 2023
Drag-guided diffusion models for vehicle image generation Nikos Arechiga Frank Permenter Binyang Song Chenyang Yuan DiffM 82 12 0 16 Jun 2023
Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms Nari Johnson Ángel Alexander Cabrera Gregory Plumb Ameet Talwalkar 75 13 0 13 Jun 2023
TART: A plug-and-play Transformer module for task-agnostic reasoning Kush S. Bhatia A. Narayan Chris De Sa Christopher Ré LRM ReLM VLM 63 15 0 13 Jun 2023
On the Effectiveness of Out-of-Distribution Data in Self-Supervised Long-Tail Learning Jianhong Bai Zuozhu Liu Hualiang Wang Jinxiang Hao Yang Feng Huanpeng Chu Haoji Hu OODD 94 18 0 08 Jun 2023
Differentially Private Image Classification by Learning Priors from Random Processes Xinyu Tang Ashwinee Panda Vikash Sehwag Prateek Mittal 89 21 0 08 Jun 2023
Guiding The Last Layer in Federated Learning with Pre-Trained Models G. Legate Nicolas Bernier Lucas Caccia Edouard Oyallon Eugene Belilovsky FedML 56 10 0 06 Jun 2023
LRVS-Fashion: Extending Visual Search with Referring Instructions Simon Lepage Jérémie Mary David Picard 87 1 0 05 Jun 2023
Improved Active Multi-Task Representation Learning via Lasso Yiping Wang Yifang Chen Kevin Jamieson S. Du 92 11 0 05 Jun 2023
LIV: Language-Image Representations and Rewards for Robotic Control Yecheng Jason Ma William Liang Vaidehi Som Vikash Kumar Amy Zhang Osbert Bastani Dinesh Jayaraman LM&Ro 94 130 0 01 Jun 2023
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection Rui Shao Tianxing Wu Liqiang Nie Ziwei Liu 78 14 0 01 Jun 2023
Identifying visible tissue in intraoperative ultrasound: a method and application Alistair Weld L. Dixon Giulio Anichini Michael Dyck Alex Ranne Sophie Camp Stamatia Giannarou 36 2 0 01 Jun 2023
Prompt-Based Tuning of Transformer Models for Multi-Center Medical Image Segmentation of Head and Neck Cancer Numan Saeed Muhammad Ridzuan Roba Al Majzoub Mohammad Yaqub VLM MedIm 72 3 0 30 May 2023
Global Layers: Non-IID Tabular Federated Learning Yazan Obeidi FedML 99 0 0 29 May 2023
FoPro-KD: Fourier Prompted Effective Knowledge Distillation for Long-Tailed Medical Image Recognition Marawan Elbatel Robert Martí Xuelong Li AAML 116 11 0 27 May 2023
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 160 205 0 27 May 2023
Rethinking the Evaluation Protocol of Domain Generalization Han Yu Xingxuan Zhang Renzhe Xu Jiashuo Liu Yue He Peng Cui OOD 101 8 0 24 May 2023
Non-adversarial Robustness of Deep Learning Methods for Computer Vision Gorana Gojić V. Vincan O. Kundacina D. Mišković Dinu Dragan OOD 52 4 0 24 May 2023
Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings Yihao Xue Ali Payani Yu Yang Baharan Mirzasoleiman VLM 107 4 0 23 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 129 3 0 23 May 2023
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality Harman Singh Pengchuan Zhang Qifan Wang Mengjiao MJ Wang Wenhan Xiong Jingfei Du Yu Chen CoGe VLM 91 26 0 23 May 2023
Revisiting pre-trained remote sensing model benchmarks: resizing and normalization matters Isaac Corley Caleb Robinson Rahul Dodhia J. L. Ferres Peyman Najafirad 122 19 0 22 May 2023
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection Rheeya Uppaal Junjie Hu Yixuan Li OODD 207 36 0 22 May 2023
Cross-functional Analysis of Generalisation in Behavioural Learning Pedro Henrique Luz de Araujo Benjamin Roth 61 4 0 22 May 2023
Interactive Data Synthesis for Systematic Vision Adaptation via LLMs-AIGCs Collaboration Qifan Yu Juncheng Li Wentao Ye Siliang Tang Yueting Zhuang 70 14 0 22 May 2023
SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization Yingchun Wang Jingcai Guo Yi Liu Song Guo Weizhan Zhang Xiangyong Cao Qinghua Zheng AAML OODD 106 11 0 19 May 2023
Differentially Private Adapters for Parameter Efficient Acoustic Modeling Chun-Wei Ho Chao-Han Huck Yang Sabato Marco Siniscalchi 100 1 0 19 May 2023
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation Lijie Yang Chao-Han Huck Yang Jen-Tzung Chien 91 11 0 18 May 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 92 6 0 14 May 2023
How to Train Your CheXDragon: Training Chest X-Ray Models for Transfer to Novel Tasks and Healthcare Systems Cara Van Uden Jeremy Irvin Mars Huang N. Dean J. Carr A. Ng C. Langlotz OOD 54 1 0 13 May 2023
Consistency Regularization for Domain Generalization with Logit Attribution Matching Han Gao Kaican Li Weiyan Xie Zhi Lin Yongxiang Huang Luning Wang Caleb Chen Cao N. Zhang 73 2 0 13 May 2023
Visual Tuning Bruce X. B. Yu Jianlong Chang Haixin Wang Lin Liu Shijie Wang ... Lingxi Xie Haojie Li Zhouchen Lin Qi Tian Chang Wen Chen VLM 171 41 0 10 May 2023
Few-shot In-context Learning for Knowledge Base Question Answering Tianle Li Xueguang Ma Alex Zhuang Yu Gu Yu-Chuan Su Wenhu Chen 182 84 0 02 May 2023
VPGTrans: Transfer Visual Prompt Generator across LLMs Ao Zhang Hao Fei Yuan Yao Wei Ji Li Li Zhiyuan Liu Tat-Seng Chua MLLM VLM 84 89 0 02 May 2023
Enhancing Adversarial Contrastive Learning via Adversarial Invariant Regularization Xilie Xu Jingfeng Zhang Feng Liu Masashi Sugiyama Mohan S. Kankanhalli AAML 111 11 0 30 Apr 2023
Deep Audio-Visual Singing Voice Transcription based on Self-Supervised Learning Models Xiangming Gu Weizhen Zeng Jianan Zhang Longshen Ou Ye Wang 95 6 0 24 Apr 2023
Understanding and Improving Feature Learning for Out-of-Distribution Generalization Yongqiang Chen Wei Huang Kaiwen Zhou Yatao Bian Bo Han James Cheng MLT OOD OODD 73 29 0 22 Apr 2023
Benchmarking Low-Shot Robustness to Natural Distribution Shifts Aaditya K. Singh Kartik Sarangmath Prithvijit Chattopadhyay Judy Hoffman OOD 90 1 0 21 Apr 2023
LEIA: Linguistic Embeddings for the Identification of Affect S. Aroyehun Lukas Malik Hannah Metzler Nikolas Haimerl Anna Flavia Di Natale David Garcia 35 3 0 21 Apr 2023
Activity Classification Using Unsupervised Domain Transfer from Body Worn Sensors Chaitra Hedge Gezheng Wen Layne Price 31 0 0 20 Apr 2023
OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images Bingchen Zhao Jiahao Wang Wufei Ma Artur Jesslen Si-Jia Yang Shaozuo Yu O. Zendel Christian Theobalt Alan Yuille Adam Kortylewski 95 9 0 17 Apr 2023