ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2202.10054
  4. Cited By
Fine-Tuning can Distort Pretrained Features and Underperform
  Out-of-Distribution

Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution

21 February 2022
Ananya Kumar
Aditi Raghunathan
Robbie Jones
Tengyu Ma
Percy Liang
    OODD
ArXiv (abs)PDFHTML

Papers citing "Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution"

50 / 492 papers shown
Title
Substance or Style: What Does Your Image Embedding Know?
Substance or Style: What Does Your Image Embedding Know?
Cyrus Rashtchian
Charles Herrmann
Chun-Sung Ferng
Ayan Chakrabarti
Dilip Krishnan
Deqing Sun
Da-Cheng Juan
Andrew Tomkins
57
6
0
10 Jul 2023
Advances and Challenges in Meta-Learning: A Technical Review
Advances and Challenges in Meta-Learning: A Technical Review
Anna Vettoruzzo
Mohamed-Rafik Bouguelia
Joaquin Vanschoren
Thorsteinn Rögnvaldsson
K. Santosh
OffRL
96
78
0
10 Jul 2023
Text Descriptions are Compressive and Invariant Representations for
  Visual Learning
Text Descriptions are Compressive and Invariant Representations for Visual Learning
Zhili Feng
Anna Bair
J. Zico Kolter
VLM
48
6
0
10 Jul 2023
T-MARS: Improving Visual Representations by Circumventing Text Feature
  Learning
T-MARS: Improving Visual Representations by Circumventing Text Feature Learning
Pratyush Maini
Sachin Goyal
Zachary Chase Lipton
J. Zico Kolter
Aditi Raghunathan
VLM
83
35
0
06 Jul 2023
Becoming self-instruct: introducing early stopping criteria for minimal
  instruct tuning
Becoming self-instruct: introducing early stopping criteria for minimal instruct tuning
Waseem Alshikh
Manhal Daaboul
K. Goddard
Brock Imel
Kiran Kamble
Parikshit Kulkarni
M. Russak
ALM
13
13
0
05 Jul 2023
Large Language Model as Attributed Training Data Generator: A Tale of
  Diversity and Bias
Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias
Yue Yu
Yuchen Zhuang
Jieyu Zhang
Yu Meng
Alexander Ratner
Ranjay Krishna
Jiaming Shen
Chao Zhang
ALM
108
236
0
28 Jun 2023
Differentially Private Video Activity Recognition
Differentially Private Video Activity Recognition
Zelun Luo
Yuliang Zou
Yijin Yang
Zane Durante
De-An Huang
Zhiding Yu
Chaowei Xiao
L. Fei-Fei
Anima Anandkumar
PICV
85
5
0
27 Jun 2023
A Collaborative Transfer Learning Framework for Cross-domain
  Recommendation
A Collaborative Transfer Learning Framework for Cross-domain Recommendation
Wei Emma Zhang
Peng Zhang
Bo Zhang
Xingxing Wang
Dong Wang
60
18
0
26 Jun 2023
Confidence-Based Model Selection: When to Take Shortcuts for
  Subpopulation Shifts
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts
Annie S. Chen
Yoonho Lee
Amrith Rajagopal Setlur
Sergey Levine
Chelsea Finn
OOD
101
5
0
19 Jun 2023
Neural Priming for Sample-Efficient Adaptation
Neural Priming for Sample-Efficient Adaptation
Matthew Wallingford
Vivek Ramanujan
Alex Fang
Aditya Kusupati
Roozbeh Mottaghi
Aniruddha Kembhavi
Ludwig Schmidt
Ali Farhadi
VLM
189
15
0
16 Jun 2023
Drag-guided diffusion models for vehicle image generation
Drag-guided diffusion models for vehicle image generation
Nikos Arechiga
Frank Permenter
Binyang Song
Chenyang Yuan
DiffM
82
12
0
16 Jun 2023
Where Does My Model Underperform? A Human Evaluation of Slice Discovery
  Algorithms
Where Does My Model Underperform? A Human Evaluation of Slice Discovery Algorithms
Nari Johnson
Ángel Alexander Cabrera
Gregory Plumb
Ameet Talwalkar
75
13
0
13 Jun 2023
TART: A plug-and-play Transformer module for task-agnostic reasoning
TART: A plug-and-play Transformer module for task-agnostic reasoning
Kush S. Bhatia
A. Narayan
Chris De Sa
Christopher Ré
LRMReLMVLM
63
15
0
13 Jun 2023
On the Effectiveness of Out-of-Distribution Data in Self-Supervised
  Long-Tail Learning
On the Effectiveness of Out-of-Distribution Data in Self-Supervised Long-Tail Learning
Jianhong Bai
Zuozhu Liu
Hualiang Wang
Jinxiang Hao
Yang Feng
Huanpeng Chu
Haoji Hu
OODD
94
18
0
08 Jun 2023
Differentially Private Image Classification by Learning Priors from
  Random Processes
Differentially Private Image Classification by Learning Priors from Random Processes
Xinyu Tang
Ashwinee Panda
Vikash Sehwag
Prateek Mittal
89
21
0
08 Jun 2023
Guiding The Last Layer in Federated Learning with Pre-Trained Models
Guiding The Last Layer in Federated Learning with Pre-Trained Models
G. Legate
Nicolas Bernier
Lucas Caccia
Edouard Oyallon
Eugene Belilovsky
FedML
56
10
0
06 Jun 2023
LRVS-Fashion: Extending Visual Search with Referring Instructions
LRVS-Fashion: Extending Visual Search with Referring Instructions
Simon Lepage
Jérémie Mary
David Picard
87
1
0
05 Jun 2023
Improved Active Multi-Task Representation Learning via Lasso
Improved Active Multi-Task Representation Learning via Lasso
Yiping Wang
Yifang Chen
Kevin Jamieson
S. Du
92
11
0
05 Jun 2023
LIV: Language-Image Representations and Rewards for Robotic Control
LIV: Language-Image Representations and Rewards for Robotic Control
Yecheng Jason Ma
William Liang
Vaidehi Som
Vikash Kumar
Amy Zhang
Osbert Bastani
Dinesh Jayaraman
LM&Ro
94
130
0
01 Jun 2023
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection
DeepFake-Adapter: Dual-Level Adapter for DeepFake Detection
Rui Shao
Tianxing Wu
Liqiang Nie
Ziwei Liu
78
14
0
01 Jun 2023
Identifying visible tissue in intraoperative ultrasound: a method and application
Identifying visible tissue in intraoperative ultrasound: a method and application
Alistair Weld
L. Dixon
Giulio Anichini
Michael Dyck
Alex Ranne
Sophie Camp
Stamatia Giannarou
36
2
0
01 Jun 2023
Prompt-Based Tuning of Transformer Models for Multi-Center Medical Image
  Segmentation of Head and Neck Cancer
Prompt-Based Tuning of Transformer Models for Multi-Center Medical Image Segmentation of Head and Neck Cancer
Numan Saeed
Muhammad Ridzuan
Roba Al Majzoub
Mohammad Yaqub
VLMMedIm
72
3
0
30 May 2023
Global Layers: Non-IID Tabular Federated Learning
Global Layers: Non-IID Tabular Federated Learning
Yazan Obeidi
FedML
99
0
0
29 May 2023
FoPro-KD: Fourier Prompted Effective Knowledge Distillation for
  Long-Tailed Medical Image Recognition
FoPro-KD: Fourier Prompted Effective Knowledge Distillation for Long-Tailed Medical Image Recognition
Marawan Elbatel
Robert Martí
Xuelong Li
AAML
116
11
0
27 May 2023
Fine-Tuning Language Models with Just Forward Passes
Fine-Tuning Language Models with Just Forward Passes
Sadhika Malladi
Tianyu Gao
Eshaan Nichani
Alexandru Damian
Jason D. Lee
Danqi Chen
Sanjeev Arora
160
205
0
27 May 2023
Rethinking the Evaluation Protocol of Domain Generalization
Rethinking the Evaluation Protocol of Domain Generalization
Han Yu
Xingxuan Zhang
Renzhe Xu
Jiashuo Liu
Yue He
Peng Cui
OOD
101
8
0
24 May 2023
Non-adversarial Robustness of Deep Learning Methods for Computer Vision
Non-adversarial Robustness of Deep Learning Methods for Computer Vision
Gorana Gojić
V. Vincan
O. Kundacina
D. Mišković
Dinu Dragan
OOD
52
4
0
24 May 2023
Few-shot Adaptation to Distribution Shifts By Mixing Source and Target
  Embeddings
Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings
Yihao Xue
Ali Payani
Yu Yang
Baharan Mirzasoleiman
VLM
107
4
0
23 May 2023
Out-of-Distribution Generalization in Text Classification: Past,
  Present, and Future
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future
Linyi Yang
Yangqiu Song
Xuan Ren
Chenyang Lyu
Yidong Wang
Lingqiao Liu
Jindong Wang
Jennifer Foster
Yue Zhang
OOD
129
3
0
23 May 2023
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for
  Improved Vision-Language Compositionality
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality
Harman Singh
Pengchuan Zhang
Qifan Wang
Mengjiao MJ Wang
Wenhan Xiong
Jingfei Du
Yu Chen
CoGeVLM
91
26
0
23 May 2023
Revisiting pre-trained remote sensing model benchmarks: resizing and
  normalization matters
Revisiting pre-trained remote sensing model benchmarks: resizing and normalization matters
Isaac Corley
Caleb Robinson
Rahul Dodhia
J. L. Ferres
Peyman Najafirad
122
19
0
22 May 2023
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for
  Out-of-Domain Detection
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection
Rheeya Uppaal
Junjie Hu
Yixuan Li
OODD
207
36
0
22 May 2023
Cross-functional Analysis of Generalisation in Behavioural Learning
Cross-functional Analysis of Generalisation in Behavioural Learning
Pedro Henrique Luz de Araujo
Benjamin Roth
61
4
0
22 May 2023
Interactive Data Synthesis for Systematic Vision Adaptation via
  LLMs-AIGCs Collaboration
Interactive Data Synthesis for Systematic Vision Adaptation via LLMs-AIGCs Collaboration
Qifan Yu
Juncheng Li
Wentao Ye
Siliang Tang
Yueting Zhuang
70
14
0
22 May 2023
SFP: Spurious Feature-targeted Pruning for Out-of-Distribution
  Generalization
SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization
Yingchun Wang
Jingcai Guo
Yi Liu
Song Guo
Weizhan Zhang
Xiangyong Cao
Qinghua Zheng
AAMLOODD
106
11
0
19 May 2023
Differentially Private Adapters for Parameter Efficient Acoustic
  Modeling
Differentially Private Adapters for Parameter Efficient Acoustic Modeling
Chun-Wei Ho
Chao-Han Huck Yang
Sabato Marco Siniscalchi
100
1
0
19 May 2023
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation
Lijie Yang
Chao-Han Huck Yang
Jen-Tzung Chien
91
11
0
18 May 2023
Learning to Generalize for Cross-domain QA
Learning to Generalize for Cross-domain QA
Yingjie Niu
Linyi Yang
Ruihai Dong
Yue Zhang
92
6
0
14 May 2023
How to Train Your CheXDragon: Training Chest X-Ray Models for Transfer
  to Novel Tasks and Healthcare Systems
How to Train Your CheXDragon: Training Chest X-Ray Models for Transfer to Novel Tasks and Healthcare Systems
Cara Van Uden
Jeremy Irvin
Mars Huang
N. Dean
J. Carr
A. Ng
C. Langlotz
OOD
54
1
0
13 May 2023
Consistency Regularization for Domain Generalization with Logit
  Attribution Matching
Consistency Regularization for Domain Generalization with Logit Attribution Matching
Han Gao
Kaican Li
Weiyan Xie
Zhi Lin
Yongxiang Huang
Luning Wang
Caleb Chen Cao
N. Zhang
73
2
0
13 May 2023
Visual Tuning
Visual Tuning
Bruce X. B. Yu
Jianlong Chang
Haixin Wang
Lin Liu
Shijie Wang
...
Lingxi Xie
Haojie Li
Zhouchen Lin
Qi Tian
Chang Wen Chen
VLM
171
41
0
10 May 2023
Few-shot In-context Learning for Knowledge Base Question Answering
Few-shot In-context Learning for Knowledge Base Question Answering
Tianle Li
Xueguang Ma
Alex Zhuang
Yu Gu
Yu-Chuan Su
Wenhu Chen
182
84
0
02 May 2023
VPGTrans: Transfer Visual Prompt Generator across LLMs
VPGTrans: Transfer Visual Prompt Generator across LLMs
Ao Zhang
Hao Fei
Yuan Yao
Wei Ji
Li Li
Zhiyuan Liu
Tat-Seng Chua
MLLMVLM
84
89
0
02 May 2023
Enhancing Adversarial Contrastive Learning via Adversarial Invariant
  Regularization
Enhancing Adversarial Contrastive Learning via Adversarial Invariant Regularization
Xilie Xu
Jingfeng Zhang
Feng Liu
Masashi Sugiyama
Mohan S. Kankanhalli
AAML
111
11
0
30 Apr 2023
Deep Audio-Visual Singing Voice Transcription based on Self-Supervised
  Learning Models
Deep Audio-Visual Singing Voice Transcription based on Self-Supervised Learning Models
Xiangming Gu
Weizhen Zeng
Jianan Zhang
Longshen Ou
Ye Wang
95
6
0
24 Apr 2023
Understanding and Improving Feature Learning for Out-of-Distribution
  Generalization
Understanding and Improving Feature Learning for Out-of-Distribution Generalization
Yongqiang Chen
Wei Huang
Kaiwen Zhou
Yatao Bian
Bo Han
James Cheng
MLTOODOODD
73
29
0
22 Apr 2023
Benchmarking Low-Shot Robustness to Natural Distribution Shifts
Benchmarking Low-Shot Robustness to Natural Distribution Shifts
Aaditya K. Singh
Kartik Sarangmath
Prithvijit Chattopadhyay
Judy Hoffman
OOD
90
1
0
21 Apr 2023
LEIA: Linguistic Embeddings for the Identification of Affect
LEIA: Linguistic Embeddings for the Identification of Affect
S. Aroyehun
Lukas Malik
Hannah Metzler
Nikolas Haimerl
Anna Flavia Di Natale
David Garcia
35
3
0
21 Apr 2023
Activity Classification Using Unsupervised Domain Transfer from Body
  Worn Sensors
Activity Classification Using Unsupervised Domain Transfer from Body Worn Sensors
Chaitra Hedge
Gezheng Wen
Layne Price
31
0
0
20 Apr 2023
OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution
  Shifts of Individual Nuisances in Natural Images
OOD-CV-v2: An extended Benchmark for Robustness to Out-of-Distribution Shifts of Individual Nuisances in Natural Images
Bingchen Zhao
Jiahao Wang
Wufei Ma
Artur Jesslen
Si-Jia Yang
Shaozuo Yu
O. Zendel
Christian Theobalt
Alan Yuille
Adam Kortylewski
95
9
0
17 Apr 2023
Previous
123...106789
Next