Surgical Fine-Tuning Improves Adaptation to Distribution Shifts

20 October 2022

Papers citing "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts"

33 / 133 papers shown

Title
LIV: Language-Image Representations and Rewards for Robotic Control Yecheng Jason Ma William Liang Vaidehi Som Vikash Kumar Amy Zhang Osbert Bastani Dinesh Jayaraman LM&Ro 39 122 0 01 Jun 2023
SlimFit: Memory-Efficient Fine-Tuning of Transformer-based Models Using Training Dynamics A. Ardakani Altan Haan Shangyin Tan Doru-Thom Popovici Alvin Cheung Costin Iancu Koushik Sen 24 2 0 29 May 2023
Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings Yihao Xue Ali Payani Yu Yang Baharan Mirzasoleiman VLM 26 4 0 23 May 2023
Universal Domain Adaptation from Foundation Models: A Baseline Study Bin Deng Kui Jia VLM 29 6 0 18 May 2023
Preemptively Pruning Clever-Hans Strategies in Deep Neural Networks Lorenz Linhardt Klaus-Robert Muller G. Montavon AAML 29 7 0 12 Apr 2023
Last-Layer Fairness Fine-tuning is Simple and Effective for Neural Networks Yuzhen Mao Zhun Deng Huaxiu Yao Ting Ye Kenji Kawaguchi James Zou 40 20 0 08 Apr 2023
ERM++: An Improved Baseline for Domain Generalization Piotr Teterwak Kuniaki Saito Theodoros Tsiligkaridis Kate Saenko Bryan A. Plummer OOD 44 9 0 04 Apr 2023
Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence? Arjun Majumdar Karmesh Yadav Sergio Arnaud Yecheng Jason Ma Claire Chen ... Dhruv Batra Yixin Lin Oleksandr Maksymets Aravind Rajeswaran Franziska Meier LM&Ro 27 174 0 31 Mar 2023
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning Changdae Oh Hyeji Hwang Hee-young Lee Yongtaek Lim Geunyoung Jung Jiyoung Jung Hosik Choi Kyungwoo Song VLM VPVLM 85 57 0 26 Mar 2023
Mind the Backbone: Minimizing Backbone Distortion for Robust Object Detection Kuniaki Saito Donghyun Kim Piotr Teterwak Rogerio Feris Kate Saenko 44 1 0 26 Mar 2023
A Closer Look at Model Adaptation using Feature Distortion and Simplicity Bias Puja Trivedi Danai Koutra Jayaraman J. Thiagarajan AAML 40 17 0 23 Mar 2023
Trainable Projected Gradient Method for Robust Fine-tuning Junjiao Tian Xiaoliang Dai Chih-Yao Ma Zecheng He Yen-Cheng Liu Z. Kira 65 31 0 19 Mar 2023
Spawrious: A Benchmark for Fine Control of Spurious Correlation Biases Aengus Lynch G. Dovonon Jean Kaddour Ricardo M. A. Silva 205 30 0 09 Mar 2023
Optimal transfer protocol by incremental layer defrosting Federica Gerace Diego Doimo Stefano Sarao Mannelli Luca Saglietti Alessandro Laio CLL 38 2 0 02 Mar 2023
Edit at your own risk: evaluating the robustness of edited models to distribution shifts Davis Brown Charles Godfrey Cody Nizinski Jonathan Tu Henry Kvinge KELM 29 8 0 28 Feb 2023
Task-Specific Skill Localization in Fine-tuned Language Models A. Panigrahi Nikunj Saunshi Haoyu Zhao Sanjeev Arora MoMe 34 69 0 13 Feb 2023
Less is More: Selective Layer Finetuning with SubTuning Gal Kaplun Andrey Gurevich Tal Swisa Mazor David Shai Shalev-Shwartz Eran Malach 29 7 0 13 Feb 2023
Cross-Modal Fine-Tuning: Align then Refine Junhong Shen Liam Li Lucio Dery Corey Staten M. Khodak Graham Neubig Ameet Talwalkar 33 36 0 11 Feb 2023
Project and Probe: Sample-Efficient Domain Adaptation by Interpolating Orthogonal Features Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn VLM 35 9 0 10 Feb 2023
Offsite-Tuning: Transfer Learning without Full Model Guangxuan Xiao Ji Lin Song Han 43 67 0 09 Feb 2023
FUN with Fisher: Improving Generalization of Adapter-Based Cross-lingual Transfer with Scheduled Unfreezing Chen Cecilia Liu Jonas Pfeiffer Ivan Vulić Iryna Gurevych CLL 32 9 0 13 Jan 2023
Efficient On-device Training via Gradient Filtering Yuedong Yang Guihong Li R. Marculescu 39 19 0 01 Jan 2023
Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors Thomas Hartvigsen S. Sankaranarayanan Hamid Palangi Yoon Kim Marzyeh Ghassemi KELM 22 147 0 20 Nov 2022
Diagnostic Tool for Out-of-Sample Model Evaluation Ludvig Hult Dave Zachariah Petre Stoica 14 1 0 22 Jun 2022
Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations Polina Kirichenko Pavel Izmailov A. Wilson OOD 51 320 0 06 Apr 2022
Diversify and Disambiguate: Learning From Underspecified Data Yoonho Lee Huaxiu Yao Chelsea Finn 215 64 0 07 Feb 2022
A Fine-Grained Analysis on Distribution Shift Olivia Wiles Sven Gowal Florian Stimberg Sylvestre-Alvise Rebuffi Ira Ktena Krishnamurthy Dvijotham A. Cemgil OOD 236 208 0 21 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,872 0 18 Apr 2021
WARP: Word-level Adversarial ReProgramming Karen Hambardzumyan Hrant Khachatrian Jonathan May AAML 254 342 0 01 Jan 2021
In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness Sang Michael Xie Ananya Kumar Robbie Jones Fereshte Khani Tengyu Ma Percy Liang OOD 174 62 0 08 Dec 2020
RobustBench: a standardized adversarial robustness benchmark Francesco Croce Maksym Andriushchenko Vikash Sehwag Edoardo Debenedetti Nicolas Flammarion M. Chiang Prateek Mittal Matthias Hein VLM 234 680 0 19 Oct 2020
Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models Cheolhyoung Lee Kyunghyun Cho Wanmo Kang MoE 249 208 0 25 Sep 2019
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Aniruddh Raghu M. Raghu Samy Bengio Oriol Vinyals 186 640 0 19 Sep 2019