Surgical Fine-Tuning Improves Adaptation to Distribution Shifts

20 October 2022

Papers citing "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts"

50 / 133 papers shown

Title
R2SNet: Scalable Domain Adaptation for Object Detection in Cloud-Based Robotic Ecosystems via Proposal Refinement Michele Antonazzi Matteo Luperto N. A. Borghese Nicola Basilico 42 1 0 18 Mar 2024
Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Experts Shengzhuang Chen Jihoon Tack Yunqiao Yang Yee Whye Teh Jonathan Richard Schwarz Ying Wei MoE 45 1 0 13 Mar 2024
Overcoming Reward Overoptimization via Adversarial Policy Optimization with Lightweight Uncertainty Estimation Xiaoying Zhang Jean-François Ton Wei Shen Hongning Wang Yang Liu 39 14 0 08 Mar 2024
Any-Shift Prompting for Generalization over Distributions Zehao Xiao Jiayi Shen Mohammad Mahdi Derakhshani Tianran Ouyang Cees G. M. Snoek OOD VPVLM VLM 47 9 0 15 Feb 2024
Active Few-Shot Fine-Tuning Jonas Hübotter Bhavya Sukhija Lenart Treven Yarden As Andreas Krause 48 1 0 13 Feb 2024
LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views Yuji Roh Qingyun Liu Huan Gui Zhe Yuan Yujin Tang ... Liang Liu Shuchao Bi Lichan Hong Ed H. Chi Zhe Zhao 48 1 0 07 Feb 2024
Clarify: Improving Model Robustness With Natural Language Corrections Yoonho Lee Michelle S. Lam Helena Vasconcelos Michael S. Bernstein Chelsea Finn 40 6 0 06 Feb 2024
Toward Human-AI Alignment in Large-Scale Multi-Player Games Sugandha Sharma Guy Davidson Khimya Khetarpal Anssi Kanervisto Udit Arora Katja Hofmann Ida Momennejad 35 0 0 05 Feb 2024
Cross-modality debiasing: using language to mitigate sub-population shifts in imaging Yijiang Pang Hoang Bao Jiayu Zhou 27 0 0 02 Feb 2024
Development and Adaptation of Robotic Vision in the Real-World: the Challenge of Door Detection Michele Antonazzi Matteo Luperto N. A. Borghese Nicola Basilico 41 1 0 31 Jan 2024
AutoFT: Learning an Objective for Robust Fine-Tuning Caroline Choi Yoonho Lee Annie S. Chen Allan Zhou Aditi Raghunathan Chelsea Finn OOD 54 0 0 18 Jan 2024
HCVP: Leveraging Hierarchical Contrastive Visual Prompt for Domain Generalization Guanglin Zhou Zhongyi Han Shiming Chen Erdun Gao Liming Zhu Tongliang Liu Lina Yao Kun Zhang 37 3 0 18 Jan 2024
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction Pratyusha Sharma Jordan T. Ash Dipendra Kumar Misra LRM 19 79 0 21 Dec 2023
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision Collin Burns Pavel Izmailov Jan Hendrik Kirchner Bowen Baker Leo Gao ... Adrien Ecoffet Manas Joglekar Jan Leike Ilya Sutskever Jeff Wu ELM 50 265 0 14 Dec 2023
Towards On-device Learning on the Edge: Ways to Select Neurons to Update under a Budget Constraint Ael Quélennec Enzo Tartaglione Pavlo Mozharovskyi Van-Tam Nguyen 39 2 0 08 Dec 2023
Sim-to-Real Causal Transfer: A Metric Learning Approach to Causally-Aware Interaction Representations Yuejiang Liu Ahmad Rahimi Po-Chien Luan Frano Rajic Alexandre Alahi 37 3 0 07 Dec 2023
An Empirical Study of Automated Mislabel Detection in Real World Vision Datasets Maya Srikanth Jeremy Irvin Brian Wesley Hill Felipe Godoy Ishan Sabane Andrew Y. Ng 42 2 0 02 Dec 2023
Slot-Mixup with Subsampling: A Simple Regularization for WSI Classification Seongho Keum Sanghyun Kim Soojeong Lee Juho Lee 50 2 0 29 Nov 2023
Layer-wise Auto-Weighting for Non-Stationary Test-Time Adaptation Junyoung Park Jin-Hwa Kim Hyeongjun Kwon Ilhoon Yoon Kwanghoon Sohn 38 8 0 10 Nov 2023
The Fairness Stitch: Unveiling the Potential of Model Stitching in Neural Network De-Biasing Modar Sulaiman Kallol Roy 29 0 0 06 Nov 2023
Towards Calibrated Robust Fine-Tuning of Vision-Language Models Changdae Oh Hyesu Lim Mijoo Kim Dongyoon Han Junhyeok Park Euiseog Jeong Alexander G. Hauptmann Zhi-Qi Cheng Kyungwoo Song VLM 37 15 0 03 Nov 2023
Invariant-Feature Subspace Recovery: A New Class of Provable Domain Generalization Algorithms Haoxiang Wang Gargi Balasubramaniam Haozhe Si Bo Li Han Zhao OOD 35 1 0 02 Nov 2023
Spuriosity Rankings for Free: A Simple Framework for Last Layer Retraining Based on Object Detection Mohammad Azizmalayeri Reza Abbasi Amir Hosein Haji Mohammad Rezaie Reihaneh Zohrabi Mahdi Amiri M. T. Manzuri M. Rohban 19 0 0 31 Oct 2023
Fast Trainable Projection for Robust Fine-Tuning Junjiao Tian Yen-Cheng Liu James Seale Smith Z. Kira OOD 43 11 0 29 Oct 2023
Adaptive Test-Time Personalization for Federated Learning Wenxuan Bao Tianxin Wei Haohan Wang Jingrui He TTA OOD 31 14 0 28 Oct 2023
PockEngine: Sparse and Efficient Fine-tuning in a Pocket Ligeng Zhu Lanxiang Hu Ji Lin Wei-Chen Wang Wei-Ming Chen Chuang Gan Song Han 32 19 0 26 Oct 2023
On Surgical Fine-tuning for Language Encoders Abhilasha Lodha Gayatri Belapurkar Saloni Chalkapurkar Yuanming Tao Reshmi Ghosh Samyadeep Basu Dmitrii Petrov Soundararajan Srinivasan 33 3 0 25 Oct 2023
ClusT3: Information Invariant Test-Time Training G. A. V. Hakim David Osowiechi Mehrdad Noori Milad Cheraghalikhani Ismail Ben Ayed Christian Desrosiers TTA OOD 31 10 0 18 Oct 2023
A Recent Survey of Heterogeneous Transfer Learning Runxue Bao Yiming Sun Yuhe Gao Jindong Wang Qiang Yang Zhi-Hong Mao Ye Ye 30 4 0 12 Oct 2023
TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Models Zuxin Liu Jesse Zhang Kavosh Asadi Yao Liu Ding Zhao Shoham Sabach Rasool Fakoor ALM AI4CE 44 26 0 09 Oct 2023
Test-Time Training for Speech Sri Harsha Dumpala Chandramouli Shama Sastry Sageev Oore 43 1 0 19 Sep 2023
Mitigating the Alignment Tax of RLHF Yong Lin Hangyu Lin Wei Xiong Shizhe Diao Zeming Zheng ... Han Zhao Nan Jiang Heng Ji Yuan Yao Tong Zhang MoMe CLL 29 69 0 12 Sep 2023
Zero-Shot Robustification of Zero-Shot Models Dyah Adila Changho Shin Lin Cai Frederic Sala 51 19 0 08 Sep 2023
REALM: Robust Entropy Adaptive Loss Minimization for Improved Single-Sample Test-Time Adaptation Skyler Seto B. Theobald Federico Danieli Navdeep Jaitly Dan Busbridge TTA OOD 50 6 0 07 Sep 2023
EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models Peng Wang Ningyu Zhang Bo Tian Zekun Xi Yunzhi Yao ... Shuyang Cheng Kangwei Liu Yuansheng Ni Guozhou Zheng Huajun Chen KELM 43 42 0 14 Aug 2023
SYNAuG: Exploiting Synthetic Data for Data Imbalance Problems Moon Ye-Bin Nam Hyeon-Woo Wonseok Choi Nayeong Kim Suha Kwak Tae-Hyun Oh DiffM 27 3 0 02 Aug 2023
Improving Generalization of Adversarial Training via Robust Critical Fine-Tuning Kaijie Zhu Jindong Wang Xixu Hu Xingxu Xie G. Yang AAML 35 23 0 01 Aug 2023
PromptStyler: Prompt-driven Style Generation for Source-free Domain Generalization Junhyeong Cho Gilhyun Nam Sungyeon Kim Hunmin Yang Suha Kwak VLM OOD TTA 29 49 0 27 Jul 2023
Revisiting Fine-Tuning Strategies for Self-supervised Medical Imaging Analysis Muhammad Osama Khan Yi Fang 30 3 0 20 Jul 2023
FedBug: A Bottom-Up Gradual Unfreezing Framework for Federated Learning Chia-Hsiang Kao Yu-Chiang Frank Wang FedML 28 1 0 19 Jul 2023
What Happens During Finetuning of Vision Transformers: An Invariance Based Investigation Gabriele Merlin Vedant Nanda Ruchit Rawal Mariya Toneva 28 3 0 12 Jul 2023
Advances and Challenges in Meta-Learning: A Technical Review Anna Vettoruzzo Mohamed-Rafik Bouguelia Joaquin Vanschoren Thorsteinn Rögnvaldsson K. Santosh OffRL 36 70 0 10 Jul 2023
Surgical fine-tuning for Grape Bunch Segmentation under Visual Domain Shifts Agnese Chiatti R. Bertoglio Nicolás Catalano Matteo Gatti Matteo Matteucci 35 4 0 03 Jul 2023
FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learning Rishub Tamirisa John Won Chengjun Lu Ron Arel Andy Zhou FedML 38 3 0 23 Jun 2023
Confidence-Based Model Selection: When to Take Shortcuts for Subpopulation Shifts Annie S. Chen Yoonho Lee Amrith Rajagopal Setlur Sergey Levine Chelsea Finn OOD 24 5 0 19 Jun 2023
Simple and Fast Group Robustness by Automatic Feature Reweighting Shi Qiu Andres Potapczynski Pavel Izmailov A. Wilson OOD 75 54 0 19 Jun 2023
Neural Priming for Sample-Efficient Adaptation Matthew Wallingford Vivek Ramanujan Alex Fang Aditya Kusupati Roozbeh Mottaghi Aniruddha Kembhavi Ludwig Schmidt Ali Farhadi VLM 110 13 0 16 Jun 2023
Modularity Trumps Invariance for Compositional Robustness I. Mason Anirban Sarkar Tomotake Sasaki Xavier Boix OOD 26 1 0 15 Jun 2023
Background Prompting for Improved Object Depth Manel Baradad Yuanzhen Li Forrester Cole Michael Rubinstein Antonio Torralba William T. Freeman Varun Jampani VLM MDE 19 1 0 08 Jun 2023
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Sebastian Pineda Arango Fabio Ferreira Arlind Kadra Frank Hutter Frank Hutter Josif Grabocka 44 15 0 06 Jun 2023