Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data

2 November 2023

Tanya Berger-Wolf

Wei-Lun Chao

Papers citing "Holistic Transfer: Towards Non-Disruptive Fine-Tuning with Partial Target Data"

50 / 54 papers shown

Title
Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning Yujun Shi Jian Liang Wenqing Zhang Vincent Y. F. Tan Song Bai FedML 146 59 0 01 Oct 2022
Test-Time Training with Masked Autoencoders Yossi Gandelsman Yu Sun Xinlei Chen Alexei A. Efros OOD 103 177 0 15 Sep 2022
Patching open-vocabulary models by interpolating weights Gabriel Ilharco Mitchell Wortsman S. Gadre Shuran Song Hannaneh Hajishirzi Simon Kornblith Ali Farhadi Ludwig Schmidt VLM KELM 112 176 0 10 Aug 2022
Gradual Domain Adaptation without Indexed Intermediate Domains Hong-You Chen Wei-Lun Chao CLL 116 40 0 11 Jul 2022
Siamese Contrastive Embedding Network for Compositional Zero-Shot Learning Xiangyu Li Xu Yang Kun-Juan Wei Cheng Deng Muli Yang CoGe 78 70 0 29 Jun 2022
A Closer Look at Smoothness in Domain Adversarial Training Harsh Rangwani Sumukh K Aithal Mayank Mishra Arihant Jain R. Venkatesh Babu 109 122 0 16 Jun 2022
Balancing Discriminability and Transferability for Source-Free Domain Adaptation Jogendra Nath Kundu Akshay Ravindra Kulkarni Suvaansh Bhambri Deepesh Mehta Shreyas Kulkarni Varun Jampani R. Venkatesh Babu TTA 83 94 0 16 Jun 2022
FedAvg with Fine Tuning: Local Updates Lead to Representation Learning Liam Collins Hamed Hassani Aryan Mokhtari Sanjay Shakkottai FedML 72 80 0 27 May 2022
Source-Free Domain Adaptation via Distribution Estimation Ning Ding Yixing Xu Yehui Tang Chao Xu Yunhe Wang Dacheng Tao TTA 61 116 0 24 Apr 2022
Conditional Prompt Learning for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VLM CLIP VPVLM 148 1,359 0 10 Mar 2022
MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning Shiming Chen Ziming Hong Guosen Xie Wenhan Wang Qinmu Peng Kai Wang Jian-jun Zhao Xinge You VLM 85 107 0 07 Mar 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 132 685 0 21 Feb 2022
Head2Toe: Utilizing Intermediate Representations for Better Transfer Learning Utku Evci Vincent Dumoulin Hugo Larochelle Michael C. Mozer 116 84 0 10 Jan 2022
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 105 796 0 16 Dec 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 120 359 0 18 Oct 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 169 739 0 04 Sep 2021
TVT: Transferable Vision Transformer for Unsupervised Domain Adaptation Jinyu Yang Jingjing Liu N. Xu Junzhou Huang 96 127 0 12 Aug 2021
Generalized Source-free Domain Adaptation Shiqi Yang Yaxing Wang Joost van de Weijer Luis Herranz Shangling Jui TTA 92 259 0 03 Aug 2021
FREE: Feature Refinement for Generalized Zero-Shot Learning Shiming Chen Wenjie Wang Beihao Xia Qinmu Peng Xinge You Feng Zheng Ling Shao VLM 77 137 0 29 Jul 2021
Online Coreset Selection for Rehearsal-based Continual Learning Jaehong Yoon Divyam Madaan Eunho Yang Sung Ju Hwang CLL 82 145 0 02 Jun 2021
The iWildCam 2021 Competition Dataset Sara Beery Arush Agarwal Elijah Cole Vighnesh Birodkar 69 78 0 07 May 2021
Supervised Contrastive Replay: Revisiting the Nearest Class Mean Classifier in Online Class-Incremental Continual Learning Zheda Mai Ruiwen Li Hyunwoo J. Kim Scott Sanner CLL 91 186 0 22 Mar 2021
Cycle Self-Training for Domain Adaptation Hong Liu Jianmin Wang Mingsheng Long 111 179 0 05 Mar 2021
SWAD: Domain Generalization by Seeking Flat Minima Junbum Cha Sanghyuk Chun Kyungjae Lee Han-Cheol Cho Seunghyun Park Yunsung Lee Sungrae Park MoMe 301 459 0 17 Feb 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 469 3,906 0 11 Feb 2021
Learning Graph Embeddings for Compositional Zero-shot Learning Muhammad Ferjad Naeem Yongqin Xian Federico Tombari Zeynep Akata CoGe 57 140 0 03 Feb 2021
Online Continual Learning in Image Classification: An Empirical Survey Zheda Mai Ruiwen Li Jihwan Jeong David Quispe Hyunwoo J. Kim Scott Sanner VLM CLL 114 419 0 25 Jan 2021
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 244 1,449 0 14 Dec 2020
Attribute Prototype Network for Zero-Shot Learning Wenjia Xu Yongqin Xian Jiuniu Wang Bernt Schiele Zeynep Akata 73 294 0 19 Aug 2020
Understanding and Mitigating the Tradeoff Between Robustness and Accuracy Aditi Raghunathan Sang Michael Xie Fanny Yang John C. Duchi Percy Liang AAML 102 229 0 25 Feb 2020
Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptation Jian Liang Dapeng Hu Jiashi Feng 135 1,251 0 20 Feb 2020
Universal Domain Adaptation through Self Supervision Kuniaki Saito Donghyun Kim Stan Sclaroff Kate Saenko OOD TTA 87 323 0 19 Feb 2020
A Comprehensive Survey on Transfer Learning Fuzhen Zhuang Zhiyuan Qi Keyu Duan Dongbo Xi Yongchun Zhu Hengshu Zhu Hui Xiong Qing He 192 4,479 0 07 Nov 2019
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Xiaohua Zhai J. Puigcerver Alexander Kolesnikov P. Ruyssen C. Riquelme ... Michael Tschannen Marcin Michalski Olivier Bousquet Sylvain Gelly N. Houlsby SSL 97 447 0 01 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning Kevin Hsieh Amar Phanishayee O. Mutlu Phillip B. Gibbons 182 573 0 01 Oct 2019
Uncertainty-based Continual Learning with Adaptive Regularization Hongjoon Ahn Sungmin Cha Donggyu Lee Taesup Moon BDL 93 219 0 28 May 2019
Learning to Transfer Examples for Partial Domain Adaptation Zhangjie Cao Kaichao You Mingsheng Long Jianmin Wang Qiang Yang 72 277 0 28 Mar 2019
Class-incremental Learning via Deep Model Consolidation Junting Zhang Jie Zhang Shalini Ghosh Dawei Li Serafettin Tasci Larry Heck Heming Zhang C.-C. Jay Kuo CLL 91 339 0 19 Mar 2019
On Tiny Episodic Memories in Continual Learning Arslan Chaudhry Marcus Rohrbach Mohamed Elhoseiny Thalaiyasingam Ajanthan P. Dokania Philip Torr MarcÁurelio Ranzato CLL 93 400 0 27 Feb 2019
LEAF: A Benchmark for Federated Settings S. Caldas Sai Meher Karthik Duddu Peter Wu Tian Li Jakub Konecný H. B. McMahan Virginia Smith Ameet Talwalkar FedML 158 1,424 0 03 Dec 2018
Learning without Memorizing Prithviraj Dhar Rajat Vikram Singh Kuan-Chuan Peng Ziyan Wu Rama Chellappa CLL 93 487 0 20 Nov 2018
Partial Adversarial Domain Adaptation Zhangjie Cao Li-jie Ma Mingsheng Long Jianmin Wang 99 442 0 10 Aug 2018
Local SGD Converges Fast and Communicates Little Sebastian U. Stich FedML 191 1,070 0 24 May 2018
Averaging Weights Leads to Wider Optima and Better Generalization Pavel Izmailov Dmitrii Podoprikhin T. Garipov Dmitry Vetrov A. Wilson FedML MoMe 143 1,673 0 14 Mar 2018
Deep Visual Domain Adaptation: A Survey Mei Wang Weihong Deng OOD 102 2,020 0 10 Feb 2018
Lifelong Learning with Dynamically Expandable Networks Jaehong Yoon Eunho Yang Jeongtae Lee Sung Ju Hwang CLL 129 1,231 0 04 Aug 2017
Deep Hashing Network for Unsupervised Domain Adaptation Hemanth Venkateswara José Eusébio Shayok Chakraborty S. Panchanathan OOD 147 2,059 0 22 Jun 2017
Zero-Shot Learning -- The Good, the Bad and the Ugly Yongqin Xian Bernt Schiele Zeynep Akata 87 844 0 13 Mar 2017
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 374 7,587 0 02 Dec 2016
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 162 3,784 0 23 Nov 2016