A Theoretical Analysis of Fine-tuning with Linear Teachers

4 July 2021

Papers citing "A Theoretical Analysis of Fine-tuning with Linear Teachers"

12 / 12 papers shown

Title
TSDS: Data Selection for Task-Specific Model Finetuning Zifan Liu Amin Karbasi Theodoros Rekatsinas 29 3 0 15 Oct 2024
Features are fate: a theory of transfer learning in high-dimensional regression Javan Tahir Surya Ganguli Grant M. Rotskoff 32 1 0 10 Oct 2024
On the Generalization Ability of Unsupervised Pretraining Yuyang Deng Junyuan Hong Jiayu Zhou M. Mahdavi SSL 55 4 0 11 Mar 2024
Improved Active Multi-Task Representation Learning via Lasso Yiping Wang Yifang Chen Kevin G. Jamieson S. Du 26 11 0 05 Jun 2023
Representation Transfer Learning via Multiple Pre-trained models for Linear Regression Navjot Singh Suhas Diggavi 34 1 0 25 May 2023
On the Implicit Bias in Deep-Learning Algorithms Gal Vardi FedML AI4CE 34 72 0 26 Aug 2022
On Transfer of Adversarial Robustness from Pretraining to Downstream Tasks Laura Fee Nern Harsh Raj Maurice Georgi Yash Sharma AAML 31 2 0 07 Aug 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees Haotian Ju Dongyue Li Hongyang R. Zhang 35 28 0 06 Jun 2022
Active Multi-Task Representation Learning Yifang Chen S. Du Kevin G. Jamieson 35 12 0 02 Feb 2022
Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks Noam Razin Asaf Maman Nadav Cohen 46 29 0 27 Jan 2022
Towards Understanding Learning in Neural Networks with Linear Teachers Roei Sarussi Alon Brutzkus Amir Globerson FedML MLT 55 20 0 07 Jan 2021