Rethinking the Hyperparameters for Fine-tuning

19 February 2020

Hao Li

Papers citing "Rethinking the Hyperparameters for Fine-tuning"

36 / 36 papers shown

Title
Transfer Learning with Pre-trained Conditional Generative Models Shin'ya Yamaguchi Sekitoshi Kanai Atsutoshi Kumagai Daiki Chijiwa H. Kashima VLM CLL BDL DiffM 148 5 0 21 Feb 2025
Double-Bayesian Learning Stefan Jaeger BDL UD 18 0 0 16 Oct 2024
Flora: Low-Rank Adapters Are Secretly Gradient Compressors Yongchang Hao Yanshuai Cao Lili Mou 16 39 0 05 Feb 2024
The Performance of Transferability Metrics does not Translate to Medical Tasks Levy G. Chaves Alceu Bissoto Eduardo Valle Sandra Avila 37 4 0 14 Aug 2023
Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How Sebastian Pineda Arango Fabio Ferreira Arlind Kadra Frank Hutter Frank Hutter Josif Grabocka 34 15 0 06 Jun 2023
Overwriting Pretrained Bias with Finetuning Data Angelina Wang Olga Russakovsky 26 29 0 10 Mar 2023
How to prepare your task head for finetuning Yi Ren Shangmin Guo Wonho Bae Danica J. Sutherland 24 14 0 11 Feb 2023
Improving Reliability of Fine-tuning with Block-wise Optimisation Basel Barakat Qiang Huang 19 1 0 15 Jan 2023
Fine-Tuning Is All You Need to Mitigate Backdoor Attacks Zeyang Sha Xinlei He Pascal Berrang Mathias Humbert Yang Zhang AAML 13 33 0 18 Dec 2022
A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization Ashwinee Panda Xinyu Tang Saeed Mahloujifar Vikash Sehwag Prateek Mittal 43 11 0 08 Dec 2022
Classification of Colorectal Cancer Polyps via Transfer Learning and Vision-Based Tactile Sensing Nethra Venkatayogi Ozdemir Can Kara Jeff Bonyun N. Ikoma Farshid Alambeigi 25 15 0 08 Nov 2022
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts Yoonho Lee Annie S. Chen Fahim Tajwar Ananya Kumar Huaxiu Yao Percy Liang Chelsea Finn OOD 58 197 0 20 Oct 2022
Efficient Multi-Prize Lottery Tickets: Enhanced Accuracy, Training, and Inference Speed Hao-Ran Cheng Pu Zhao Yize Li Xue Lin James Diffenderfer R. Goldhahn B. Kailkhura MQ 33 0 0 26 Sep 2022
How to Fine-tune Models with Few Samples: Update, Data Augmentation, and Test-time Augmentation Yujin Kim Jaehoon Oh Sungnyun Kim Se-Young Yun 29 6 0 13 May 2022
Robust and Explainable Autoencoders for Unsupervised Time Series Outlier Detection---Extended Version Tung Kieu B. Yang Chenjuan Guo Christian S. Jensen Yan Zhao Feiteng Huang Kai Zheng AI4TS 27 37 0 07 Apr 2022
Learning Representations with Contrastive Self-Supervised Learning for Histopathology Applications Karin Stacke Jonas Unger Claes Lundström Gabriel Eilertsen OOD SSL 21 25 0 10 Dec 2021
Forward Compatible Training for Large-Scale Embedding Retrieval Systems Vivek Ramanujan Pavan Kumar Anasosalu Vasu Ali Farhadi Oncel Tuzel Hadi Pouransari VLM 32 16 0 06 Dec 2021
Improved Regularization and Robustness for Fine-tuning in Neural Networks Dongyue Li Hongyang R. Zhang NoLa 55 54 0 08 Nov 2021
SCSS-Net: Solar Corona Structures Segmentation by Deep Learning Š. Mackovjak Martin Harman V. Maslej-Krešňáková P. Butka 29 10 0 22 Sep 2021
DHA: End-to-End Joint Optimization of Data Augmentation Policy, Hyper-parameter and Architecture Kaichen Zhou Lanqing Hong Shuailiang Hu Fengwei Zhou Binxin Ru Jiashi Feng Zhenguo Li 59 10 0 13 Sep 2021
Robust fine-tuning of zero-shot models Mitchell Wortsman Gabriel Ilharco Jong Wook Kim Mike Li Simon Kornblith ... Raphael Gontijo-Lopes Hannaneh Hajishirzi Ali Farhadi Hongseok Namkoong Ludwig Schmidt VLM 64 691 0 04 Sep 2021
FREE: Feature Refinement for Generalized Zero-Shot Learning Shiming Chen Wenjie Wang Beihao Xia Qinmu Peng Xinge You Feng Zheng Ling Shao VLM 24 134 0 29 Jul 2021
End-to-end Neural Diarization: From Transformer to Conformer Yi Y. Liu Eunjung Han Chul Lee A. Stolcke 22 40 0 14 Jun 2021
AngularGrad: A New Optimization Technique for Angular Convergence of Convolutional Neural Networks S. K. Roy Mercedes Eugenia Paoletti J. Haut S. Dubey Purushottam Kar A. Plaza B. B. Chaudhuri ODL 24 18 0 21 May 2021
Modular Adaptation for Cross-Domain Few-Shot Learning Xiaoyu Lin Meng Ye Yunye Gong G. Buracas Nikoletta Basiou Ajay Divakaran Yi Yao 26 4 0 01 Apr 2021
Low-Fidelity End-to-End Video Encoder Pre-training for Temporal Action Localization Mengmeng Xu Juan-Manuel Perez-Rua Xiatian Zhu Guohao Li Brais Martinez 15 27 0 28 Mar 2021
LogME: Practical Assessment of Pre-trained Models for Transfer Learning Kaichao You Yong Liu Jianmin Wang Mingsheng Long 27 178 0 22 Feb 2021
A linearized framework and a new benchmark for model selection for fine-tuning Aditya Deshpande Alessandro Achille Avinash Ravichandran Hao Li L. Zancato Charless C. Fowlkes Rahul Bhotika Stefano Soatto Pietro Perona ALM 115 46 0 29 Jan 2021
LQF: Linear Quadratic Fine-Tuning Alessandro Achille Aditya Golatkar Avinash Ravichandran M. Polito Stefano Soatto 29 27 0 21 Dec 2020
Neural Prototype Trees for Interpretable Fine-grained Image Recognition Meike Nauta Ron van Bree C. Seifert 80 262 0 03 Dec 2020
Hyperparameter Transfer Across Developer Adjustments Daniel Stoll Jörg Franke Diane Wagner Simon Selg Frank Hutter 27 12 0 25 Oct 2020
Predicting Training Time Without Training L. Zancato Alessandro Achille Avinash Ravichandran Rahul Bhotika Stefano Soatto 23 24 0 28 Aug 2020
An Asymptotically Optimal Multi-Armed Bandit Algorithm and Hyperparameter Optimization Yimin Huang Yujun Li Hanrong Ye Zhenguo Li Zhihua Zhang 24 7 0 11 Jul 2020
Bag of Tricks for Image Classification with Convolutional Neural Networks Tong He Zhi-Li Zhang Hang Zhang Zhongyue Zhang Junyuan Xie Mu Li 221 1,399 0 04 Dec 2018
A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decay L. Smith 208 1,020 0 26 Mar 2018
Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-tuning Weifeng Ge Yizhou Yu 94 233 0 28 Feb 2017