Hyperparameter Transfer Learning with Adaptive Complexity

25 February 2021

Papers citing "Hyperparameter Transfer Learning with Adaptive Complexity"

8 / 8 papers shown

Title
Principled Architecture-aware Scaling of Hyperparameters Wuyang Chen Junru Wu Zhangyang Wang Boris Hanin AI4CE 49 0 0 27 Feb 2024
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition Samuel Horváth Stefanos Laskaridis Shashank Rajput Hongyi Wang BDL 37 4 0 28 Aug 2023
Obeying the Order: Introducing Ordered Transfer Hyperparameter Optimisation Sigrid Passano Hellan Huibin Shen Franccois-Xavier Aubet David Salinas Aaron Klein 35 1 0 29 Jun 2023
Accelerated Training via Incrementally Growing Neural Networks using Variance Transfer and Learning Rate Adaptation Xin Yuan Pedro H. P. Savarese Michael Maire 13 5 0 22 Jun 2023
Transfer Learning for Bayesian Optimization: A Survey Tianyi Bai Yang Li Yu Shen Xinyi Zhang Wentao Zhang Tengjiao Wang BDL 39 29 0 12 Feb 2023
TransBO: Hyperparameter Optimization via Two-Phase Transfer Learning Yang Li Yu Shen Huaijun Jiang Wentao Zhang Zhi-Xin Yang Ce Zhang Tengjiao Wang 41 15 0 06 Jun 2022
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer Greg Yang J. E. Hu Igor Babuschkin Szymon Sidor Xiaodong Liu David Farhi Nick Ryder J. Pachocki Weizhu Chen Jianfeng Gao 31 149 0 07 Mar 2022
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout Samuel Horváth Stefanos Laskaridis Mario Almeida Ilias Leondiadis Stylianos I. Venieris Nicholas D. Lane 189 268 0 26 Feb 2021