Multilevel Initialization for Layer-Parallel Deep Neural Network Training

19 December 2019

Papers citing "Multilevel Initialization for Layer-Parallel Deep Neural Network Training"

8 / 8 papers shown

Title
A Multi-Level Framework for Accelerating Training Transformer Models Longwei Zou Han Zhang Yangdong Deng AI4CE 40 1 0 07 Apr 2024
Multilevel Objective-Function-Free Optimization with an Application to Neural Networks Training Serge Gratton Alena Kopanicáková P. Toint 21 7 0 14 Feb 2023
Multilevel-in-Layer Training for Deep Neural Network Regression Colin Ponce Ruipeng Li Christina Mao P. Vassilevski AI4CE 19 1 0 11 Nov 2022
Parallel Training of GRU Networks with a Multi-Grid Solver for Long Sequences G. Moon E. Cyr 25 5 0 07 Mar 2022
Training of deep residual networks with stochastic MG/OPT Cyrill Planta Alena Kopanicáková Rolf Krause 29 3 0 09 Aug 2021
Globally Convergent Multilevel Training of Deep Residual Networks Alena Kopanicáková Rolf Krause 37 15 0 15 Jul 2021
Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection Elizabeth Newman Lars Ruthotto Joseph L. Hart B. V. B. Waanders AAML 30 19 0 26 Jul 2020
Multilevel Minimization for Deep Residual Networks Lisa Gaedke-Merzhäuser Alena Kopanicáková Rolf Krause 14 15 0 13 Apr 2020