Scaling Forward Gradient With Local Losses

7 October 2022

Papers citing "Scaling Forward Gradient With Local Losses"

8 / 8 papers shown

Title
Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients Yezhen Wang Zhouhao Yang Brian K Chen Fanyi Pu Bo-wen Li Tianyu Gao Kenji Kawaguchi 41 0 0 03 May 2025
FLOPS: Forward Learning with OPtimal Sampling Tao Ren Zishi Zhang Jinyang Jiang Guanghao Li Zeliang Zhang Mingqian Feng Yijie Peng 35 1 0 08 Oct 2024
HPFF: Hierarchical Locally Supervised Learning with Patch Feature Fusion Junhao Su Chenghao He Feiyu Zhu Xiaojie Xu Dongzhi Guan Chenyang Si 48 2 0 08 Jul 2024
Effective Learning with Node Perturbation in Multi-Layer Neural Networks Sander Dalm Marcel van Gerven Nasir Ahmad AAML 25 0 0 02 Oct 2023
Improving equilibrium propagation without weight symmetry through Jacobian homeostasis Axel Laborieux Friedemann Zenke 10 6 0 05 Sep 2023
Can Forward Gradient Match Backpropagation? Louis Fournier Stephane Rivaud Eugene Belilovsky Michael Eickenberg Edouard Oyallon 19 16 0 12 Jun 2023
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 271 2,603 0 04 May 2021
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 297 10,216 0 16 Nov 2016