Training Neural Networks with Local Error Signals

20 January 2019

Papers citing "Training Neural Networks with Local Error Signals"

50 / 134 papers shown

Title
Collaborative Split Federated Learning with Parallel Training and Aggregation Yiannis Papageorgiou Yannis Thomas Alexios Filippakopoulos Ramin Khalili Iordanis Koutsopoulos FedML 39 0 0 22 Apr 2025
The Forward-Forward Algorithm: Characterizing Training Behavior Reece Adamson 23 0 0 15 Apr 2025
Toward Spiking Neural Network Local Learning Modules Resistant to Adversarial Attacks Jiaqi Lin Abhronil Sengupta AAML 31 0 0 11 Apr 2025
Self-Assembly of a Biologically Plausible Learning Circuit Q. Liao Liu Ziyin Yulu Gan Brian Cheung Mark Harnett Tomaso Poggio 52 0 0 31 Dec 2024
KALAHash: Knowledge-Anchored Low-Resource Adaptation for Deep Hashing Shu Zhao Tan Yu Xiaoshuai Hao Wenchao Ma Vijaykrishnan Narayanan 59 0 0 27 Dec 2024
Deep Trees for (Un)structured Data: Tractability, Performance, and Interpretability Dimitris Bertsimas Lisa Everest Jiayi Gu Matthew Peroni Vasiliki Stoumpou 27 0 0 28 Oct 2024
Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates Cabrel Teguemne Fokam Khaleelulla Khan Nazeer Lukas König David Kappel Anand Subramoney 35 0 0 08 Oct 2024
Unifying back-propagation and forward-forward algorithms through model predictive control Lianhai Ren Qianxiao Li 36 1 0 29 Sep 2024
Heterogeneity-Aware Coordination for Federated Learning via Stitching Pre-trained blocks Shichen Zhan Yebo Wu Chunlin Tian Yan Zhao Li Li FedML 38 2 0 11 Sep 2024
NITRO-D: Native Integer-only Training of Deep Convolutional Neural Networks Alberto Pirillo Luca Colombo Manuel Roveri MQ 37 0 0 16 Jul 2024
HPFF: Hierarchical Locally Supervised Learning with Patch Feature Fusion Junhao Su Chenghao He Feiyu Zhu Xiaojie Xu Dongzhi Guan Chenyang Si 56 2 0 08 Jul 2024
Momentum Auxiliary Network for Supervised Local Learning Junhao Su Changpeng Cai Feiyu Zhu Chenghao He Xiaojie Xu Dongzhi Guan Chenyang Si 43 4 0 08 Jul 2024
MLAAN: Scaling Supervised Local Learning with Multilaminar Leap Augmented Auxiliary Network Yuming Zhang Shouxin Zhang Peizhe Wang Feiyu Zhu Dongzhi Guan Junhao Su Jiabin Liu Changpeng Cai 33 2 0 24 Jun 2024
Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation Yibo Yang Xiaojie Li Motasem Alfarra Hasan Hammoud Adel Bibi Philip Torr Guohao Li 37 2 0 07 Jun 2024
Training of Physical Neural Networks Ali Momeni Babak Rahmani B. Scellier Logan G. Wright Peter L. McMahon ... Julie Grollier Andrea J. Liu D. Psaltis Andrea Alù Romain Fleury PINN AI4CE 51 10 0 05 Jun 2024
PETRA: Parallel End-to-end Training with Reversible Architectures Stéphane Rivaud Louis Fournier Thomas Pumir Eugene Belilovsky Michael Eickenberg Edouard Oyallon 25 0 0 04 Jun 2024
LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronization M. Apolinario Arani Roy Kaushik Roy 43 2 0 24 May 2024
Lightweight Inference for Forward-Forward Algorithm Amin Aminifar Baichuan Huang Azra Abtahi Amir Aminifar 35 3 0 08 Apr 2024
Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks Louis Fournier Edouard Oyallon 52 0 0 13 Mar 2024
Scaling Supervised Local Learning with Augmented Auxiliary Networks Chenxiang Ma Jibin Wu Chenyang Si Kay Chen Tan 49 2 0 27 Feb 2024
Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark Yihua Zhang Pingzhi Li Junyuan Hong Jiaxiang Li Yimeng Zhang ... Wotao Yin Mingyi Hong Zhangyang Wang Sijia Liu Tianlong Chen 33 45 0 18 Feb 2024
End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training Keitaro Sakamoto Issei Sato 24 4 0 14 Feb 2024
Two Tales of Single-Phase Contrastive Hebbian Learning R. Høier Christopher Zach 33 1 0 13 Feb 2024
FedImpro: Measuring and Improving Client Update in Federated Learning Zhenheng Tang Yonggang Zhang S. Shi Xinmei Tian Tongliang Liu Bo Han Xiaowen Chu FedML 26 13 0 10 Feb 2024
$HyperZ$\cdot$Z$\cdot$W Operator Connects Slow-Fast Networks for Full Context Interaction$ HyperZ $\cdot$ Z $\cdot$ W Operator Connects Slow-Fast Networks for Full Context Interaction Harvie Zhang 39 0 0 31 Jan 2024
Parametric Matrix Models Patrick Cook Danny Jammooa Morten Hjorth-Jensen Daniel D. Lee Dean Lee PINN 15 4 0 22 Jan 2024
Enhancing Small Object Encoding in Deep Neural Networks: Introducing Fast&Focused-Net with Volume-wise Dot Product Layer Tofik Ali Partha Pratim Roy ObjD 30 2 0 18 Jan 2024
Cyclic Neural Network Liangwei Yang Hengrui Zhang Zihe Song Jiawei Zhang Weizhi Zhang Jing Ma Philip S. Yu GNN 28 0 0 11 Jan 2024
When To Grow? A Fitting Risk-Aware Policy for Layer Growing in Deep Neural Networks Haihang Wu Wei Wang T. Malepathirana Damith A. Senanayake D. Oetomo Saman K. Halgamuge 26 2 0 06 Jan 2024
Unlocking Deep Learning: A BP-Free Approach for Parallel Block-Wise Training of Neural Networks Anzhe Cheng Zhenkun Wang Chenzhong Yin Mingxi Cheng Heng Ping Xiongye Xiao Shahin Nazarian Paul Bogdan 25 2 0 20 Dec 2023
Speed Up Federated Learning in Heterogeneous Environment: A Dynamic Tiering Approach Seyed Mahmoud Sajjadi Mohammadabadi Syed Zawad Feng Yan Lei Yang FedML 27 7 0 09 Dec 2023
Representation Learning in a Decomposed Encoder Design for Bio-inspired Hebbian Learning Achref Jaziri Sina Ditzel Iuliia Pliushch Visvanathan Ramesh SSL 44 1 0 22 Nov 2023
Recasting Continual Learning as Sequence Modeling Soochan Lee Jaehyeon Son Gunhee Kim CLL 25 9 0 18 Oct 2023
Seeking Next Layer Neurons' Attention for Error-Backpropagation-Like Training in a Multi-Agent Network Framework Arshia Soltani Moakhar Mohammad Azizmalayeri Hossein Mirzaei M. T. Manzuri M. Rohban 31 2 0 15 Oct 2023
Leader-Follower Neural Networks with Local Error Signals Inspired by Complex Collectives Chenzhong Yin Mingxi Cheng Xiongye Xiao Xinghe Chen Shahin Nazarian Andrei Irimia Paul Bogdan 24 2 0 11 Oct 2023
Boosting Learning for LDPC Codes to Improve the Error-Floor Performance Heeyoul Kwak Dae-Young Yun Yongjune Kim Sang-Hyo Kim Jong-Seon No 31 7 0 11 Oct 2023
DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training Aochuan Chen Yimeng Zhang Jinghan Jia James Diffenderfer Jiancheng Liu Konstantinos Parasyris Yihua Zhang Zheng-Wei Zhang B. Kailkhura Sijia Liu 35 43 0 03 Oct 2023
Module-wise Training of Neural Networks via the Minimizing Movement Scheme Skander Karkar Bhaskar Sen Emmanuel de Bezenac Patrick Gallinari 33 2 0 29 Sep 2023
Uncovering mesa-optimization algorithms in Transformers J. Oswald Eyvind Niklasson Maximilian Schlegel Seijin Kobayashi Nicolas Zucchet ... Mark Sandler Blaise Agüera y Arcas Max Vladymyrov Razvan Pascanu João Sacramento 32 54 0 11 Sep 2023
SG-Former: Self-guided Transformer with Evolving Token Reallocation Sucheng Ren Xingyi Yang Songhua Liu Xinchao Wang ViT 27 41 0 23 Aug 2023
Unlocking the Potential of Similarity Matching: Scalability, Supervision and Pre-training Yanis Bahroun Shagesh Sridharan Atithi Acharya D. Chklovskii Anirvan M. Sengupta 19 0 0 02 Aug 2023
Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey Gabriele Lagani Fabrizio Falchi Claudio Gennaro Giuseppe Amato 28 8 0 30 Jul 2023
Can Forward Gradient Match Backpropagation? Louis Fournier Stéphane Rivaud Eugene Belilovsky Michael Eickenberg Edouard Oyallon 19 16 0 12 Jun 2023
Normalization-Equivariant Neural Networks with Application to Image Denoising Sébastien Herbreteau E. Moebel Charles Kervrann 25 9 0 08 Jun 2023
Random Feedback Alignment Algorithms to train Neural Networks: Why do they Align? Dominique F. Chu Florian Bacho ODL 28 0 0 04 Jun 2023
A General Framework for Interpretable Neural Learning based on Local Information-Theoretic Goal Functions Abdullah Makkeh Marcel Graetz Andreas C. Schneider David A. Ehrlich V. Priesemann Michael Wibral 44 1 0 03 Jun 2023
Block-local learning with probabilistic latent representations David Kappel Khaleelulla Khan Nazeer Cabrel Teguemne Fokam Christian Mayr Anand Subramoney 24 4 0 24 May 2023
Feed-Forward Optimization With Delayed Feedback for Neural Networks Katharina Flügel D. Coquelin Marie Weiel Charlotte Debus Achim Streit Markus Goetz AI4CE 40 7 0 26 Apr 2023
EcoFed: Efficient Communication for DNN Partitioning-based Federated Learning Di Wu R. Ullah Philip Rodgers Peter Kilpatrick I. Spence Blesson Varghese FedML 35 1 0 11 Apr 2023
Masked Image Modeling with Local Multi-Scale Reconstruction Haoqing Wang Yehui Tang Yunhe Wang Jianyuan Guo Zhiwei Deng Kai Han 61 46 0 09 Mar 2023