Decoupled Greedy Learning of CNNs

23 January 2019

Papers citing "Decoupled Greedy Learning of CNNs"

50 / 72 papers shown

Title
You Don't Need All Attentions: Distributed Dynamic Fine-Tuning for Foundation Models Shiwei Ding Lan Zhang Zhenlin Wang Giuseppe Ateniese Xiaoyong Yuan 41 0 0 16 Apr 2025
PaCA: Partial Connection Adaptation for Efficient Fine-Tuning Sunghyeon Woo Sol Namkung Sunwoo Lee Inho Jeong Beomseok Kim Dongsuk Jeon 39 0 0 28 Feb 2025
Faster Multi-GPU Training with PPLL: A Pipeline Parallelism Framework Leveraging Local Learning Xiuyuan Guo Chengqi Xu Guinan Guo Feiyu Zhu Changpeng Cai Peizhe Wang Xiaoming Wei Junhao Su Jialin Gao 79 0 0 19 Nov 2024
Beyond Backpropagation: Optimization with Multi-Tangent Forward Gradients Katharina Flügel D. Coquelin Marie Weiel Achim Streit Markus Gotz 27 0 0 23 Oct 2024
FedProphet: Memory-Efficient Federated Adversarial Training via Robust and Consistent Cascade Learning Minxue Tang Yitu Wang Jingyang Zhang Louis DiValentin Aolin Ding Amin Hass Yiran Chen Hai "Helen" Li FedML AAML 29 0 0 12 Sep 2024
Momentum Auxiliary Network for Supervised Local Learning Junhao Su Changpeng Cai Feiyu Zhu Chenghao He Xiaojie Xu Dongzhi Guan Chenyang Si 46 4 0 08 Jul 2024
MLAAN: Scaling Supervised Local Learning with Multilaminar Leap Augmented Auxiliary Network Yuming Zhang Shouxin Zhang Peizhe Wang Feiyu Zhu Dongzhi Guan Junhao Su Jiabin Liu Changpeng Cai 33 2 0 24 Jun 2024
DRACO: Decentralized Asynchronous Federated Learning over Row-Stochastic Wireless Networks Eunjeong Jeong Marios Kountouris 31 0 0 19 Jun 2024
Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation Yibo Yang Xiaojie Li Motasem Alfarra Hasan Hammoud Adel Bibi Philip Torr Guohao Li 42 2 0 07 Jun 2024
PETRA: Parallel End-to-end Training with Reversible Architectures Stéphane Rivaud Louis Fournier Thomas Pumir Eugene Belilovsky Michael Eickenberg Edouard Oyallon 25 0 0 04 Jun 2024
Communication-Efficient Training Workload Balancing for Decentralized Multi-Agent Learning Seyed Mahmoud Sajjadi Mohammadabadi Lei Yang Feng Yan Junshan Zhang 39 5 0 01 May 2024
Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks Louis Fournier Edouard Oyallon 52 0 0 13 Mar 2024
Decoupled Vertical Federated Learning for Practical Training on Vertically Partitioned Data Avi Amalanshu Yash Sirvi David I. Inouye FedML 40 1 0 06 Mar 2024
Scaling Supervised Local Learning with Augmented Auxiliary Networks Chenxiang Ma Jibin Wu Chenyang Si Kay Chen Tan 49 2 0 27 Feb 2024
NeuroFlux: Memory-Efficient CNN Training Using Adaptive Local Learning Dhananjay Saikumar Blesson Varghese 24 1 0 21 Feb 2024
End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training Keitaro Sakamoto Issei Sato 24 4 0 14 Feb 2024
Unlocking Deep Learning: A BP-Free Approach for Parallel Block-Wise Training of Neural Networks Anzhe Cheng Zhenkun Wang Chenzhong Yin Mingxi Cheng Heng Ping Xiongye Xiao Shahin Nazarian Paul Bogdan 31 2 0 20 Dec 2023
Go beyond End-to-End Training: Boosting Greedy Local Learning with Context Supply Chengting Yu Fengzhao Zhang Hanzhi Ma Aili Wang Er-ping Li 35 1 0 12 Dec 2023
Speed Up Federated Learning in Heterogeneous Environment: A Dynamic Tiering Approach Seyed Mahmoud Sajjadi Mohammadabadi Syed Zawad Feng Yan Lei Yang FedML 29 7 0 09 Dec 2023
Module-wise Training of Neural Networks via the Minimizing Movement Scheme Skander Karkar Bhaskar Sen Emmanuel de Bezenac Patrick Gallinari 33 2 0 29 Sep 2023
$$\textbf{A}^2\textbf{CiD}^2$: Accelerating Asynchronous Communication in Decentralized Deep Learning$ $\textbf{A}^2\textbf{CiD}^2$ : Accelerating Asynchronous Communication in Decentralized Deep Learning Adel Nabli Eugene Belilovsky Edouard Oyallon 24 6 0 14 Jun 2023
ADA-GP: Accelerating DNN Training By Adaptive Gradient Prediction Vahid Janfaza Shantanu Mandal Farabi Mahmud A. Muzahid 30 2 0 22 May 2023
Feed-Forward Optimization With Delayed Feedback for Neural Networks Katharina Flügel D. Coquelin Marie Weiel Charlotte Debus Achim Streit Markus Goetz AI4CE 40 7 0 26 Apr 2023
ProGAP: Progressive Graph Neural Networks with Differential Privacy Guarantees Sina Sajadmanesh D. Gática-Pérez 35 15 0 18 Apr 2023
EcoFed: Efficient Communication for DNN Partitioning-based Federated Learning Di Wu R. Ullah Philip Rodgers Peter Kilpatrick I. Spence Blesson Varghese FedML 35 1 0 11 Apr 2023
Communication and Storage Efficient Federated Split Learning Yujia Mu Cong Shen FedML 22 13 0 11 Feb 2023
Local Learning with Neuron Groups Adeetya Patel Michael Eickenberg Eugene Belilovsky 32 6 0 18 Jan 2023
The Predictive Forward-Forward Algorithm Alexander Ororbia A. Mali 35 37 0 04 Jan 2023
Local Learning on Transformers via Feature Reconstruction P. Pathak Jingwei Zhang Dimitris Samaras ViT 24 5 0 29 Dec 2022
QuickNets: Saving Training and Preventing Overconfidence in Early-Exit Neural Architectures Devdhar Patel H. Siegelmann OnRL 42 1 0 25 Dec 2022
Deep Incubation: Training Large Models by Divide-and-Conquering Zanlin Ni Yulin Wang Jiangwei Yu Haojun Jiang Yu Cao Gao Huang VLM 20 11 0 08 Dec 2022
EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbones Yulin Wang Yang Yue Rui Lu Tian-De Liu Zhaobai Zhong S. Song Gao Huang 39 28 0 17 Nov 2022
A Variational Inequality Model for Learning Neural Networks P. Combettes J. Pesquet A. Repetti 14 2 0 26 Oct 2022
Scaling Forward Gradient With Local Losses Mengye Ren Simon Kornblith Renjie Liao Geoffrey E. Hinton 81 49 0 07 Oct 2022
Block-wise Training of Residual Networks via the Minimizing Movement Scheme Skander Karkar Ibrahim Ayed Emmanuel de Bézenac Patrick Gallinari 33 1 0 03 Oct 2022
FADE: Enabling Federated Adversarial Training on Heterogeneous Resource-Constrained Edge Devices Minxue Tang Jianyi Zhang Mingyuan Ma Louis DiValentin Aolin Ding Amin Hassanzadeh H. Li Yiran Chen FedML 28 0 0 08 Sep 2022
Locally Supervised Learning with Periodic Global Guidance Hasnain Irshad Bhatti Jaekyun Moon 16 0 0 01 Aug 2022
DADAO: Decoupled Accelerated Decentralized Asynchronous Optimization Adel Nabli Edouard Oyallon 45 8 0 26 Jul 2022
Layer-Wise Partitioning and Merging for Efficient and Scalable Deep Learning S. Akintoye Liangxiu Han H. Lloyd Xin Zhang Darren Dancey Haoming Chen Daoqiang Zhang FedML 34 5 0 22 Jul 2022
GLEAM: Greedy Learning for Large-Scale Accelerated MRI Reconstruction Batu Mehmet Ozturkler Arda Sahiner Tolga Ergen Arjun D Desai Christopher M. Sandino S. Vasanawala John M. Pauly Morteza Mardani Mert Pilanci 24 4 0 18 Jul 2022
Gigapixel Whole-Slide Images Classification using Locally Supervised Learning Jingwei Zhang Xin Zhang Ke Ma Rajarsi R. Gupta Joel H. Saltz Maria Vakalopoulou Dimitris Samaras 24 24 0 17 Jul 2022
BackLink: Supervised Local Training with Backward Links Wenzhe Guo M. Fouda A. Eltawil K. Salama 21 2 0 14 May 2022
Signal Propagation: A Framework for Learning and Inference In a Forward Pass Adam A. Kohan E. Rietman H. Siegelmann 27 26 0 04 Apr 2022
Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass Giorgia Dellaferrera Gabriel Kreiman 31 53 0 27 Jan 2022
Efficient Training of Spiking Neural Networks with Temporally-Truncated Local Backpropagation through Time Wenzhe Guo M. Fouda A. Eltawil K. Salama 28 12 0 13 Dec 2021
Layer-Parallel Training of Residual Networks with Auxiliary-Variable Networks Qi Sun Hexin Dong Zewei Chen Jiacheng Sun Zhenguo Li Bin Dong 32 1 0 10 Dec 2021
AdaSplit: Adaptive Trade-offs for Resource-constrained Distributed Deep Learning Ayush Chopra Surya Kant Sahu Abhishek Singh Abhinav Java Praneeth Vepakomma Vivek Sharma Ramesh Raskar 32 26 0 02 Dec 2021
Cortico-cerebellar networks as decoupling neural interfaces J. Pemberton E. Boven Richard Apps Rui Ponte Costa 35 6 0 21 Oct 2021
ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training Hui-Po Wang Sebastian U. Stich Yang He Mario Fritz FedML AI4CE 36 48 0 11 Oct 2021
The staircase property: How hierarchical structure can guide deep learning Emmanuel Abbe Enric Boix-Adserà Matthew Brennan Guy Bresler Dheeraj M. Nagaraj 22 48 0 24 Aug 2021