Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation

7 June 2024

Yibo Yang

Papers citing "Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation"

24 / 24 papers shown

Title
CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning Yibo Yang Xiaojie Li Zhongzhu Zhou Shuaiwen Leon Song Jianlong Wu Liqiang Nie Guohao Li 77 14 0 07 Jun 2024
Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classification Yuxuan Du Yibo Yang Dacheng Tao Min-hsiu Hsieh 86 23 0 29 Dec 2022
Hebbian Deep Learning Without Feedback Adrien Journé Hector Garcia Rodriguez Qinghai Guo Timoleon Moraitis AAML 72 54 0 23 Sep 2022
Gradients without Backpropagation A. G. Baydin Barak A. Pearlmutter Don Syme Frank Wood Philip Torr 70 67 0 17 Feb 2022
Credit Assignment Through Broadcasting a Global Error Vector David G. Clark L. F. Abbott SueYeon Chung 79 23 0 08 Jun 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 69 205 0 06 May 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 463 21,564 0 25 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 344 2,362 0 04 Mar 2021
Local plasticity rules can learn deep representations using self-supervised contrastive predictions Bernd Illing Jean-Paul Ventura G. Bellec W. Gerstner SSL DRL 88 71 0 16 Oct 2020
Prevalence of Neural Collapse during the terminal phase of deep learning training Vardan Papyan Xuemei Han D. Donoho 205 578 0 18 Aug 2020
LoCo: Local Contrastive Representation Learning Yuwen Xiong Mengye Ren R. Urtasun SSL DRL 80 70 0 04 Aug 2020
L $^2$ -GCN: Layer-Wise and Learned Efficient Training of Graph Convolutional Networks Yuning You Tianlong Chen Zhangyang Wang Yang Shen GNN 163 82 0 30 Mar 2020
Decoupled Greedy Learning of CNNs Eugene Belilovsky Michael Eickenberg Edouard Oyallon 54 117 0 23 Jan 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 81 228 0 20 Jan 2019
Greedy Layerwise Learning Can Scale to ImageNet Eugene Belilovsky Michael Eickenberg Edouard Oyallon 122 181 0 29 Dec 2018
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures Sergey Bartunov Adam Santoro Blake A. Richards Luke Marris Geoffrey E. Hinton Timothy Lillicrap 89 244 0 12 Jul 2018
Deep supervised learning using local errors Hesham Mostafa V. Ramesh Gert Cauwenberghs 58 114 0 17 Nov 2017
The Reversible Residual Network: Backpropagation Without Storing Activations Aidan Gomez Mengye Ren R. Urtasun Roger C. Grosse 74 551 0 14 Jul 2017
Direct Feedback Alignment Provides Learning in Deep Neural Networks Arild Nøkland ODL 94 459 0 06 Sep 2016
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 82 358 0 18 Aug 2016
Training Neural Networks Without Gradients: A Scalable ADMM Approach Gavin Taylor R. Burmeister Zheng Xu Bharat Singh Ankit B. Patel Tom Goldstein ODL 69 276 0 06 May 2016
How Important is Weight Symmetry in Backpropagation? Q. Liao Joel Z Leibo T. Poggio 73 170 0 17 Oct 2015
Towards Biologically Plausible Deep Learning Yoshua Bengio Dong-Hyun Lee J. Bornschein Thomas Mesnard Zhouhan Lin DRL OOD 70 352 0 14 Feb 2015
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,479 0 04 Sep 2014