Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct
Feedback Alignment

Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment

11 December 2020

Gustave Pariente

Florent Krzakala

Papers citing "Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment"

14 / 14 papers shown

Title
Self-Contrastive Forward-Forward Algorithm Xing Chen Dongshu Liu Jérémie Laydevant Julie Grollier 87 2 0 17 Sep 2024
The Hardware Lottery Sara Hooker 52 205 0 14 Sep 2020
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang M. Krikun Noam M. Shazeer Zhiwen Chen MoE 76 1,142 0 30 Jun 2020
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay Iacopo Poli Franccois Boniface Florent Krzakala 54 63 0 23 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 500 41,106 0 28 May 2020
A 28-nm Convolutional Neuromorphic Processor Enabling Online Learning with Spike-Based Retinas Charlotte Frenkel J. Legat D. Bol 30 43 0 13 May 2020
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism Mohammad Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 290 1,861 0 17 Sep 2019
Learning without feedback: Fixed random learning signals allow for feedforward training of deep neural networks Charlotte Frenkel M. Lefebvre D. Bol 23 23 0 03 Sep 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 64 226 0 20 Jan 2019
Training of photonic neural networks through in situ backpropagation Tyler W. Hughes M. Minkov Yu Shi S. Fan 22 360 0 25 May 2018
In-Datacenter Performance Analysis of a Tensor Processing Unit N. Jouppi C. Young Nishant Patil David Patterson Gaurav Agrawal ... Vijay Vasudevan Richard Walter Walter Wang Eric Wilcox Doe Hyun Yoon 181 4,619 0 16 Apr 2017
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 447 28,901 0 09 Sep 2016
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 65 356 0 18 Aug 2016
Random Projections through multiple optical scattering: Approximating kernels at the speed of light Alaa Saade F. Caltagirone I. Carron L. Daudet Angélique Dremeau S. Gigan Florent Krzakala 37 117 0 22 Oct 2015