Stabilizing Gradients for Deep Neural Networks via Efficient SVD Parameterization

25 March 2018

Inderjit S. Dhillon

Papers citing "Stabilizing Gradients for Deep Neural Networks via Efficient SVD Parameterization"

20 / 20 papers shown

Title
Generalization Error Analysis for Selective State-Space Models Through the Lens of Attention Arya Honarpisheh Mustafa Bozdag Octavia Camps Mario Sznaier Mamba 85 1 0 03 Feb 2025
HadamRNN: Binary and Sparse Ternary Orthogonal RNNs Armand Foucault Franck Mamalet François Malgouyres MQ 85 0 0 28 Jan 2025
A Generalization Bound for a Family of Implicit Networks Samy Wu Fung Benjamin Berkels 60 0 0 28 Jan 2025
PAC-Bayesian-Like Error Bound for a Class of Linear Time-Invariant Stochastic State-Space Models Deividas Eringis J. Leth Zheng-Hua Tan Rafal Wisniewski Mihaly Petreczky 32 1 0 30 Dec 2022
Streaming, fast and accurate on-device Inverse Text Normalization for Automatic Speech Recognition Yashesh Gaur Nick Kibre Jian Xue Kangyuan Shu Yuhui Wang Issac Alphonso Jinyu Li Jiawei Liu 16 6 0 07 Nov 2022
Stable Long-Term Recurrent Video Super-Resolution Benjamin Naoto Chiche Arnaud Woiselle J. Frontera-Pons Jean-Luc Starck SupR 30 6 0 16 Dec 2021
On the Stochastic Stability of Deep Markov Models Ján Drgoňa Sayak Mukherjee Jiaxin Zhang Frank Liu M. Halappanavar BDL 25 5 0 08 Nov 2021
A Method for Medical Data Analysis Using the LogNNet for Clinical Decision Support Systems and Edge Computing in Healthcare Andrei Velichko 18 15 0 05 Aug 2021
Recognition of handwritten MNIST digits on low-memory 2 Kb RAM Arduino board using LogNNet reservoir neural network Y. Izotov Andrei Velichko A. Ivshin R. Novitskiy 25 7 0 20 Apr 2021
Physics-Informed Neural State Space Models via Learning and Evolution Elliott Skomski Ján Drgoňa Aaron Tuor PINN AI4CE 27 9 0 26 Nov 2020
Dissipative Deep Neural Dynamical Systems Ján Drgoňa Soumya Vasisht Aaron Tuor D. Vrabie 21 7 0 26 Nov 2020
Neural Network for Low-Memory IoT Devices and MNIST Image Recognition Using Kernels Based on Logistic Map Andrei Velichko 39 44 0 04 Jun 2020
Stable and expressive recurrent vision models Drew Linsley A. Ashok L. Govindarajan Rex G Liu Thomas Serre 19 45 0 22 May 2020
Generalization and Representational Limits of Graph Neural Networks Vikas K. Garg Stefanie Jegelka Tommi Jaakkola GNN 26 304 0 14 Feb 2020
Contracting Implicit Recurrent Neural Networks: Stable Models with Improved Trainability Max Revay I. Manchester 14 43 0 22 Dec 2019
Risk bounds for reservoir computing Lukas Gonon Lyudmila Grigoryeva Juan-Pablo Ortega 33 40 0 30 Oct 2019
On Generalization Bounds of a Family of Recurrent Neural Networks Minshuo Chen Xingguo Li T. Zhao 19 70 0 28 Oct 2019
Compressing RNNs for IoT devices by 15-38x using Kronecker Products Urmish Thakker Jesse G. Beu Dibakar Gope Chu Zhou Igor Fedorov Ganesh S. Dasika Matthew Mattina 27 36 0 07 Jun 2019
Norm-based generalisation bounds for multi-class convolutional neural networks Antoine Ledent Waleed Mustafa Yunwen Lei Marius Kloft 18 5 0 29 May 2019
Data-dependent Sample Complexity of Deep Neural Networks via Lipschitz Augmentation Colin Wei Tengyu Ma 25 109 0 09 May 2019