Ghosts in Neural Networks: Existence, Structure and Role of
Infinite-Dimensional Null Space

Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space

9 June 2021

ArXiv (abs)PDF HTML

Papers citing "Ghosts in Neural Networks: Existence, Structure and Role of Infinite-Dimensional Null Space"

17 / 17 papers shown

Title
Approximate Nullspace Augmented Finetuning for Robust Vision Transformers Haoyang Liu Aditya Singh Yijiang Li Haohan Wang AAML ViT 106 1 0 15 Mar 2024
Universal Approximation Theorem for Equivariant Maps by Group CNNs Wataru Kumagai Akiyoshi Sannai 86 14 0 27 Dec 2020
Compression based bound for non-compressed network: unified generalization error analysis of large compressible deep neural network Taiji Suzuki Hiroshi Abe Tomoaki Nishimura AI4CE 59 44 0 25 Sep 2019
Surprises in High-Dimensional Ridgeless Least Squares Interpolation Trevor Hastie Andrea Montanari Saharon Rosset Robert Tibshirani 214 747 0 19 Mar 2019
Global Convergence of Adaptive Gradient Methods for An Over-parameterized Neural Network Xiaoxia Wu S. Du Rachel A. Ward 82 66 0 19 Feb 2019
How do infinite width bounded norm networks look in function space? Pedro H. P. Savarese Itay Evron Daniel Soudry Nathan Srebro 83 166 0 13 Feb 2019
Width Provably Matters in Optimization for Deep Linear Neural Networks S. Du Wei Hu 72 95 0 24 Jan 2019
Reconciling modern machine learning practice and the bias-variance trade-off M. Belkin Daniel J. Hsu Siyuan Ma Soumik Mandal 244 1,659 0 28 Dec 2018
A Mean Field View of the Landscape of Two-Layers Neural Networks Song Mei Andrea Montanari Phan-Minh Nguyen MLT 105 862 0 18 Apr 2018
Stronger generalization bounds for deep nets via a compression approach Sanjeev Arora Rong Ge Behnam Neyshabur Yi Zhang MLT AI4CE 89 643 0 14 Feb 2018
Size-Independent Sample Complexity of Neural Networks Noah Golowich Alexander Rakhlin Ohad Shamir 154 551 0 18 Dec 2017
Deep Neural Networks as Gaussian Processes Jaehoon Lee Yasaman Bahri Roman Novak S. Schoenholz Jeffrey Pennington Jascha Narain Sohl-Dickstein UQCV BDL 135 1,100 0 01 Nov 2017
Implicit Regularization in Deep Learning Behnam Neyshabur 58 147 0 06 Sep 2017
Spectrally-normalized margin bounds for neural networks Peter L. Bartlett Dylan J. Foster Matus Telgarsky ODL 210 1,225 0 26 Jun 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 351 4,635 0 10 Nov 2016
Neural Network with Unbounded Activation Functions is Universal Approximator Sho Sonoda Noboru Murata 70 336 0 14 May 2015
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 292 591 0 27 Feb 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.