The Singular Values of Convolutional Layers

26 May 2018

Papers citing "The Singular Values of Convolutional Layers"

50 / 128 papers shown

Title
Robustness against Adversarial Attacks in Neural Networks using Incremental Dissipativity B. Aquino Arash Rahnama Peter M. Seiler Lizhen Lin Vijay Gupta AAML 30 8 0 25 Nov 2021
A Dynamical System Perspective for Lipschitz Neural Networks Laurent Meunier Blaise Delattre Alexandre Araujo A. Allauzen 45 54 0 25 Oct 2021
Existence, Stability and Scalability of Orthogonal Convolutional Neural Networks El Mehdi Achour Franccois Malgouyres Franck Mamalet 21 21 0 12 Aug 2021
Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100 Sahil Singla Surbhi Singla S. Feizi AAML 48 55 0 05 Aug 2021
Certified Defense via Latent Space Randomized Smoothing with Orthogonal Encoders Huimin Zeng Jiahao Su Furong Huang AAML 24 4 0 01 Aug 2021
Scaling-up Diverse Orthogonal Convolutional Networks with a Paraunitary Framework Jiahao Su Wonmin Byeon Furong Huang 25 9 0 16 Jun 2021
Scaling Properties of Deep Residual Networks A. Cohen R. Cont Alain Rossier Renyuan Xu 27 18 0 25 May 2021
Skew Orthogonal Convolutions Sahil Singla S. Feizi 29 67 0 24 May 2021
A Probabilistic Approach to Neural Network Pruning Xin-Yao Qian Diego Klabjan 37 17 0 20 May 2021
EZCrop: Energy-Zoned Channels for Robust Output Pruning R. Lin Jie Ran Dongpeng Wang King Hung Chiu Ngai Wong 16 6 0 08 May 2021
Orthogonalizing Convolutional Layers with the Cayley Transform Asher Trockman J. Zico Kolter 25 111 0 14 Apr 2021
Fast Approximate Spectral Normalization for Robust Deep Neural Networks Zhixin Pan Prabhat Mishra AAML OOD 25 1 0 22 Mar 2021
Reverse Differentiation via Predictive Coding Tommaso Salvatori Yuhang Song Thomas Lukasiewicz Rafal Bogacz Zhenghua Xu PINN 30 26 0 08 Mar 2021
Spectral Tensor Train Parameterization of Deep Learning Layers Anton Obukhov M. Rakhuba Alexander Liniger Zhiwu Huang Stamatios Georgoulis Dengxin Dai Luc Van Gool 31 10 0 07 Mar 2021
Predictive Coding Can Do Exact Backpropagation on Convolutional and Recurrent Neural Networks Tommaso Salvatori Yuhang Song Thomas Lukasiewicz Rafal Bogacz Zhenghua Xu PINN 29 24 0 05 Mar 2021
SVMax: A Feature Embedding Regularizer Ahmed Taha Alex Hanson Abhinav Shrivastava L. Davis 34 0 0 04 Mar 2021
Sparsity Aware Normalization for GANs I. Kligvasser T. Michaeli GAN 41 6 0 03 Mar 2021
Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training Sheng Liu Xiao Li Yuexiang Zhai Chong You Zhihui Zhu C. Fernandez‐Granda Qing Qu 25 25 0 01 Mar 2021
Globally-Robust Neural Networks Klas Leino Zifan Wang Matt Fredrikson AAML OOD 80 126 0 16 Feb 2021
Depthwise Separable Convolutions Allow for Fast and Memory-Efficient Spectral Normalization Christina Runkel Christian Etmann Michael Möller Carola-Bibiane Schönlieb 25 1 0 12 Feb 2021
Regularization for convolutional kernel tensors to avoid unstable gradient problem in convolutional neural networks Pei-Chang Guo 21 0 0 05 Feb 2021
MP3net: coherent, minute-long music generation from raw audio with a simple convolutional GAN Korneel van den Broek MGen 31 7 0 12 Jan 2021
Towards Understanding the Regularization of Adversarial Robustness on Neural Networks Yuxin Wen Shuai Li Kui Jia AAML 18 24 0 15 Nov 2020
LEAN: graph-based pruning for convolutional neural networks by extracting longest chains R. Schoonhoven A. Hendriksen D. Pelt K. Batenburg 3DPC 22 4 0 13 Nov 2020
Convolutional Proximal Neural Networks and Plug-and-Play Algorithms J. Hertrich Sebastian Neumayer Gabriele Steidl 22 57 0 04 Nov 2020
Deep Networks from the Principle of Rate Reduction Kwan Ho Ryan Chan Yaodong Yu Chong You Haozhi Qi John N. Wright Yi Ma 22 21 0 27 Oct 2020
Few-Shot Adaptation of Generative Adversarial Networks Esther Robb Wen-Sheng Chu Abhishek Kumar Jia-Bin Huang 37 99 0 22 Oct 2020
Layer-adaptive sparsity for the Magnitude-based Pruning Jaeho Lee Sejun Park Sangwoo Mo Sungsoo Ahn Jinwoo Shin 21 189 0 15 Oct 2020
Diagnosing and Preventing Instabilities in Recurrent Video Processing T. Tanay Aivar Sootla Matteo Maggioni P. Dokania Philip Torr A. Leonardis Greg Slabaugh 27 7 0 10 Oct 2020
Lipschitz Bounded Equilibrium Networks Max Revay Ruigang Wang I. Manchester 9 75 0 05 Oct 2020
Async-RED: A Provably Convergent Asynchronous Block Parallel Stochastic Method using Deep Denoising Priors Yu Sun Jiaming Liu Yiran Sun B. Wohlberg Ulugbek S. Kamilov 37 15 0 03 Oct 2020
MSR-DARTS: Minimum Stable Rank of Differentiable Architecture Search Kengo Machida Kuniaki Uto Koichi Shinoda Taiji Suzuki 17 0 0 19 Sep 2020
Large Norms of CNN Layers Do Not Hurt Adversarial Robustness Youwei Liang Dong Huang 22 11 0 17 Sep 2020
What is being transferred in transfer learning? Behnam Neyshabur Hanie Sedghi Chiyuan Zhang 29 508 0 26 Aug 2020
On the Iteration Complexity of Hypergradient Computation Riccardo Grazzi Luca Franceschi Massimiliano Pontil Saverio Salzo 50 193 0 29 Jun 2020
Using Wavelets and Spectral Methods to Study Patterns in Image-Classification Datasets Roozbeh Yousefzadeh Furong Huang 19 6 0 17 Jun 2020
On Lipschitz Regularization of Convolutional Layers using Toeplitz Matrix Theory Alexandre Araujo Benjamin Négrevergne Y. Chevaleyre Jamal Atif 34 0 0 15 Jun 2020
Asymptotic Singular Value Distribution of Linear Convolutional Layers Xinping Yi 19 3 0 12 Jun 2020
Scalable Plug-and-Play ADMM with Convergence Guarantees Yu Sun Zihui Wu Xiaojian Xu B. Wohlberg Ulugbek S. Kamilov BDL 35 74 0 05 Jun 2020
Second-Order Provable Defenses against Adversarial Attacks Sahil Singla S. Feizi AAML 16 60 0 01 Jun 2020
Achieving Online Regression Performance of LSTMs with Simple RNNs Nuri Mert Vural Fatih Ilhan Selim F. Yilmaz Salih Ergüt Suleyman Serdar Kozat 16 13 0 16 May 2020
Learning Deep Kernels for Non-Parametric Two-Sample Tests Feng Liu Wenkai Xu Jie Lu Guangquan Zhang Arthur Gretton Danica J. Sutherland 24 177 0 21 Feb 2020
Distance-Based Regularisation of Deep Networks for Fine-Tuning Henry Gouk Timothy M. Hospedales Massimiliano Pontil 6 52 0 19 Feb 2020
$Gradient $\ell_1$ Regularization for Quantization Robustness$ Gradient $\ell_1$ Regularization for Quantization Robustness Milad Alizadeh Arash Behboodi M. V. Baalen Christos Louizos Tijmen Blankevoort Max Welling MQ 17 8 0 18 Feb 2020
Predicting trends in the quality of state-of-the-art neural networks without access to training or testing data Charles H. Martin Tongsu Peng Peng Michael W. Mahoney 36 101 0 17 Feb 2020
Lookahead: A Far-Sighted Alternative of Magnitude-based Pruning Sejun Park Jaeho Lee Sangwoo Mo Jinwoo Shin 15 91 0 12 Feb 2020
Understanding Generalization in Deep Learning via Tensor Methods Jingling Li Yanchao Sun Jiahao Su Taiji Suzuki Furong Huang 25 27 0 14 Jan 2020
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 27 168 0 19 Dec 2019
Gabor Layers Enhance Network Robustness Juan C. Pérez Motasem Alfarra Guillaume Jeanneret Adel Bibi Ali K. Thabet Guohao Li Pablo Arbelaez AAML 22 17 0 11 Dec 2019
Fantastic Generalization Measures and Where to Find Them Yiding Jiang Behnam Neyshabur H. Mobahi Dilip Krishnan Samy Bengio AI4CE 16 597 0 04 Dec 2019