Sensitivity and Generalization in Neural Networks: an Empirical Study

23 February 2018

Jascha Narain Sohl-Dickstein

AAML

ArXiv PDF HTML

Papers citing "Sensitivity and Generalization in Neural Networks: an Empirical Study"

50 / 87 papers shown

Title
Harmonic Loss Trains Interpretable AI Models David D. Baek Ziming Liu Riya Tyagi Max Tegmark 97 2 0 03 Feb 2025
FedTLU: Federated Learning with Targeted Layer Updates Jong-Ik Park Carlee Joe-Wong FedML 86 0 0 28 Jan 2025
Evolution and The Knightian Blindspot of Machine Learning Joel Lehman Elliot Meyerson Tarek El-Gaaly Kenneth O. Stanley Tarin Ziyaee 88 2 0 22 Jan 2025
Monomial Matrix Group Equivariant Neural Functional Networks Hoang V. Tran Thieu N. Vo Tho H. Tran An T. Nguyen Tan M. Nguyen 54 5 0 18 Sep 2024
BADM: Batch ADMM for Deep Learning Ouya Wang Shenglong Zhou Geoffrey Ye Li ODL 50 1 0 30 Jun 2024
A Margin-based Multiclass Generalization Bound via Geometric Complexity Michael Munn Benoit Dherin Javier Gonzalvo UQCV 40 2 0 28 May 2024
Robust Survival Analysis with Adversarial Regularization Michael Potter Stefano Maxenti Michael Everett AAML 24 0 0 26 Dec 2023
Neural Network Approximation for Pessimistic Offline Reinforcement Learning Di Wu Yuling Jiao Li Shen Haizhao Yang Xiliang Lu OffRL 29 1 0 19 Dec 2023
Investigating Weight-Perturbed Deep Neural Networks With Application in Iris Presentation Attack Detection Renu Sharma Redwan Sony Arun Ross AAML 21 3 0 21 Nov 2023
Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets A. D. Cunha Francesco d’Amore Emanuele Natale MLT 27 1 0 16 Nov 2023
On the Over-Memorization During Natural, Robust and Catastrophic Overfitting Runqi Lin Chaojian Yu Bo Han Tongliang Liu 35 7 0 13 Oct 2023
SkelEx and BoundEx: Natural Visualization of ReLU Neural Networks Pawel Pukowski Haiping Lu 33 0 0 09 May 2023
When Deep Learning Meets Polyhedral Theory: A Survey Joey Huchette Gonzalo Muñoz Thiago Serra Calvin Tsay AI4CE 94 32 0 29 Apr 2023
Koopman-based generalization bound: New aspect for full-rank weights Yuka Hashimoto Sho Sonoda Isao Ishikawa Atsushi Nitanda Taiji Suzuki 11 2 0 12 Feb 2023
On the Lipschitz Constant of Deep Networks and Double Descent Matteo Gamba Hossein Azizpour Mårten Björkman 33 7 0 28 Jan 2023
Neural networks learn to magnify areas near decision boundaries Jacob A. Zavatone-Veth Sheng Yang Julian Rubinfien Cengiz Pehlevan MLT AI4CE 28 6 0 26 Jan 2023
Understanding the Spectral Bias of Coordinate Based MLPs Via Training Dynamics J. Lazzari Xiuwen Liu 26 3 0 14 Jan 2023
Effects of Data Geometry in Early Deep Learning Saket Tiwari George Konidaris 79 7 0 29 Dec 2022
Context Label Learning: Improving Background Class Representations in Semantic Segmentation Zeju Li Konstantinos Kamnitsas Cheng Ouyang Chen Chen Ben Glocker VLM 30 6 0 16 Dec 2022
Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions S. Bhattamishra Arkil Patel Varun Kanade Phil Blunsom 22 45 0 22 Nov 2022
Interpreting Neural Networks through the Polytope Lens Sid Black Lee D. Sharkey Léo Grinsztajn Eric Winsor Daniel A. Braun ... Kip Parker Carlos Ramón Guevara Beren Millidge Gabriel Alfour Connor Leahy FAtt MILM 31 22 0 22 Nov 2022
Curved Representation Space of Vision Transformers Juyeop Kim Junha Park Songkuk Kim Jongseok Lee ViT 41 6 0 11 Oct 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 57 31 0 27 Sep 2022
Deep Double Descent via Smooth Interpolation Matteo Gamba Erik Englesson Mårten Björkman Hossein Azizpour 63 11 0 21 Sep 2022
Data Provenance via Differential Auditing Xin Mu Ming Pang Feida Zhu 16 1 0 04 Sep 2022
The BUTTER Zone: An Empirical Study of Training Dynamics in Fully Connected Neural Networks Charles Edison Tripp J. Perr-Sauer L. Hayne M. Lunacek Jamil Gafur AI4CE 23 0 0 25 Jul 2022
Blessing of Nonconvexity in Deep Linear Models: Depth Flattens the Optimization Landscape Around the True Solution Jianhao Ma S. Fattahi 44 5 0 15 Jul 2022
Standalone Neural ODEs with Sensitivity Analysis Rym Jaroudi Lukáš Malý Gabriel Eilertsen B. Johansson Jonas Unger George Baravdish 23 0 0 27 May 2022
Discovering and Explaining the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions Fang Wu Siyuan Li Lirong Wu Dragomir R. Radev Stan Z. Li 27 2 0 15 May 2022
Overparametrization improves robustness against adversarial attacks: A replication study Ali Borji AAML 19 1 0 20 Feb 2022
Perspective Transformation Layer Nishant Khatri Agnibh Dasgupta Yucong Shen Xinru Zhong F. Shih 33 3 0 14 Jan 2022
On the Effectiveness of Neural Ensembles for Image Classification with Small Datasets Lorenzo Brigato Luca Iocchi UQCV 30 0 0 29 Nov 2021
Discovering and Explaining the Representation Bottleneck of DNNs Huiqi Deng Qihan Ren Hao Zhang Quanshi Zhang 39 59 0 11 Nov 2021
Visualizing the Emergence of Intermediate Visual Patterns in DNNs Mingjie Li Shaobo Wang Quanshi Zhang 44 11 0 05 Nov 2021
Gradient representations in ReLU networks as similarity functions Dániel Rácz Balint Daroczy FAtt 27 1 0 26 Oct 2021
In Search of Probeable Generalization Measures Jonathan Jaegerman Khalil Damouni M. M. Ankaralı Konstantinos N. Plataniotis 27 2 0 23 Oct 2021
Noise Stability Regularization for Improving BERT Fine-tuning Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 19 43 0 10 Jul 2021
Stabilizing Equilibrium Models by Jacobian Regularization Shaojie Bai V. Koltun J. Zico Kolter 30 57 0 28 Jun 2021
A Universal Law of Robustness via Isoperimetry Sébastien Bubeck Mark Sellke 13 213 0 26 May 2021
Relative stability toward diffeomorphisms indicates performance in deep nets Leonardo Petrini Alessandro Favero Mario Geiger M. Wyart OOD 38 15 0 06 May 2021
Analytical bounds on the local Lipschitz constants of ReLU networks Trevor Avant K. Morgansen FAtt 21 12 0 29 Apr 2021
Is it enough to optimize CNN architectures on ImageNet? Lukas Tuggener Jürgen Schmidhuber Thilo Stadelmann 33 23 0 16 Mar 2021
Intraclass clustering: an implicit learning ability that regularizes DNNs Simon Carbonnelle Christophe De Vleeschouwer 60 8 0 11 Mar 2021
Reframing Neural Networks: Deep Structure in Overcomplete Representations Calvin Murdock George Cazenavette Simon Lucey BDL 41 4 0 10 Mar 2021
DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning Xianyuan Zhan Haoran Xu Yueying Zhang Xiangyu Zhu Honglei Yin Yu Zheng OffRL AI4CE 40 67 0 23 Feb 2021
A case for new neural network smoothness constraints Mihaela Rosca T. Weber Arthur Gretton S. Mohamed AAML 35 48 0 14 Dec 2020
MetaInfoNet: Learning Task-Guided Information for Sample Reweighting Hongxin Wei Lei Feng R. Wang Bo An NoLa 25 6 0 09 Dec 2020
Optimism in the Face of Adversity: Understanding and Improving Deep Learning through Adversarial Robustness Guillermo Ortiz-Jiménez Apostolos Modas Seyed-Mohsen Moosavi-Dezfooli P. Frossard AAML 29 48 0 19 Oct 2020
What About Inputing Policy in Value Function: Policy Representation and Policy-extended Value Function Approximator Hongyao Tang Zhaopeng Meng Jianye Hao Chong Chen D. Graves ... Hangyu Mao Wulong Liu Yaodong Yang Wenyuan Tao Li Wang OffRL 14 7 0 19 Oct 2020
Meta-Learning Requires Meta-Augmentation Janarthanan Rajendran A. Irpan Eric Jang 24 93 0 10 Jul 2020