v1v2 (latest)

Gradient Methods Provably Converge to Non-Robust Networks

9 February 2022

Gal Vardi

Gilad Yehudai

Ohad Shamir

ArXiv (abs)PDF HTML

Papers citing "Gradient Methods Provably Converge to Non-Robust Networks"

22 / 22 papers shown

Title
$Existence of Adversarial Examples for Random Convolutional Networks via Isoperimetric Inequalities on $\mathbb{so}(d)$$ Existence of Adversarial Examples for Random Convolutional Networks via Isoperimetric Inequalities on $\mathbb{so}(d)$ Amit Daniely 28 0 0 14 Jun 2025
MALT Powers Up Adversarial Attacks Odelia Melamed Gilad Yehudai Adi Shamir AAML 54 0 0 02 Jul 2024
The Implicit Bias of Adam on Separable Data Chenyang Zhang Difan Zou Yuan Cao AI4CE 94 9 0 15 Jun 2024
The Price of Implicit Bias in Adversarially Robust Generalization Nikolaos Tsilivis Natalie Frank Nathan Srebro Julia Kempe 106 4 0 07 Jun 2024
Effect of Ambient-Intrinsic Dimension Gap on Adversarial Vulnerability Rajdeep Haldar Yue Xing Qifan Song 53 3 0 06 Mar 2024
Upper and lower bounds for the Lipschitz constant of random neural networks Paul Geuchen Thomas Heindl Dominik Stöger Felix Voigtlaender AAML 111 0 0 02 Nov 2023
Fundamental Limits of Membership Inference Attacks on Machine Learning Models Eric Aubinais Elisabeth Gassiat Pablo Piantanida MIACV 172 2 0 20 Oct 2023
$Is Certifying $\ell_p$ Robustness Still Worthwhile?$ Is Certifying $\ell_p$ Robustness Still Worthwhile? Ravi Mangal Klas Leino Zifan Wang Kai Hu Weicheng Yu Corina S. Pasareanu Anupam Datta Matt Fredrikson AAML OOD 84 1 0 13 Oct 2023
Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs D. Chistikov Matthias Englert R. Lazic MLT 102 12 0 10 Jun 2023
Deep ReLU Networks Have Surprisingly Simple Polytopes Fenglei Fan Wei Huang Xiang-yu Zhong Lecheng Ruan T. Zeng Huan Xiong Fei Wang 112 5 0 16 May 2023
Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization Spencer Frei Gal Vardi Peter L. Bartlett Nathan Srebro 86 23 0 02 Mar 2023
The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks Spencer Frei Gal Vardi Peter L. Bartlett Nathan Srebro 83 17 0 02 Mar 2023
Adversarial Examples Exist in Two-Layer ReLU Networks for Low Dimensional Linear Subspaces Odelia Melamed Gilad Yehudai Gal Vardi GAN 60 2 0 01 Mar 2023
Simplicity Bias in 1-Hidden Layer Neural Networks Depen Morwani Jatin Batra Prateek Jain Praneeth Netrapalli 103 21 0 01 Feb 2023
Robust Linear Regression: Gradient-descent, Early-stopping, and Beyond M. Scetbon Elvis Dohmatob AAML 50 3 0 31 Jan 2023
Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data Spencer Frei Gal Vardi Peter L. Bartlett Nathan Srebro Wei Hu MLT 83 42 0 13 Oct 2022
On the Implicit Bias in Deep-Learning Algorithms Gal Vardi FedML AI4CE 101 81 0 26 Aug 2022
Shortcut Learning of Large Language Models in Natural Language Understanding Mengnan Du Fengxiang He Na Zou Dacheng Tao Helen Zhou KELM OffRL 134 90 0 25 Aug 2022
Adversarial Robustness is at Odds with Lazy Training Yunjuan Wang Enayat Ullah Poorya Mianjy R. Arora SILM AAML 114 11 0 18 Jun 2022
Adversarial Reprogramming Revisited Matthias Englert R. Lazic AAML 98 11 0 07 Jun 2022
Adversarial Examples in Random Neural Networks with General Activations Andrea Montanari Yuchen Wu GAN AAML 103 14 0 31 Mar 2022
On Margin Maximization in Linear and ReLU Networks Gal Vardi Ohad Shamir Nathan Srebro 162 30 0 06 Oct 2021