Convergence of Adversarial Training in Overparametrized Neural Networks

19 June 2019

Ruiqi Gao

Tianle Cai

Papers citing "Convergence of Adversarial Training in Overparametrized Neural Networks"

36 / 36 papers shown

Title
Blessing of Dimensionality for Approximating Sobolev Classes on Manifolds Hong Ye Tan Subhadip Mukherjee Junqi Tang Carola-Bibiane Schönlieb 57 0 0 13 Aug 2024
Spectral regularization for adversarially-robust representation learning Sheng Yang Jacob A. Zavatone-Veth Cengiz Pehlevan AAML OOD 51 0 0 27 May 2024
Generating Less Certain Adversarial Examples Improves Robust Generalization Minxing Zhang Michael Backes Xiao Zhang AAML 40 1 0 06 Oct 2023
Robust Linear Regression: Phase-Transitions and Precise Tradeoffs for General Norms Elvis Dohmatob M. Scetbon AAML OOD 28 0 0 01 Aug 2023
VIPeR: Provably Efficient Algorithm for Offline RL with Neural Function Approximation Thanh Nguyen-Tang R. Arora OffRL 48 5 0 24 Feb 2023
Adaptive Smoothness-weighted Adversarial Training for Multiple Perturbations with Its Stability Analysis Jiancong Xiao Zeyu Qin Yanbo Fan Baoyuan Wu Jue Wang Zhimin Luo AAML 34 7 0 02 Oct 2022
Robustness in deep learning: The good (width), the bad (depth), and the ugly (initialization) Zhenyu Zhu Fanghui Liu Grigorios G. Chrysos V. Cevher 41 19 0 15 Sep 2022
BiFeat: Supercharge GNN Training via Graph Feature Quantization Yuxin Ma Ping Gong Jun Yi Z. Yao Cheng-rong Li Yuxiong He Feng Yan GNN 21 6 0 29 Jul 2022
Distributed Adversarial Training to Robustify Deep Neural Networks at Scale Gaoyuan Zhang Songtao Lu Yihua Zhang Xiangyi Chen Pin-Yu Chen Quanfu Fan Lee Martie L. Horesh Min-Fong Hong Sijia Liu OOD 35 12 0 13 Jun 2022
Why Robust Generalization in Deep Learning is Difficult: Perspective of Expressive Power Binghui Li Jikai Jin Han Zhong J. Hopcroft Liwei Wang OOD 84 27 0 27 May 2022
Randomly Initialized One-Layer Neural Networks Make Data Linearly Separable Promit Ghosal Srinath Mahankali Yihang Sun MLT 29 4 0 24 May 2022
On the (Non-)Robustness of Two-Layer Neural Networks in Different Learning Regimes Elvis Dohmatob A. Bietti AAML 39 13 0 22 Mar 2022
Semi-Implicit Hybrid Gradient Methods with Application to Adversarial Robustness Beomsu Kim Junghoon Seo AAML 28 0 0 21 Feb 2022
Finding Dynamics Preserving Adversarial Winning Tickets Xupeng Shi Pengfei Zheng Adam Ding Yuan Gao Weizhong Zhang AAML 31 1 0 14 Feb 2022
Benign Overfitting in Adversarially Robust Linear Classification Jinghui Chen Yuan Cao Quanquan Gu AAML SILM 34 10 0 31 Dec 2021
On the Convergence and Robustness of Adversarial Training Yisen Wang Xingjun Ma James Bailey Jinfeng Yi Bowen Zhou Quanquan Gu AAML 215 345 0 15 Dec 2021
Provable Regret Bounds for Deep Online Learning and Control Xinyi Chen Edgar Minasyan Jason D. Lee Elad Hazan 36 6 0 15 Oct 2021
Improving the Robustness of Adversarial Attacks Using an Affine-Invariant Gradient Estimator Wenzhao Xiang Hang Su Chang-rui Liu Yandong Guo Shibao Zheng AAML 29 5 0 13 Sep 2021
Advances in adversarial attacks and defenses in computer vision: A survey Naveed Akhtar Ajmal Mian Navid Kardan M. Shah AAML 38 236 0 01 Aug 2021
Taxonomy of Machine Learning Safety: A Survey and Primer Sina Mohseni Haotao Wang Zhiding Yu Chaowei Xiao Zhangyang Wang J. Yadawa 31 31 0 09 Jun 2021
A Universal Law of Robustness via Isoperimetry Sébastien Bubeck Mark Sellke 13 212 0 26 May 2021
On Function Approximation in Reinforcement Learning: Optimism in the Face of Large State Spaces Zhuoran Yang Chi Jin Zhaoran Wang Mengdi Wang Michael I. Jordan 39 18 0 09 Nov 2020
Single-Timescale Actor-Critic Provably Finds Globally Optimal Policy Zuyue Fu Zhuoran Yang Zhaoran Wang 21 42 0 02 Aug 2020
Do Adversarially Robust ImageNet Models Transfer Better? Hadi Salman Andrew Ilyas Logan Engstrom Ashish Kapoor A. Madry 37 417 0 16 Jul 2020
Provably Efficient Neural Estimation of Structural Equation Model: An Adversarial Approach Luofeng Liao You-Lin Chen Zhuoran Yang Bo Dai Zhaoran Wang Mladen Kolar 30 33 0 02 Jul 2020
Feature Purification: How Adversarial Training Performs Robust Deep Learning Zeyuan Allen-Zhu Yuanzhi Li MLT AAML 39 147 0 20 May 2020
Robust Deep Learning as Optimal Control: Insights and Convergence Guarantees Jacob H. Seidman Mahyar Fazlyab V. Preciado George J. Pappas AAML 22 15 0 01 May 2020
The Curious Case of Adversarially Robust Models: More Data Can Help, Double Descend, or Hurt Generalization Yifei Min Lin Chen Amin Karbasi AAML 37 69 0 25 Feb 2020
CAT: Customized Adversarial Training for Improved Robustness Minhao Cheng Qi Lei Pin-Yu Chen Inderjit Dhillon Cho-Jui Hsieh OOD AAML 35 114 0 17 Feb 2020
Over-parameterized Adversarial Training: An Analysis Overcoming the Curse of Dimensionality Yi Zhang Orestis Plevrakis S. Du Xingguo Li Zhao Song Sanjeev Arora 29 51 0 16 Feb 2020
MACER: Attack-free and Scalable Robust Training via Maximizing Certified Radius Runtian Zhai Chen Dan Di He Huan Zhang Boqing Gong Pradeep Ravikumar Cho-Jui Hsieh Liwei Wang OOD AAML 21 177 0 08 Jan 2020
Intriguing properties of adversarial training at scale Cihang Xie Alan Yuille AAML 13 68 0 10 Jun 2019
A Theoretical Analysis of Deep Q-Learning Jianqing Fan Zhuoran Yang Yuchen Xie Zhaoran Wang 28 596 0 01 Jan 2019
Adversarial examples from computational constraints Sébastien Bubeck Eric Price Ilya P. Razenshteyn AAML 65 230 0 25 May 2018
Adversarial Machine Learning at Scale Alexey Kurakin Ian Goodfellow Samy Bengio AAML 298 3,113 0 04 Nov 2016
New Analysis and Algorithm for Learning with Drifting Distributions M. Mohri Andrés Munoz Medina 97 124 0 19 May 2012