Understanding the robustness difference between stochastic gradient
descent and adaptive gradient methods

Understanding the robustness difference between stochastic gradient descent and adaptive gradient methods

13 August 2023

Amir-massoud Farahmand

Papers citing "Understanding the robustness difference between stochastic gradient descent and adaptive gradient methods"

19 / 19 papers shown

Title
SAGE: Saliency-Guided Mixup with Optimal Rearrangements A. Ma Nikita Dvornik Ran Zhang Leila Pishdad Konstantinos G. Derpanis Afsaneh Fazly 53 6 0 31 Oct 2022
Exploring Architectural Ingredients of Adversarially Robust Deep Neural Networks Hanxun Huang Yisen Wang S. Erfani Quanquan Gu James Bailey Xingjun Ma AAML TPM 79 100 0 07 Oct 2021
DORO: Distributional and Outlier Robust Optimization Runtian Zhai Chen Dan J. Zico Kolter Pradeep Ravikumar 37 60 0 11 Jun 2021
Towards Understanding the Regularization of Adversarial Robustness on Neural Networks Yuxin Wen Shuai Li Kui Jia AAML 45 24 0 15 Nov 2020
Disentangling Adaptive Gradient Methods from Learning Rates Naman Agarwal Rohan Anil Elad Hazan Tomer Koren Cyril Zhang 67 35 0 26 Feb 2020
An Analysis of Adversarial Attacks and Defenses on Autonomous Driving Models Yao Deng Xi Zheng Tianyi Zhang Chen Chen Guannan Lou Miryung Kim AAML 38 141 0 06 Feb 2020
Adversarial Machine Learning -- Industry Perspectives Ramnath Kumar Magnus Nyström J. Lambert Andrew Marshall Mario Goertzel Andi Comissoneru Matt Swann Sharon Xia AAML SILM 67 235 0 04 Feb 2020
Secure and Robust Machine Learning for Healthcare: A Survey A. Qayyum Junaid Qadir Muhammad Bilal Ala I. Al-Fuqaha AAML OOD 70 378 0 21 Jan 2020
Gradient Descent Maximizes the Margin of Homogeneous Neural Networks Kaifeng Lyu Jian Li 73 332 0 13 Jun 2019
High Frequency Component Helps Explain the Generalization of Convolutional Neural Networks Haohan Wang Xindi Wu Pengcheng Yin Eric Xing 51 518 0 28 May 2019
A general system of differential equations to model first order adaptive algorithms André Belotto da Silva Maxime Gazeau 46 33 0 31 Oct 2018
Stable Prediction across Unknown Environments Kun Kuang Ruoxuan Xiong Peng Cui Susan Athey Bo Li OOD 51 167 0 16 Jun 2018
Lipschitz regularity of deep neural networks: analysis and efficient estimation Kevin Scaman Aladin Virmaux 69 523 0 28 May 2018
Regularisation of Neural Networks by Enforcing Lipschitz Continuity Henry Gouk E. Frank Bernhard Pfahringer M. Cree 136 473 0 12 Apr 2018
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 221 8,807 0 25 Aug 2017
Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients Lukas Balles Philipp Hennig 64 166 0 22 May 2017
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 313 10,149 0 16 Mar 2016
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 238 18,534 0 06 Feb 2015
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 213 14,831 1 21 Dec 2013