Concurrent Adversarial Learning for Large-Batch Training

Concurrent Adversarial Learning for Large-Batch Training

1 June 2021

Yong Liu

Yang You

Papers citing "Concurrent Adversarial Learning for Large-Batch Training"

11 / 11 papers shown

Title
Accelerating Large Batch Training via Gradient Signal to Noise Ratio (GSNR) Guo-qing Jiang Jinlong Liu Zixiang Ding Lin Guo W. Lin AI4CE 26 1 0 24 Sep 2023
Systematic Investigation of Sparse Perturbed Sharpness-Aware Minimization Optimizer Peng Mi Li Shen Tianhe Ren Yiyi Zhou Tianshuo Xu Xiaoshuai Sun Tongliang Liu Rongrong Ji Dacheng Tao AAML 43 2 0 30 Jun 2023
Decentralized Adversarial Training over Graphs Ying Cao Elsa Rizk Stefan Vlaski Ali H. Sayed AAML 43 1 0 23 Mar 2023
Multi-Agent Adversarial Training Using Diffusion Learning Ying Cao Elsa Rizk Stefan Vlaski Ali H. Sayed DiffM 40 4 0 03 Mar 2023
Large-batch Optimization for Dense Visual Predictions Zeyue Xue Jianming Liang Guanglu Song Zhuofan Zong Liang Chen Yu Liu Ping Luo VLM 39 9 0 20 Oct 2022
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach Peng Mi Li Shen Tianhe Ren Yiyi Zhou Xiaoshuai Sun Rongrong Ji Dacheng Tao AAML 38 69 0 11 Oct 2022
Fast AdvProp Jieru Mei Yucheng Han Yutong Bai Yixiao Zhang Yingwei Li Xianhang Li Alan Yuille Cihang Xie AAML 29 8 0 21 Apr 2022
ScaLA: Accelerating Adaptation of Pre-Trained Transformer-Based Language Models via Efficient Large-Batch Adversarial Noise Minjia Zhang U. Niranjan Yuxiong He 28 1 0 29 Jan 2022
On the Convergence and Robustness of Adversarial Training Yisen Wang Xingjun Ma James Bailey Jinfeng Yi Bowen Zhou Quanquan Gu AAML 212 345 0 15 Dec 2021
Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusters Chen Sun Shenggui Li Jinyue Wang Jun Yu 54 47 0 08 Aug 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,892 0 15 Sep 2016