ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks

23 February 2021

Papers citing "ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks"

50 / 193 papers shown

Title
Sharpness-Aware Minimization Enhances Feature Quality via Balanced Learning Jacob Mitchell Springer Vaishnavh Nagarajan Aditi Raghunathan 44 5 0 30 May 2024
Domain-Inspired Sharpness-Aware Minimization Under Domain Shifts Ruipeng Zhang Ziqing Fan Jiangchao Yao Ya Zhang Yanfeng Wang 38 7 0 29 May 2024
Supervised Contrastive Learning for Snapshot Spectral Imaging Face Anti-Spoofing Chuanbiao Song Yan Hong Jun Lan Huijia Zhu Weiqiang Wang Jianfu Zhang CVBM 40 0 0 29 May 2024
Improving Generalization of Deep Neural Networks by Optimum Shifting Yuyan Zhou Ye Li Lei Feng Sheng-Jun Huang OOD ODL 38 0 0 23 May 2024
SADDLe: Sharpness-Aware Decentralized Deep Learning with Heterogeneous Data Sakshi Choudhary Sai Aparna Aketi Kaushik Roy FedML 45 0 0 22 May 2024
Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks Xin-Chun Li Lan Li De-Chuan Zhan 41 2 0 21 May 2024
Exploring and Exploiting the Asymmetric Valley of Deep Neural Networks Xin-Chun Li Jinli Tang Bo Zhang Lan Li De-Chuan Zhan 49 2 0 21 May 2024
Two-Phase Dynamics of Interactions Explains the Starting Point of a DNN Learning Over-Fitted Features Junpeng Zhang Qing Li Liang Lin Quanshi Zhang AI4CE 43 5 0 16 May 2024
Sharpness-Aware Minimization for Evolutionary Feature Construction in Regression Hengzhe Zhang Qi Chen Bing Xue Wolfgang Banzhaf Mengjie Zhang AAML 46 1 0 11 May 2024
The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio Yuankun Xie Yi Lu Ruibo Fu Zhengqi Wen Zhiyong Wang ... Xiaopeng Wang Yukun Liu Haonan Cheng Long Ye Yi Sun 47 15 0 08 May 2024
A Hybrid Generative and Discriminative PointNet on Unordered Point Sets Yang Ye Shihao Ji PINN 3DPC 41 0 0 19 Apr 2024
Flatness Improves Backbone Generalisation in Few-shot Classification Rui Li Martin Trapp Marcus Klasson Arno Solin 45 0 0 11 Apr 2024
Revisiting Random Weight Perturbation for Efficiently Improving Generalization Tao Li Qinghua Tao Weihao Yan Zehao Lei Yingwen Wu Kun Fang M. He Xiaolin Huang AAML 39 5 0 30 Mar 2024
ConGeo: Robust Cross-view Geo-localization across Ground View Variations Li Mi Chang Xu J. Castillo-Navarro Syrielle Montariol Wen Yang Antoine Bosselut D. Tuia ObjD 29 5 0 20 Mar 2024
Friendly Sharpness-Aware Minimization Tao Li Pan Zhou Zhengbao He Xinwen Cheng Xiaolin Huang AAML 54 15 0 19 Mar 2024
Unknown Domain Inconsistency Minimization for Domain Generalization Seungjae Shin Heesun Bae Byeonghu Na Yoon-Yeong Kim Il-Chul Moon 39 2 0 12 Mar 2024
FlatNAS: optimizing Flatness in Neural Architecture Search for Out-of-Distribution Robustness Matteo Gambella Fabrizio Pittorino Manuel Roveri OOD 42 3 0 29 Feb 2024
Improving Group Connectivity for Generalization of Federated Deep Learning Zexi Li Jie Lin Zhiqi Li Didi Zhu Chao Wu AI4CE FedML 43 0 0 29 Feb 2024
Gradient Alignment for Cross-Domain Face Anti-Spoofing B. Le Simon S. Woo CVBM 46 19 0 29 Feb 2024
Effective Gradient Sample Size via Variation Estimation for Accelerating Sharpness aware Minimization Jiaxin Deng Junbiao Pang Baochang Zhang Tian Wang 48 1 0 24 Feb 2024
Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization Zirui Zhu Yong Liu Zangwei Zheng Huifeng Guo Yang You 35 0 0 23 Feb 2024
On the Duality Between Sharpness-Aware Minimization and Adversarial Training Yihao Zhang Hangzhou He Jingyu Zhu Huanran Chen Yifei Wang Zeming Wei AAML 37 10 0 23 Feb 2024
Mirror Gradient: Towards Robust Multimodal Recommender Systems via Exploring Flat Local Minima Shan Zhong Zhongzhan Huang Daifeng Li Wushao Wen Jinghui Qin Liang Lin 30 12 0 17 Feb 2024
Subgraphormer: Unifying Subgraph GNNs and Graph Transformers via Graph Products Guy Bar-Shalom Beatrice Bevilacqua Haggai Maron AI4CE 35 6 0 13 Feb 2024
Curvature-Informed SGD via General Purpose Lie-Group Preconditioners Omead Brandon Pooladzandi Xi-Lin Li 38 4 0 07 Feb 2024
A Precise Characterization of SGD Stability Using Loss Surface Geometry Gregory Dexter Borja Ocejo S. Keerthi Aman Gupta Ayan Acharya Rajiv Khanna MLT 30 0 0 22 Jan 2024
Momentum-SAM: Sharpness Aware Minimization without Computational Overhead Marlon Becker Frederick Altrock Benjamin Risse 82 5 0 22 Jan 2024
Stabilizing Sharpness-aware Minimization Through A Simple Renormalization Strategy Chengli Tan Jiangshe Zhang Junmin Liu Yicheng Wang Yunda Hao AAML 34 1 0 14 Jan 2024
ELSA: Partial Weight Freezing for Overhead-Free Sparse Network Deployment Paniz Halvachi Alexandra Peste Dan Alistarh Christoph H. Lampert 25 0 0 11 Dec 2023
Robust Contrastive Learning With Theory Guarantee Ngoc N. Tran Lam C. Tran Hoang Phan Anh-Vu Bui Tung Pham Toan M. Tran Dinh Q. Phung Trung Le SSL NoLa 29 0 0 16 Nov 2023
Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization with Optimal Noise Scheduling Naoki Sato Hideaki Iiduka 25 3 0 15 Nov 2023
FlatMatch: Bridging Labeled Data and Unlabeled Data with Cross-Sharpness for Semi-Supervised Learning Zhuo Huang Li Shen Jun-chen Yu Bo Han Tongliang Liu FedML 29 21 0 25 Oct 2023
Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization Zhuo Huang Muyang Li Li Shen Jun-chen Yu Chen Gong Bo Han Tongliang Liu OOD 46 8 0 25 Oct 2023
Why Does Sharpness-Aware Minimization Generalize Better Than SGD? Zixiang Chen Junkai Zhang Yiwen Kou Xiangning Chen Cho-Jui Hsieh Quanquan Gu 34 13 0 11 Oct 2023
Asymmetrically Decentralized Federated Learning Qinglun Li Miao Zhang Nan Yin Quanjun Yin Li Shen FedML 35 4 0 08 Oct 2023
TRAM: Bridging Trust Regions and Sharpness Aware Minimization Tom Sherborne Naomi Saphra Pradeep Dasigi Hao Peng 32 4 0 05 Oct 2023
A simple connection from loss flatness to compressed neural representations Shirui Chen Stefano Recanatesi E. Shea-Brown 15 0 0 03 Oct 2023
Window-based Model Averaging Improves Generalization in Heterogeneous Federated Learning Debora Caldarola Barbara Caputo Marco Ciccone FedML 13 7 0 02 Oct 2023
On Memorization and Privacy Risks of Sharpness Aware Minimization Young In Kim Pratiksha Agrawal J. Royset Rajiv Khanna FedML 28 3 0 30 Sep 2023
RSAM: Learning on manifolds with Riemannian Sharpness-aware Minimization Kenneth Allen Hoang-Phi Nguyen Tung Pham Ming-Jun Lai Mehrtash Harandi Dinh Q. Phung Trung Le AAML 40 3 0 29 Sep 2023
Enhancing Sharpness-Aware Optimization Through Variance Suppression Bingcong Li G. Giannakis AAML 28 19 0 27 Sep 2023
Accelerating Large Batch Training via Gradient Signal to Noise Ratio (GSNR) Guo-qing Jiang Jinlong Liu Zixiang Ding Lin Guo W. Lin AI4CE 26 1 0 24 Sep 2023
Create and Find Flatness: Building Flat Training Spaces in Advance for Continual Learning Wenhang Shi Yiren Chen Zhe Zhao Wei Lu Kimmo Yan Xiaoyong Du CLL 38 5 0 20 Sep 2023
Gradient constrained sharpness-aware prompt learning for vision-language models Liangchen Liu Nannan Wang Dawei Zhou Xinbo Gao Decheng Liu Xi Yang Tongliang Liu VLM 33 2 0 14 Sep 2023
Adversarial Collaborative Filtering for Free Huiyuan Chen Xiaoting Li Vivian Lai Chin-Chia Michael Yeh Yujie Fan Yan Zheng Mahashweta Das Hao Yang AAML 23 6 0 20 Aug 2023
DFedADMM: Dual Constraints Controlled Model Inconsistency for Decentralized Federated Learning Qinglun Li Li Shen Guang-Ming Li Quanjun Yin Dacheng Tao FedML 31 7 0 16 Aug 2023
ImbSAM: A Closer Look at Sharpness-Aware Minimization in Class-Imbalanced Recognition Yixuan Zhou Yi Qu Xing Xu Hengtao Shen 33 16 0 15 Aug 2023
G-Mix: A Generalized Mixup Learning Framework Towards Flat Minima Xingyu Li Bo Tang AAML 17 0 0 07 Aug 2023
Improving Generalization of Adversarial Training via Robust Critical Fine-Tuning Kaijie Zhu Jindong Wang Xixu Hu Xingxu Xie G. Yang AAML 35 23 0 01 Aug 2023
Flatness-Aware Minimization for Domain Generalization Xingxuan Zhang Renzhe Xu Han Yu Yancheng Dong Pengfei Tian Peng Cu 32 20 0 20 Jul 2023