v1v2 (latest)

Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes

18 December 2024

Papers citing "Seeking Consistent Flat Minima for Better Domain Generalization via Refining Loss Landscapes"

50 / 86 papers shown

Title
Internal Consistency and Self-Feedback in Large Language Models: A Survey Xun Liang Shichao Song Zifan Zheng Hanyu Wang Qingchen Yu ... Rong-Hua Li Peng Cheng Zhonghao Wang Feiyu Xiong Zhiyu Li HILM LRM 162 29 0 19 Jul 2024
Towards Robust Out-of-Distribution Generalization Bounds via Sharpness Yingtian Zou Kenji Kawaguchi Yingnan Liu Jiashuo Liu Mong Li Lee Wynne Hsu 81 7 0 11 Mar 2024
Flatness-Aware Minimization for Domain Generalization Xingxuan Zhang Renzhe Xu Han Yu Yancheng Dong Pengfei Tian Peng Cu 85 22 0 20 Jul 2023
Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofing Hye-jin Shim Jee-weon Jung Tomi Kinnunen 65 14 0 31 May 2023
An Adaptive Policy to Employ Sharpness-Aware Minimization Weisen Jiang Hansi Yang Yu Zhang James T. Kwok AAML 130 34 0 28 Apr 2023
Self-Refine: Iterative Refinement with Self-Feedback Aman Madaan Niket Tandon Prakhar Gupta Skyler Hallinan Luyu Gao ... Bodhisattwa Prasad Majumder Katherine Hermann Sean Welleck Amir Yazdanbakhsh Peter Clark ReLM LRM DiffM 212 1,688 0 30 Mar 2023
Sharpness-Aware Gradient Matching for Domain Generalization Pengfei Wang Zhaoxiang Zhang Zhen Lei Lei Zhang 73 95 0 18 Mar 2023
Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization Xingxuan Zhang Renzhe Xu Han Yu Hao Zou Peng Cui 77 41 0 03 Mar 2023
Neural Architecture Search: Insights from 1000 Papers Colin White Mahmoud Safari R. Sukthanker Binxin Ru T. Elsken Arber Zela Debadeepta Dey Frank Hutter 3DV AI4CE 129 142 0 20 Jan 2023
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach Peng Mi Li Shen Tianhe Ren Yiyi Zhou Xiaoshuai Sun Rongrong Ji Dacheng Tao AAML 121 71 0 11 Oct 2022
Prompt Vision Transformer for Domain Generalization Zangwei Zheng Xiangyu Yue Kai Wang Yang You VLM VPVLM MDE 126 54 0 18 Aug 2022
On the Maximum Hessian Eigenvalue and Generalization Simran Kaur Jérémy E. Cohen Zachary Chase Lipton 103 43 0 21 Jun 2022
Towards Understanding Sharpness-Aware Minimization Maksym Andriushchenko Nicolas Flammarion AAML 115 142 0 13 Jun 2022
Fisher SAM: Information Geometry and Sharpness Aware Minimisation Minyoung Kim Da Li S. Hu Timothy M. Hospedales AAML 92 72 0 10 Jun 2022
Sharpness-Aware Training for Free Jiawei Du Daquan Zhou Jiashi Feng Vincent Y. F. Tan Qiufeng Wang AAML 103 96 0 27 May 2022
Visual Prompt Tuning Menglin Jia Luming Tang Bor-Chun Chen Claire Cardie Serge Belongie Bharath Hariharan Ser-Nam Lim VLM VPVLM 208 1,654 0 23 Mar 2022
Domain Generalization by Mutual-Information Regularization with Pre-trained Models Junbum Cha Kyungjae Lee Sungrae Park Sanghyuk Chun OOD 118 138 0 21 Mar 2022
Are Vision Transformers Robust to Spurious Correlations? Soumya Suvra Ghosal Yifei Ming Yixuan Li ViT 71 34 0 17 Mar 2022
Surrogate Gap Minimization Improves Sharpness-Aware Training Juntang Zhuang Boqing Gong Liangzhe Yuan Huayu Chen Hartwig Adam Nicha Dvornek S. Tatikonda James Duncan Ting Liu 105 157 0 15 Mar 2022
Domain Generalization using Pretrained Models without Fine-tuning Ziyue Li Kan Ren Xinyang Jiang Yue Liu Haipeng Zhang Dongsheng Li VLM 94 38 0 09 Mar 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 142 687 0 21 Feb 2022
When Do Flat Minima Optimizers Work? Jean Kaddour Linqing Liu Ricardo M. A. Silva Matt J. Kusner ODL 134 64 0 01 Feb 2022
Exploiting Domain-Specific Features to Enhance Domain Generalization Manh-Ha Bui Toan M. Tran Anh Tran D.Q. Phung OOD 103 135 0 18 Oct 2021
Sharpness-Aware Minimization Improves Language Model Generalization Dara Bahri H. Mobahi Yi Tay 182 104 0 16 Oct 2021
Towards a Unified View of Parameter-Efficient Transfer Learning Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 178 958 0 08 Oct 2021
Fishr: Invariant Gradient Variances for Out-of-Distribution Generalization Alexandre Ramé Corentin Dancette Matthieu Cord OOD 146 210 0 07 Sep 2021
NAS-OoD: Neural Architecture Search for Out-of-Distribution Generalization Haoyue Bai Fengwei Zhou Lanqing Hong Nanyang Ye Shueng-Han Gary Chan Zhenguo Li OOD UQCV 73 44 0 05 Sep 2021
Learning to Prompt for Vision-Language Models Kaiyang Zhou Jingkang Yang Chen Change Loy Ziwei Liu VPVLM CLIP VLM 548 2,444 0 02 Sep 2021
Towards Out-Of-Distribution Generalization: A Survey Jiashuo Liu Zheyan Shen Yue He Xingxuan Zhang Renzhe Xu Han Yu Peng Cui CML OOD 168 536 0 31 Aug 2021
Delving Deep into the Generalization of Vision Transformers under Distribution Shifts Chongzhi Zhang Mingyuan Zhang Shanghang Zhang Daisheng Jin Qiang-feng Zhou Zhongang Cai Haiyu Zhao Xianglong Liu Ziwei Liu 69 105 0 14 Jun 2021
Invariant Information Bottleneck for Domain Generalization Yue Liu Yifei Shen Yezhen Wang Wenzhen Zhu Colorado Reed Jun Zhang Dongsheng Li Kurt Keutzer Han Zhao OOD 97 116 0 11 Jun 2021
SAND-mask: An Enhanced Gradient Masking Strategy for the Discovery of Invariances in Domain Generalization Soroosh Shahtalebi Jean-Christophe Gagnon-Audet Touraj Laleh Mojtaba Faramarzi Kartik Ahuja Irina Rish 85 61 0 04 Jun 2021
SelfReg: Self-supervised Contrastive Regularization for Domain Generalization Daehee Kim Seunghyun Park Jinkyu Kim Jaekoo Lee OOD SSL 137 273 0 20 Apr 2021
Deep Stable Learning for Out-Of-Distribution Generalization Xingxuan Zhang Peng Cui Renzhe Xu Linjun Zhou Yue He Zheyan Shen OOD 90 259 0 16 Apr 2021
Domain Generalization with MixStyle Kaiyang Zhou Yongxin Yang Yu Qiao Tao Xiang 149 763 0 05 Apr 2021
Generalizing to Unseen Domains: A Survey on Domain Generalization Jindong Wang Cuiling Lan Chang-Shu Liu Yidong Ouyang Tao Qin Wang Lu Yiqiang Chen Wenjun Zeng Philip S. Yu OOD 280 1,240 0 02 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 1.1K 30,053 0 26 Feb 2021
ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks Jungmin Kwon Jeongseop Kim Hyunseong Park I. Choi 126 291 0 23 Feb 2021
Model-Based Domain Generalization Alexander Robey George J. Pappas Hamed Hassani OOD 151 131 0 23 Feb 2021
SWAD: Domain Generalization by Seeking Flat Minima Junbum Cha Sanghyuk Chun Kyungjae Lee Han-Cheol Cho Seunghyun Park Yunsung Lee Sungrae Park MoMe 311 460 0 17 Feb 2021
Does Invariant Risk Minimization Capture Invariance? Pritish Kamath Akilesh Tangella Danica J. Sutherland Nathan Srebro OOD 281 128 0 04 Jan 2021
DecAug: Out-of-Distribution Generalization via Decomposed Feature Representation and Semantic Augmentation Haoyue Bai Rui Sun Lanqing Hong Fengwei Zhou Nanyang Ye Han-Jia Ye Shueng-Han Gary Chan Zhenguo Li OOD OODD CML 96 79 0 17 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 744 41,796 0 22 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 236 1,361 0 03 Oct 2020
Learning Soft Labels via Meta Learning Nidhi Vyas Shreyas Saxena T. Voice NoLa 83 30 0 20 Sep 2020
Learning explanations that are hard to vary Giambattista Parascandolo Alexander Neitz Antonio Orvieto Luigi Gresele Bernhard Schölkopf FAtt 86 187 0 01 Sep 2020
Learning to Learn with Variational Information Bottleneck for Domain Generalization Yingjun Du Jun Xu Huan Xiong Qiang Qiu Xiantong Zhen Cees G. M. Snoek Ling Shao BDL OOD 80 169 0 15 Jul 2020
Self-Challenging Improves Cross-Domain Generalization Zeyi Huang Haohan Wang Eric Xing Dong Huang OOD 102 636 0 05 Jul 2020
In Search of Lost Domain Generalization Ishaan Gulrajani David Lopez-Paz OOD 139 1,159 0 02 Jul 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 282 3,016 0 09 Jun 2020