v1v2v3 (latest)

Averaging Weights Leads to Wider Optima and Better Generalization

14 March 2018

Dmitry Vetrov

Papers citing "Averaging Weights Leads to Wider Optima and Better Generalization"

50 / 1,040 papers shown

Title
Flat minima generalize for low-rank matrix recovery Lijun Ding Dmitriy Drusvyatskiy Maryam Fazel Zaid Harchaoui 82 18 0 07 Mar 2022
Low-Loss Subspace Compression for Clean Gains against Multi-Agent Backdoor Attacks Siddhartha Datta N. Shadbolt AAML 79 6 0 07 Mar 2022
Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priors Yibo Yang Georgios Kissas P. Perdikaris BDL UQCV 88 42 0 06 Mar 2022
Ensembles of Vision Transformers as a New Paradigm for Automated Classification in Ecology S. Kyathanahally T. Hardeman M. Reyes E. Merz T. Bulas P. Brun F. Pomati Marco Baity-Jesi 72 16 0 03 Mar 2022
Towards a Common Speech Analysis Engine Hagai Aronowitz Itai Gat E. Morais Weizhong Zhu R. Hoory 56 3 0 01 Mar 2022
Adversarial robustness of sparse local Lipschitz predictors Ramchandran Muthukumar Jeremias Sulam AAML 92 13 0 26 Feb 2022
UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography Francisca Vasconcelos Bobby He Nalini Singh Yee Whye Teh BDL OOD UQCV 76 13 0 22 Feb 2022
Robustness and Accuracy Could Be Reconcilable by (Proper) Definition Tianyu Pang Min Lin Xiao Yang Junyi Zhu Shuicheng Yan 120 124 0 21 Feb 2022
Interacting Contour Stochastic Gradient Langevin Dynamics Wei Deng Siqi Liang Botao Hao Guang Lin F. Liang BDL 81 10 0 20 Feb 2022
Sparsity Winning Twice: Better Robust Generalization from More Efficient Training Tianlong Chen Zhenyu Zhang Pengju Wang Santosh Balachandra Haoyu Ma Zehao Wang Zhangyang Wang OOD AAML 149 50 0 20 Feb 2022
Ensemble Learning techniques for object detection in high-resolution satellite images A. Vilhelm Matthieu Limbert Clement Audebert Tugdual Ceillier ObjD 25 1 0 16 Feb 2022
PFGE: Parsimonious Fast Geometric Ensembling of DNNs Hao Guo Jiyong Jin B. Liu FedML 76 1 0 14 Feb 2022
Neural Models for Output-Space Invariance in Combinatorial Problems Yatin Nandwani Vidit Jain Mausam Parag Singla AAML 84 2 0 07 Feb 2022
Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data Yaoqing Yang Ryan Theisen Liam Hodgkinson Joseph E. Gonzalez Kannan Ramchandran Charles H. Martin Michael W. Mahoney 148 18 0 06 Feb 2022
When Do Flat Minima Optimizers Work? Jean Kaddour Linqing Liu Ricardo M. A. Silva Matt J. Kusner ODL 142 64 0 01 Feb 2022
Stabilizing Spiking Neuron Training Luca Herranz-Celotti Jean Rouat 56 3 0 01 Feb 2022
Stochastic Neural Networks with Infinite Width are Deterministic Liu Ziyin Hanlin Zhang Xiangming Meng Yuting Lu Eric P. Xing Masakuni Ueda 98 3 0 30 Jan 2022
Zeroth-Order Actor-Critic: An Evolutionary Framework for Sequential Decision Problems Yuheng Lei Jianyu Chen Guojian Zhan Tao Zhang Jiangtao Li Jianyu Chen Shengbo Eben Li Sifa Zheng OffRL 82 3 0 29 Jan 2022
Born-Infeld (BI) for AI: Energy-Conserving Descent (ECD) for Optimization G. Luca E. Silverstein 73 11 0 26 Jan 2022
ML4CO-KIDA: Knowledge Inheritance in Dataset Aggregation Zixuan Cao Yang Xu Zhewei Huang Shuchang Zhou 199 8 0 25 Jan 2022
Constrained Policy Optimization via Bayesian World Models Yarden As Ilnura N. Usmanova Sebastian Curi Andreas Krause OffRL 108 55 0 24 Jan 2022
Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape Devansh Bisla Jing Wang A. Choromańska 106 37 0 20 Jan 2022
Online, Informative MCMC Thinning with Kernelized Stein Discrepancy Cole Hawkins Alec Koppel Zheng Zhang 75 4 0 18 Jan 2022
On generalization bounds for deep networks based on loss surface implicit regularization Masaaki Imaizumi Johannes Schmidt-Hieber ODL 77 3 0 12 Jan 2022
SpectraNet: Learned Recognition of Artificial Satellites From High Contrast Spectroscopic Imagery J. Gazak Ian McQuaid R. Swindle M. Phelps Justin Fletcher 54 16 0 10 Jan 2022
Stochastic Weight Averaging Revisited Hao Guo Jiyong Jin B. Liu 91 30 0 03 Jan 2022
Improving the Behaviour of Vision Transformers with Token-consistent Stochastic Layers Nikola Popovic D. Paudel Thomas Probst Luc Van Gool 78 1 0 30 Dec 2021
SAE: Sequential Anchored Ensembles Arnaud Delaunoy Gilles Louppe UQCV BDL 53 0 0 30 Dec 2021
MVDG: A Unified Multi-view Framework for Domain Generalization Jian Zhang Lei Qi Yinghuan Shi Yang Gao 81 31 0 23 Dec 2021
A Convergent ADMM Framework for Efficient Neural Network Training Junxiang Wang Hongyi Li Liang Zhao 70 1 0 22 Dec 2021
Anomaly Discovery in Semantic Segmentation via Distillation Comparison Networks Huan Zhou Shi Gong Yu Zhou Zengqiang Zheng Ronghua Liu Xiang Bai 64 1 0 18 Dec 2021
AFDetV2: Rethinking the Necessity of the Second Stage for Object Detection from Point Clouds Yihan Hu Zhuangzhuang Ding Runzhou Ge Wenxin Shao Li Huang Kun Li Qiang Liu 3DPC 81 134 0 16 Dec 2021
Sharpness-Aware Minimization with Dynamic Reweighting Wenxuan Zhou Fangyu Liu Huan Zhang Muhao Chen AAML 50 8 0 16 Dec 2021
5th Place Solution for VSPW 2021 Challenge Jiafan Zhuang Y. Zhang Xinyu Hu Jianing Li Zilei Wang 22 0 0 13 Dec 2021
Information is Power: Intrinsic Control via Information Capture Nick Rhinehart Jenny Wang Glen Berseth John D. Co-Reyes Danijar Hafner Chelsea Finn Sergey Levine 60 9 0 07 Dec 2021
Probabilistic Deep Learning to Quantify Uncertainty in Air Quality Forecasting Abdulmajid Murad F. Kraemer Kerstin Bach Gavin Taylor OOD BDL UQCV 40 12 0 05 Dec 2021
Multi-task fusion for improving mammography screening data classification M. Wimmer Gert Sluiter David Major Dimitrios Lenis Astrid Berg Theresa Neubauer Katja Bühler 52 10 0 01 Dec 2021
Efficient Online Bayesian Inference for Neural Bandits Gerardo Duran-Martín Aleyna Kara Kevin Patrick Murphy BDL 69 16 0 01 Dec 2021
Multi-Channel Multi-Speaker ASR Using 3D Spatial Feature Yiwen Shao Shi-Xiong Zhang Dong Yu 88 15 0 22 Nov 2021
MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weather Sylwester Klocek Haiyu Dong M. Dixon Panashe Kanengoni Najeeb Kazmi Pete Luferenko Zhongjian Lv Shikhar Sharma Jonathan A. Weyn Siqi Xiang AI4Cl 87 23 0 18 Nov 2021
How Emotionally Stable is ALBERT? Testing Robustness with Stochastic Weight Averaging on a Sentiment Analysis Task Urja Khurana Eric T. Nalisnick Antske Fokkens MoMe 65 6 0 18 Nov 2021
A strong baseline for image and video quality assessment Shaoguo Wen Junle Wang 79 16 0 13 Nov 2021
Exploiting all samples in low-resource sentence classification: early stopping and initialization parameters Hongseok Choi Hyunju Lee 46 3 0 12 Nov 2021
Robust deep learning-based semantic organ segmentation in hyperspectral images Silvia Seidlitz Jiansheng Fang Jan Odenthal Berkin Özdemir Huazhu Fu ... Jiang-Dong Liu Martin Wagner Felix Nickel Beat P. Müller-Stich Lena Maier-Hein 74 11 0 09 Nov 2021
Data Augmentation Can Improve Robustness Sylvestre-Alvise Rebuffi Sven Gowal D. A. Calian Florian Stimberg Olivia Wiles Timothy A. Mann AAML 65 292 0 09 Nov 2021
The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning Raed Al Kontar Naichen Shi Xubo Yue Seokhyun Chung E. Byon ... Chinedum Okwudire Garvesh Raskutti R. Saigal Karandeep Singh Ye Zhisheng FedML 109 53 0 09 Nov 2021
A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications Xinlei Zhou Han Liu Farhad Pourpanah T. Zeng Xizhao Wang UQCV UD 124 61 0 03 Nov 2021
Resampling Base Distributions of Normalizing Flows Vincent Stimper Bernhard Schölkopf José Miguel Hernández-Lobato BDL 96 33 0 29 Oct 2021
Meta-learning with an Adaptive Task Scheduler Huaxiu Yao Yu Wang Ying Wei P. Zhao M. Mahdavi Defu Lian Chelsea Finn OOD 84 48 0 26 Oct 2021
Persona Authentication through Generative Dialogue Fengyi Tang Lifan Zeng Fei Wang Jiayu Zhou 97 8 0 25 Oct 2021