v1v2v3 (latest)

Averaging Weights Leads to Wider Optima and Better Generalization

14 March 2018

Dmitry Vetrov

Papers citing "Averaging Weights Leads to Wider Optima and Better Generalization"

50 / 1,040 papers shown

Title
Truly Sparse Neural Networks at Scale Selima Curci Decebal Constantin Mocanu Mykola Pechenizkiy 141 22 0 02 Feb 2021
PSLA: Improving Audio Tagging with Pretraining, Sampling, Labeling, and Aggregation Yuan Gong Yu-An Chung James R. Glass VLM 199 147 0 02 Feb 2021
Information-Theoretic Generalization Bounds for Stochastic Gradient Descent Gergely Neu Gintare Karolina Dziugaite Mahdi Haghifam Daniel M. Roy 128 90 0 01 Feb 2021
Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss Xue Yang Junchi Yan Qi Ming Wentao Wang Xiaopeng Zhang Qi Tian 222 414 0 28 Jan 2021
Exponential Moving Average Normalization for Self-supervised and Semi-supervised Learning Zhaowei Cai Avinash Ravichandran Subhransu Maji Charless C. Fowlkes Zhuowen Tu Stefano Soatto 131 120 0 21 Jan 2021
A Survey on Ensemble Learning under the Era of Deep Learning Yongquan Yang Haijun Lv Ning Chen OOD 156 206 0 21 Jan 2021
A Bayesian neural network predicts the dissolution of compact planetary systems M. Cranmer Daniel Tamayo H. Rein Peter W. Battaglia S. Hadden P. Armitage S. Ho D. Spergel BDL 112 28 0 11 Jan 2021
LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text Classification Ting Jiang Deqing Wang Leilei Sun Huayi Yang Zhengyang Zhao Fuzhen Zhuang VLM 204 140 0 09 Jan 2021
Spending Your Winning Lottery Better After Drawing It Ajay Jaiswal Haoyu Ma Tianlong Chen Ying Ding Zhangyang Wang 48 6 0 08 Jan 2021
SmartDeal: Re-Modeling Deep Network Weights for Efficient Inference and Training Xiaohan Chen Yang Zhao Yue Wang Pengfei Xu Haoran You Chaojian Li Y. Fu Yingyan Lin Zhangyang Wang 107 1 0 04 Jan 2021
Gradient Descent Averaging and Primal-dual Averaging for Strongly Convex Optimization Wei Tao Wei Li Zhisong Pan Qing Tao MoMe 39 4 0 29 Dec 2020
SWA Object Detection Haoyang Zhang Ying Wang Feras Dayoub Niko Sünderhauf ObjD 48 36 0 23 Dec 2020
Combating Mode Collapse in GAN training: An Empirical Analysis using Hessian Eigenvalues Ricard Durall Avraam Chatzimichailidis P. Labus J. Keuper GAN 77 62 0 17 Dec 2020
FedADC: Accelerated Federated Learning with Drift Control Emre Ozfatura Kerem Ozfatura Deniz Gunduz FedML 109 38 0 16 Dec 2020
Masksembles for Uncertainty Estimation Nikita Durasov Timur M. Bagautdinov Pierre Baqué Pascal Fua OOD UQCV 78 83 0 15 Dec 2020
DeepLesionBrain: Towards a broader deep-learning generalization for multiple sclerosis lesion segmentation R. A. Kamraoui Vinh-Thong Ta T. Tourdias Boris Mansencal J. V. Manjón Pierrick Coupé OOD 120 54 0 14 Dec 2020
Vilio: State-of-the-art Visio-Linguistic Models applied to Hateful Memes Niklas Muennighoff 85 64 0 14 Dec 2020
Encoding the latent posterior of Bayesian Neural Networks for uncertainty quantification Gianni Franchi Andrei Bursuc Emanuel Aldea Séverine Dubuisson Isabelle Bloch BDL UQCV 94 27 0 04 Dec 2020
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning Daniel Grießhaber J. Maucher Ngoc Thang Vu 85 46 0 04 Dec 2020
Semi-Supervised Learning with Variational Bayesian Inference and Maximum Uncertainty Regularization Kien Do T. Tran Svetha Venkatesh BDL 53 3 0 03 Dec 2020
Is Support Set Diversity Necessary for Meta-Learning? Amrith Rajagopal Setlur Oscar Li Virginia Smith 104 16 0 28 Nov 2020
Bayesian Graph Neural Networks for Molecular Property Prediction George Lamb Brooks Paige 75 12 0 25 Nov 2020
Assessing out-of-domain generalization for robust building damage detection V. Benson Alexander S. Ecker OODD 46 22 0 20 Nov 2020
A Random Matrix Theory Approach to Damping in Deep Learning Diego Granziol Nicholas P. Baskerville AI4CE ODL 86 2 0 15 Nov 2020
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu ... Xiaochun Cao Abbas Khosravi U. Acharya V. Makarenkov S. Nahavandi BDL UQCV 369 1,947 0 12 Nov 2020
SALR: Sharpness-aware Learning Rate Scheduler for Improved Generalization Xubo Yue Maher Nouiehed Raed Al Kontar ODL 38 4 0 10 Nov 2020
Detecting Outliers with Foreign Patch Interpolation Jeremy Tan Benjamin Hou James Batten Huaqi Qiu Bernhard Kainz MedIm 75 49 0 09 Nov 2020
Numerical Exploration of Training Loss Level-Sets in Deep Neural Networks Naveed Tahir Garrett E. Katz 19 0 0 09 Nov 2020
Underspecification Presents Challenges for Credibility in Modern Machine Learning Alexander DÁmour Katherine A. Heller D. Moldovan Ben Adlam B. Alipanahi ... Kellie Webster Steve Yadlowsky T. Yun Xiaohua Zhai D. Sculley OffRL 174 688 0 06 Nov 2020
Amortized Conditional Normalized Maximum Likelihood: Reliable Out of Distribution Uncertainty Estimation Aurick Zhou Sergey Levine BDL OOD UQCV 56 13 0 05 Nov 2020
Combining Domain-Specific Meta-Learners in the Parameter Space for Cross-Domain Few-Shot Classification Shuman Peng Weilian Song Martin Ester 30 3 0 31 Oct 2020
Measuring and Harnessing Transference in Multi-Task Learning Christopher Fifty Ehsan Amid Zhe Zhao Tianhe Yu Rohan Anil Chelsea Finn 104 15 0 29 Oct 2020
Scalable Bayesian neural networks by layer-wise input augmentation Trung Trinh Samuel Kaski Markus Heinonen UQCV BDL 36 3 0 26 Oct 2020
PEP: Parameter Ensembling by Perturbation Alireza Mehrtash Purang Abolmaesumi Polina Golland Tina Kapur Demian Wassermann W. Wells 70 10 0 24 Oct 2020
Decentralized Deep Learning using Momentum-Accelerated Consensus Aditya Balu Zhanhong Jiang Sin Yong Tan Chinmay Hedge Young M. Lee Soumik Sarkar FedML 94 22 0 21 Oct 2020
Combining Ensembles and Data Augmentation can Harm your Calibration Yeming Wen Ghassen Jerfel Rafael Muller Michael W. Dusenberry Jasper Snoek Balaji Lakshminarayanan Dustin Tran UQCV 139 64 0 19 Oct 2020
Consumer Behaviour in Retail: Next Logical Purchase using Deep Neural Network Ankur Verma 21 6 0 14 Oct 2020
Offer Personalization using Temporal Convolution Network and Optimization Ankur Verma 20 1 0 14 Oct 2020
Ensemble Distillation for Structured Prediction: Calibrated, Accurate, Fast-Choose Three Steven Reich David Mueller Nicholas Andrews BDL OOD UQCV 54 13 0 13 Oct 2020
Towards Theoretically Understanding Why SGD Generalizes Better Than ADAM in Deep Learning Pan Zhou Jiashi Feng Chao Ma Caiming Xiong Guosheng Lin E. Weinan 111 235 0 12 Oct 2020
Regularizing Neural Networks via Adversarial Model Perturbation Yaowei Zheng Richong Zhang Yongyi Mao AAML 107 99 0 10 Oct 2020
Uncovering the Limits of Adversarial Training against Norm-Bounded Adversarial Examples Sven Gowal Chongli Qin J. Uesato Timothy A. Mann Pushmeet Kohli AAML 73 331 0 07 Oct 2020
Reconciling Modern Deep Learning with Traditional Optimization Analyses: The Intrinsic Learning Rate Zhiyuan Li Kaifeng Lyu Sanjeev Arora 112 75 0 06 Oct 2020
Multi-Loss Sub-Ensembles for Accurate Classification with Uncertainty Estimation Omer Achrack Raizy Kellerman Ouriel Barzilay UQCV BDL 74 9 0 05 Oct 2020
Sharpness-Aware Minimization for Efficiently Improving Generalization Pierre Foret Ariel Kleiner H. Mobahi Behnam Neyshabur AAML 236 1,361 0 03 Oct 2020
End-to-End Training of CNN Ensembles for Person Re-Identification Ayse Serbetci Y. S. Akgul 46 23 0 03 Oct 2020
SESQA: semi-supervised learning for speech quality assessment Joan Serrà Jordi Pons Santiago Pascual 79 42 0 01 Oct 2020
BAMSProd: A Step towards Generalizing the Adaptive Optimization Methods to Deep Binary Model Junjie Liu Dongchao Wen Deyu Wang Wei Tao Tse-Wei Chen Kinya Osa Masami Kato MQ 44 1 0 29 Sep 2020
Conversational Semantic Parsing Armen Aghajanyan Jean Maillard Akshat Shrivastava K. Diedrick Mike Haeger ... Yashar Mehdad Ves Stoyanov Anuj Kumar M. Lewis S. Gupta 60 49 0 28 Sep 2020
Normalization Techniques in Training DNNs: Methodology, Analysis and Application Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao AI4CE 176 273 0 27 Sep 2020