Snapshot Ensembles: Train 1, get M for free

1 April 2017

Gao Huang

Papers citing "Snapshot Ensembles: Train 1, get M for free"

50 / 445 papers shown

Title
Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost Lu Yin Shiwei Liu Fang Meng Tianjin Huang Vlado Menkovski Mykola Pechenizkiy 64 13 0 23 Aug 2022
SiRi: A Simple Selective Retraining Mechanism for Transformer-based Visual Grounding Mengxue Qu Yu Wu Wu Liu Qiqi Gong Xiaodan Liang Olga Russakovsky Yao Zhao Yunchao Wei ObjD 50 24 0 27 Jul 2022
Improving Predictive Performance and Calibration by Weight Fusion in Semantic Segmentation Timo Sämann A. Hammam Andrei Bursuc Christoph Stiller H. Groß FedML 55 1 0 22 Jul 2022
YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors Chien-Yao Wang Alexey Bochkovskiy H. Liao ObjD 185 6,678 0 06 Jul 2022
RegMixup: Mixup as a Regularizer Can Surprisingly Improve Accuracy and Out Distribution Robustness Francesco Pinto Harry Yang Ser-Nam Lim Philip Torr P. Dokania UQCV 104 37 0 29 Jun 2022
Left Heavy Tails and the Effectiveness of the Policy and Value Networks in DNN-based best-first search for Sokoban Planning Dieqiao Feng Carla P. Gomes B. Selman 81 2 0 28 Jun 2022
Effective training-time stacking for ensembling of deep neural networks P. Proskura Alexey Zaytsev 39 7 0 27 Jun 2022
Transfer learning for ensembles: reducing computation time and keeping the diversity Ilya Shashkov Nikita Balabin Evgeny Burnaev Alexey Zaytsev 97 1 0 27 Jun 2022
A Geometric Method for Improved Uncertainty Estimation in Real-time Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 65 0 0 23 Jun 2022
When Does Re-initialization Work? Sheheryar Zaidi Tudor Berariu Hyunjik Kim J. Bornschein Claudia Clopath Yee Whye Teh Razvan Pascanu 68 11 0 20 Jun 2022
Modeling Generalized Specialist Approach To Train Quality Resilient Snapshot Ensemble G. Tahir C. K. Loo Zongying Liu AAML 32 0 0 12 Jun 2022
Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding Yichen Liu C. Wang Defang Chen Zhehui Zhou Yan Feng Chun-Yen Chen 133 0 0 07 Jun 2022
Star algorithm for NN ensembling Sergey Zinchenko Dmitry Lishudi FedML 33 0 0 01 Jun 2022
FiLM-Ensemble: Probabilistic Deep Learning via Feature-wise Linear Modulation Mehmet Özgür Türkoglu Alexander Becker H. Gündüz Mina Rezaei Bernd Bischl Rodrigo Caye Daudt Stefano Dáronco Jan Dirk Wegner Konrad Schindler FedML UQCV 135 28 0 31 May 2022
Superposing Many Tickets into One: A Performance Booster for Sparse Neural Network Training Lu Yin Vlado Menkovski Meng Fang Tianjin Huang Yulong Pei Mykola Pechenizkiy Decebal Constantin Mocanu Shiwei Liu 128 8 0 30 May 2022
ELODI: Ensemble Logit Difference Inhibition for Positive-Congruent Training Yue Zhao Yantao Shen Yuanjun Xiong Shuo Yang Wei Xia Zhuowen Tu Bernt Shiele Stefano Soatto BDL 103 6 0 12 May 2022
Jacobian Ensembles Improve Robustness Trade-offs to Adversarial Attacks Kenneth T. Co David Martínez-Rego Zhongyuan Hau Emil C. Lupu AAML 39 5 0 19 Apr 2022
RubCSG at SemEval-2022 Task 5: Ensemble learning for identifying misogynous MEMEs Wentao Yu Benedikt T. Boenninghoff Jonas Roehrig D. Kolossa 44 3 0 08 Apr 2022
DeepTensor: Low-Rank Tensor Decomposition with Deep Network Priors Vishwanath Saragadam Randall Balestriero Ashok Veeraraghavan Richard G. Baraniuk 97 19 0 07 Apr 2022
Discovering and forecasting extreme events via active learning in neural operators Ethan Pickering Stephen Guth George Karniadakis T. Sapsis AI4CE 82 59 0 05 Apr 2022
Learning Structured Gaussians to Approximate Deep Ensembles Ivor J. A. Simpson Sara Vicente Neill D. F. Campbell UQCV 42 10 0 29 Mar 2022
Single Model Ensemble for Subword Regularized Models in Low-Resource Machine Translation Sho Takase Tatsuya Hiraoka Naoaki Okazaki 44 5 0 25 Mar 2022
RD-Optimized Trit-Plane Coding of Deep Compressed Image Latent Tensors S. Jeon Jae-Han Lee Chang-Su Kim 60 2 0 25 Mar 2022
Hyperbolic Uncertainty Aware Semantic Segmentation Bike Chen Wei Peng Xiaofeng Cao Juha Roning UQCV 109 17 0 16 Mar 2022
Layer Ensembles: A Single-Pass Uncertainty Estimation in Deep Learning for Segmentation Kaisar Kushibar Víctor M. Campello Lidia Garrucho Moras Akis Linardos Petia Radeva Karim Lekadir UQCV 61 18 0 16 Mar 2022
Reducing Flipping Errors in Deep Neural Networks Xiang Deng Yun Xiao Bo Long Zhongfei Zhang AAML 46 4 0 16 Mar 2022
Structure and Distribution Metric for Quantifying the Quality of Uncertainty: Assessing Gaussian Processes, Deep Neural Nets, and Deep Neural Operators for Regression Ethan Pickering T. Sapsis UQCV 54 6 0 09 Mar 2022
Boosted Ensemble Learning based on Randomized NNs for Time Series Forecasting Grzegorz Dudek AI4TS 58 1 0 02 Mar 2022
Learn From the Past: Experience Ensemble Knowledge Distillation Chaofei Wang Shaowei Zhang S. Song Gao Huang 94 4 0 25 Feb 2022
Embedded Ensembles: Infinite Width Limit and Operating Regimes Maksim Velikanov Roma Kail Ivan Anokhin Roman Vashurin Maxim Panov Alexey Zaytsev Dmitry Yarotsky 49 1 0 24 Feb 2022
Prune and Tune Ensembles: Low-Cost Ensemble Learning With Sparse Independent Subnetworks Tim Whitaker L. D. Whitley UQCV 52 26 0 23 Feb 2022
Continual Learning Beyond a Single Model T. Doan Seyed Iman Mirzadeh Mehrdad Farajtabar CLL 92 16 0 20 Feb 2022
Ensemble Learning techniques for object detection in high-resolution satellite images A. Vilhelm Matthieu Limbert Clement Audebert Tugdual Ceillier ObjD 27 1 0 16 Feb 2022
ActionFormer: Localizing Moments of Actions with Transformers Chen-Da Liu-Zhang Jianxin Wu Yin Li ViT 126 342 0 16 Feb 2022
Deep Ensembles Work, But Are They Necessary? Taiga Abe E. Kelly Buchanan Geoff Pleiss R. Zemel John P. Cunningham OOD UQCV 149 65 0 14 Feb 2022
PFGE: Parsimonious Fast Geometric Ensembling of DNNs Hao Guo Jiyong Jin B. Liu FedML 84 1 0 14 Feb 2022
When Do Flat Minima Optimizers Work? Jean Kaddour Linqing Liu Ricardo M. A. Silva Matt J. Kusner ODL 142 65 0 01 Feb 2022
Learning Proximal Operators to Discover Multiple Optima Lingxiao Li Noam Aigerman Vladimir G. Kim Jiajin Li Kristjan Greenewald Mikhail Yurochkin Justin Solomon 96 1 0 28 Jan 2022
Improving robustness and calibration in ensembles with diversity regularization H. A. Mehrtens Camila González Anirban Mukhopadhyay UQCV 57 7 0 26 Jan 2022
ML4CO-KIDA: Knowledge Inheritance in Dataset Aggregation Zixuan Cao Yang Xu Zhewei Huang Shuchang Zhou 199 8 0 25 Jan 2022
EASY: Ensemble Augmented-Shot Y-shaped Learning: State-Of-The-Art Few-Shot Classification with Simple Ingredients Yassir Bendou Yuqing Hu Raphael Lafargue G. Lioi Bastien Pasdeloup S. Pateux Vincent Gripon VLM 114 38 0 24 Jan 2022
Stochastic Weight Averaging Revisited Hao Guo Jiyong Jin B. Liu 97 30 0 03 Jan 2022
SAE: Sequential Anchored Ensembles Arnaud Delaunoy Gilles Louppe UQCV BDL 55 0 0 30 Dec 2021
Semi-supervised Salient Object Detection with Effective Confidence Estimation Jiawei Liu Jing Zhang Nick Barnes 78 5 0 28 Dec 2021
Efficient Diversity-Driven Ensemble for Deep Neural Networks Wentao Zhang Jiawei Jiang Yingxia Shao Tengjiao Wang 79 18 0 26 Dec 2021
DPICT: Deep Progressive Image Compression Using Trit-Planes Jae-Han Lee S. Jeon K. Choi Youngo Park Chang-Su Kim 80 29 0 12 Dec 2021
Model-Value Inconsistency as a Signal for Epistemic Uncertainty Angelos Filos Eszter Vértes Zita Marinho Gregory Farquhar Diana Borsa A. Friesen Feryal M. P. Behbahani Tom Schaul André Barreto Simon Osindero 104 7 0 08 Dec 2021
On the Effectiveness of Mode Exploration in Bayesian Model Averaging for Neural Networks J. Holodnak Allan B. Wollaber UQCV BDL 39 0 0 07 Dec 2021
Challenges and Opportunities in Approximate Bayesian Deep Learning for Intelligent IoT Systems Meet P. Vadera Benjamin M. Marlin UQCV BDL 49 5 0 03 Dec 2021
Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Method Wenda Qin Teruhisa Misu Derry Wijaya UQCV LM&Ro 83 5 0 28 Nov 2021