Snapshot Ensembles: Train 1, get M for free

1 April 2017

Gao Huang

Papers citing "Snapshot Ensembles: Train 1, get M for free"

50 / 441 papers shown

Title
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging Fabian David Schmidt Ivan Vulić Goran Glavaš 24 8 0 26 May 2023
Transferring Learning Trajectories of Neural Networks Daiki Chijiwa 31 3 0 23 May 2023
Logit-Based Ensemble Distribution Distillation for Robust Autoregressive Sequence Uncertainties Yassir Fathullah Guoxuan Xia Mark Gales UQCV 35 2 0 17 May 2023
Securing Distributed SGD against Gradient Leakage Threats Wenqi Wei Ling Liu Jingya Zhou Ka-Ho Chow Yanzhao Wu FedML 34 18 0 10 May 2023
Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forces Jonas Busk Mikkel N. Schmidt Ole Winther Tejs Vegge Peter Bjørn Jørgensen 19 9 0 10 May 2023
ZipIt! Merging Models from Different Tasks without Training George Stoica Daniel Bolya J. Bjorner Pratik Ramesh Taylor N. Hearn Judy Hoffman VLM MoMe 52 111 0 04 May 2023
Hierarchical Weight Averaging for Deep Neural Networks Xiaozhe Gu Zixun Zhang Yuncheng Jiang Yaoyu Zhang Ruimao Zhang Shuguang Cui Zhuguo Li 27 5 0 23 Apr 2023
Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learning Hanjing Wang D. Joshi Shiqiang Wang Q. Ji UQCV BDL 16 6 0 10 Apr 2023
Reweighted Mixup for Subpopulation Shift Zongbo Han Zhipeng Liang Fan Yang Liu Liu Lanqing Li ... P. Zhao Qinghua Hu Bing Wu Changqing Zhang Jianhua Yao 37 3 0 09 Apr 2023
Uncertainty-inspired Open Set Learning for Retinal Anomaly Identification Meng Wang Tian Lin Lianyu Wang Aidi Lin K. Zou ... Yong-Jin Liu C. Pang Xinjian Chen Haoyu Chen Huazhu Fu 111 36 0 08 Apr 2023
ASPEST: Bridging the Gap Between Active Learning and Selective Prediction Jiefeng Chen Jinsung Yoon Sayna Ebrahimi Sercan Ö. Arik S. Jha Tomas Pfister 36 1 0 07 Apr 2023
ERM++: An Improved Baseline for Domain Generalization Piotr Teterwak Kuniaki Saito Theodoros Tsiligkaridis Kate Saenko Bryan A. Plummer OOD 44 9 0 04 Apr 2023
A Survey of Historical Learning: Learning Models with Learning History Xiang Li Ge Wu Lingfeng Yang Wenzhe Wang Renjie Song Jian Yang MU AI4TS 31 2 0 23 Mar 2023
TemporalMaxer: Maximize Temporal Context with only Max Pooling for Temporal Action Localization Tuan N. Tang Kwonyoung Kim Kwanghoon Sohn 29 29 0 16 Mar 2023
Deep incremental learning models for financial temporal tabular datasets with distribution shifts Thomas Wong Mauricio Barahona OOD AIFin AI4TS 23 0 0 14 Mar 2023
Dynamic Y-KD: A Hybrid Approach to Continual Instance Segmentation M. Fortin B. Chaib-draa CLL 24 1 0 10 Mar 2023
Context-Based Trit-Plane Coding for Progressive Image Compression S. Jeon K. Choi Youngo Park Chang-Su Kim 30 17 0 10 Mar 2023
To Stay or Not to Stay in the Pre-train Basin: Insights on Ensembling in Transfer Learning Ildus Sadrtdinov Dmitrii Pozdeev Dmitry Vetrov E. Lobacheva 35 4 0 06 Mar 2023
Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation Rui Zhao Wei Li Zhipeng Hu Lincheng Li Zhengxia Zou Z. Shi Changjie Fan 41 18 0 02 Mar 2023
Personalized Privacy-Preserving Framework for Cross-Silo Federated Learning Van Tuan Tran Huy Hieu Pham Kok-Seng Wong FedML 44 7 0 22 Feb 2023
Seasoning Model Soups for Robustness to Adversarial and Natural Distribution Shifts Francesco Croce Sylvestre-Alvise Rebuffi Evan Shelhamer Sven Gowal AAML 42 17 0 20 Feb 2023
Interpretable Diversity Analysis: Visualizing Feature Representations In Low-Cost Ensembles Tim Whitaker L. D. Whitley 13 0 0 12 Feb 2023
Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD than Constant Stepsize Mert Gurbuzbalaban Yuanhan Hu Umut Simsekli Lingjiong Zhu LRM 23 1 0 10 Feb 2023
Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications Chengyu Dong OOD UQCV BDL AI4CE 39 0 0 02 Feb 2023
Towards Inference Efficient Deep Ensemble Learning Ziyue Li Kan Ren Yifan Yang Xinyang Jiang Yuqing Yang Dongsheng Li BDL 29 12 0 29 Jan 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 35 0 0 11 Jan 2023
Does image resolution impact chest X-ray based fine-grained Tuberculosis-consistent lesion segmentation? S. Rajaraman Feng Yang Ghada Zamzmi Z. Xue Sameer Kiran Antani 29 0 0 10 Jan 2023
Deep Negative Correlation Classification Le Zhang Qibin Hou Yun-Hai Liu Jiawang Bian Xun Xu Qiufeng Wang Ce Zhu 34 1 0 14 Dec 2022
Efficient Bayesian Uncertainty Estimation for nnU-Net Yidong Zhao Changchun Yang Artur M. Schweidtmann Qian Tao UQCV BDL 27 20 0 12 Dec 2022
Deep Learning for Brain Age Estimation: A Systematic Review Md. Iftekhar Tanveer M. A. Ganaie I. Beheshti Tripti Goel Nehal Ahmad Kuan-Ting Lai Kaizhu Huang Yudong Zhang Javier Del Ser Chin-Teng Lin 38 86 0 07 Dec 2022
Instability in clinical risk stratification models using deep learning D. Martinez A. Yakubovich Martin G. Seneviratne Á. Lelkes Akshit Tyagi ... N. L. Downing Ron C. Li Keith Morse N. Shah Ming-Jun Chen OOD 31 2 0 20 Nov 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 29 15 0 18 Nov 2022
Augmentation by Counterfactual Explanation -- Fixing an Overconfident Classifier Sumedha Singla Nihal Murali Forough Arabshahi Sofia Triantafyllou Kayhan Batmanghelich CML 59 5 0 21 Oct 2022
Revisiting Checkpoint Averaging for Neural Machine Translation Yingbo Gao Christian Herold Zijian Yang Hermann Ney MoMe 29 11 0 21 Oct 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 46 32 0 17 Oct 2022
Efficient Knowledge Distillation from Model Checkpoints Chaofei Wang Qisen Yang Rui Huang S. Song Gao Huang FedML 14 35 0 12 Oct 2022
Deep Combinatorial Aggregation Yuesong Shen Daniel Cremers OOD UQCV 19 4 0 12 Oct 2022
Sequential Ensembling for Semantic Segmentation Rawal Khirodkar Brandon A. Smith Siddhartha Chandra Amit Agrawal A. Criminisi 40 2 0 08 Oct 2022
Leveraging variational autoencoders for multiple data imputation Breeshey Roskams-Hieter J. Wells S. Wade DRL 33 5 0 30 Sep 2022
Training neural network ensembles via trajectory sampling Jamie F. Mair Dominic C. Rose J. P. Garrahan 24 2 0 22 Sep 2022
UMIX: Improving Importance Weighting for Subpopulation Shift via Uncertainty-Aware Mixup Zongbo Han Zhipeng Liang Fan Yang Liu Liu Lanqing Li Yatao Bian P. Zhao Bing Wu Changqing Zhang Jianhua Yao 56 34 0 19 Sep 2022
Sample-based Uncertainty Quantification with a Single Deterministic Neural Network T. Kanazawa Chetan Gupta UQCV 37 4 0 17 Sep 2022
TEDL: A Two-stage Evidential Deep Learning Method for Classification Uncertainty Quantification Xue Li Wei Shen Denis Xavier Charles UQCV EDL 54 3 0 12 Sep 2022
Ensembling Neural Networks for Improved Prediction and Privacy in Early Diagnosis of Sepsis Shigehiko Schamoni Michael Hagmann Stefan Riezler FedML 21 4 0 01 Sep 2022
NeuralUQ: A comprehensive library for uncertainty quantification in neural differential equations and operators Zongren Zou Xuhui Meng Apostolos F. Psaros George Karniadakis AI4CE 34 37 0 25 Aug 2022
Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost Lu Yin Shiwei Liu Fang Meng Tianjin Huang Vlado Menkovski Mykola Pechenizkiy 25 13 0 23 Aug 2022
SiRi: A Simple Selective Retraining Mechanism for Transformer-based Visual Grounding Mengxue Qu Yu Wu Wu Liu Qiqi Gong Xiaodan Liang Olga Russakovsky Yao Zhao Yunchao Wei ObjD 19 22 0 27 Jul 2022
Improving Predictive Performance and Calibration by Weight Fusion in Semantic Segmentation Timo Sämann A. Hammam Andrei Bursuc Christoph Stiller H. Groß FedML 38 1 0 22 Jul 2022
YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors Chien-Yao Wang Alexey Bochkovskiy H. Liao ObjD 53 6,265 0 06 Jul 2022
RegMixup: Mixup as a Regularizer Can Surprisingly Improve Accuracy and Out Distribution Robustness Francesco Pinto Harry Yang Ser-Nam Lim Philip Torr P. Dokania UQCV 35 34 0 29 Jun 2022