Snapshot Ensembles: Train 1, get M for free

1 April 2017

Gao Huang

Papers citing "Snapshot Ensembles: Train 1, get M for free"

50 / 445 papers shown

Title
Lookaround Optimizer: $k$ steps around, 1 step average Jiangtao Zhang Shunyu Liu Mingli Song Tongtian Zhu Zhenxing Xu Mingli Song MoMe 116 6 0 13 Jun 2023
Population-Based Evolutionary Gaming for Unsupervised Person Re-identification Yunpeng Zhai Peixi Peng Mengxi Jia Shiyong Li Weiqiang Chen Xuesong Gao Yonghong Tian 81 14 0 08 Jun 2023
Optimal Transport Model Distributional Robustness Van-Anh Nguyen Trung Le Anh Tuan Bui Thanh-Toan Do Dinh Q. Phung OOD 85 4 0 07 Jun 2023
The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles Md Shamim Hussain Mohammed J Zaki D. Subramanian 173 3 0 02 Jun 2023
infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information Jaehyung Kim Yekyung Kim Karin de Langis Jinwoo Shin Dongyeop Kang 59 1 0 30 May 2023
Free Lunch: Robust Cross-Lingual Transfer via Model Checkpoint Averaging Fabian David Schmidt Ivan Vulić Goran Glavaš 75 9 0 26 May 2023
Transferring Learning Trajectories of Neural Networks Daiki Chijiwa 67 3 0 23 May 2023
Logit-Based Ensemble Distribution Distillation for Robust Autoregressive Sequence Uncertainties Yassir Fathullah Guoxuan Xia Mark Gales UQCV 63 5 0 17 May 2023
Securing Distributed SGD against Gradient Leakage Threats Wenqi Wei Ling Liu Jingya Zhou Ka-Ho Chow Yanzhao Wu FedML 68 19 0 10 May 2023
Graph Neural Network Interatomic Potential Ensembles with Calibrated Aleatoric and Epistemic Uncertainty on Energy and Forces Jonas Busk Mikkel N. Schmidt Ole Winther Tejs Vegge Peter Bjørn Jørgensen 56 9 0 10 May 2023
ZipIt! Merging Models from Different Tasks without Training George Stoica Daniel Bolya J. Bjorner Pratik Ramesh Taylor N. Hearn Judy Hoffman VLM MoMe 141 125 0 04 May 2023
Hierarchical Weight Averaging for Deep Neural Networks Xiaozhe Gu Zixun Zhang Yuncheng Jiang Yaoyu Zhang Ruimao Zhang Shuguang Cui Zhuguo Li 64 5 0 23 Apr 2023
Gradient-based Uncertainty Attribution for Explainable Bayesian Deep Learning Hanjing Wang D. Joshi Shiqiang Wang Q. Ji UQCV BDL 56 6 0 10 Apr 2023
Reweighted Mixup for Subpopulation Shift Zongbo Han Zhipeng Liang Fan Yang Liu Liu Lanqing Li ... P. Zhao Qinghua Hu Bing Wu Changqing Zhang Jianhua Yao 60 3 0 09 Apr 2023
Uncertainty-inspired Open Set Learning for Retinal Anomaly Identification Meng Wang Tian Lin Lianyu Wang Aidi Lin K. Zou ... Yang Liu C. Pang Xinjian Chen Haoyu Chen Huazhu Fu 208 39 0 08 Apr 2023
ASPEST: Bridging the Gap Between Active Learning and Selective Prediction Jiefeng Chen Jinsung Yoon Sayna Ebrahimi Sercan O. Arik S. Jha Tomas Pfister 115 1 0 07 Apr 2023
ERM++: An Improved Baseline for Domain Generalization Piotr Teterwak Kuniaki Saito Theodoros Tsiligkaridis Kate Saenko Bryan A. Plummer OOD 93 11 0 04 Apr 2023
A Survey of Historical Learning: Learning Models with Learning History Xiang Li Ge Wu Lingfeng Yang Wenzhe Wang Renjie Song Jian Yang MU AI4TS 103 2 0 23 Mar 2023
TemporalMaxer: Maximize Temporal Context with only Max Pooling for Temporal Action Localization Tuan N. Tang Kwonyoung Kim Kwanghoon Sohn 111 30 0 16 Mar 2023
Deep incremental learning models for financial temporal tabular datasets with distribution shifts Thomas Wong Mauricio Barahona OOD AIFin AI4TS 153 0 0 14 Mar 2023
Dynamic Y-KD: A Hybrid Approach to Continual Instance Segmentation M. Fortin B. Chaib-draa CLL 79 1 0 10 Mar 2023
Context-Based Trit-Plane Coding for Progressive Image Compression S. Jeon K. Choi Youngo Park Chang-Su Kim 74 18 0 10 Mar 2023
To Stay or Not to Stay in the Pre-train Basin: Insights on Ensembling in Transfer Learning Ildus Sadrtdinov Dmitrii Pozdeev Dmitry Vetrov E. Lobacheva 102 6 0 06 Mar 2023
Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation Rui Zhao Wei Li Zhipeng Hu Lincheng Li Zhengxia Zou Z. Shi Changjie Fan 73 19 0 02 Mar 2023
Personalized Privacy-Preserving Framework for Cross-Silo Federated Learning Van Tuan Tran Huy Hieu Pham Kok-Seng Wong FedML 98 8 0 22 Feb 2023
Seasoning Model Soups for Robustness to Adversarial and Natural Distribution Shifts Francesco Croce Sylvestre-Alvise Rebuffi Evan Shelhamer Sven Gowal AAML 81 18 0 20 Feb 2023
Interpretable Diversity Analysis: Visualizing Feature Representations In Low-Cost Ensembles Tim Whitaker L. D. Whitley 35 0 0 12 Feb 2023
Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD than Constant Stepsize Mert Gurbuzbalaban Yuanhan Hu Umut Simsekli Lingjiong Zhu LRM 95 1 0 10 Feb 2023
Generalized Uncertainty of Deep Neural Networks: Taxonomy and Applications Chengyu Dong OOD UQCV BDL AI4CE 135 0 0 02 Feb 2023
Towards Inference Efficient Deep Ensemble Learning Ziyue Li Kan Ren Yifan Yang Xinyang Jiang Yuqing Yang Dongsheng Li BDL 62 14 0 29 Jan 2023
Uncertainty Estimation based on Geometric Separation Gabriella Chouraqui L. Cohen Gil Einziger Liel Leman 67 0 0 11 Jan 2023
Does image resolution impact chest X-ray based fine-grained Tuberculosis-consistent lesion segmentation? S. Rajaraman Feng Yang Ghada Zamzmi Z. Xue Sameer Kiran Antani 72 0 0 10 Jan 2023
Deep Negative Correlation Classification Le Zhang Qibin Hou Yun-Hai Liu Jiawang Bian Xun Xu Qiufeng Wang Ce Zhu 60 1 0 14 Dec 2022
Efficient Bayesian Uncertainty Estimation for nnU-Net Yidong Zhao Changchun Yang Artur M. Schweidtmann Qian Tao UQCV BDL 64 22 0 12 Dec 2022
Deep Learning for Brain Age Estimation: A Systematic Review Md. Iftekhar Tanveer M. A. Ganaie I. Beheshti Tripti Goel Nehal Ahmad Kuan-Ting Lai Kaizhu Huang Yudong Zhang Javier Del Ser Chin-Teng Lin 97 90 0 07 Dec 2022
Instability in clinical risk stratification models using deep learning D. Martinez A. Yakubovich Martin G. Seneviratne Á. Lelkes Akshit Tyagi ... N. L. Downing Ron C. Li Keith Morse N. Shah Ming-Jun Chen OOD 68 2 0 20 Nov 2022
Weighted Ensemble Self-Supervised Learning Yangjun Ruan Saurabh Singh Warren Morningstar Alexander A. Alemi Sergey Ioffe Ian S. Fischer Joshua V. Dillon FedML 91 16 0 18 Nov 2022
Augmentation by Counterfactual Explanation -- Fixing an Overconfident Classifier Sumedha Singla Nihal Murali Forough Arabshahi Sofia Triantafyllou Kayhan Batmanghelich CML 124 5 0 21 Oct 2022
Revisiting Checkpoint Averaging for Neural Machine Translation Yingbo Gao Christian Herold Zijian Yang Hermann Ney MoMe 139 12 0 21 Oct 2022
Packed-Ensembles for Efficient Uncertainty Estimation Olivier Laurent Adrien Lafage Enzo Tartaglione Geoffrey Daniel Jean-Marc Martinez Andrei Bursuc Gianni Franchi OODD 148 32 0 17 Oct 2022
Efficient Knowledge Distillation from Model Checkpoints Chaofei Wang Qisen Yang Rui Huang S. Song Gao Huang FedML 48 36 0 12 Oct 2022
Deep Combinatorial Aggregation Yuesong Shen Zorah Lähner OOD UQCV 52 4 0 12 Oct 2022
Sequential Ensembling for Semantic Segmentation Rawal Khirodkar Brandon A. Smith Siddhartha Chandra Amit Agrawal A. Criminisi 69 2 0 08 Oct 2022
Leveraging variational autoencoders for multiple data imputation Breeshey Roskams-Hieter J. Wells S. Wade DRL 54 5 0 30 Sep 2022
Training neural network ensembles via trajectory sampling Jamie F. Mair Dominic C. Rose J. P. Garrahan 63 2 0 22 Sep 2022
UMIX: Improving Importance Weighting for Subpopulation Shift via Uncertainty-Aware Mixup Zongbo Han Zhipeng Liang Fan Yang Liu Liu Lanqing Li Yatao Bian P. Zhao Bing Wu Changqing Zhang Jianhua Yao 118 36 0 19 Sep 2022
Sample-based Uncertainty Quantification with a Single Deterministic Neural Network T. Kanazawa Chetan Gupta UQCV 82 4 0 17 Sep 2022
TEDL: A Two-stage Evidential Deep Learning Method for Classification Uncertainty Quantification Xue Li Wei Shen Denis Xavier Charles UQCV EDL 92 3 0 12 Sep 2022
Ensembling Neural Networks for Improved Prediction and Privacy in Early Diagnosis of Sepsis Shigehiko Schamoni Michael Hagmann Stefan Riezler FedML 63 4 0 01 Sep 2022
NeuralUQ: A comprehensive library for uncertainty quantification in neural differential equations and operators Zongren Zou Xuhui Meng Apostolos F. Psaros George Karniadakis AI4CE 99 39 0 25 Aug 2022