Snapshot Ensembles: Train 1, get M for free

1 April 2017

Gao Huang

Papers citing "Snapshot Ensembles: Train 1, get M for free"

50 / 445 papers shown

Title
BEM: Balanced and Entropy-based Mix for Long-Tailed Semi-Supervised Learning Hongwei Zheng Linyuan Zhou Han Li Jinming Su Xiaoming Wei Xiaoming Xu 78 5 0 01 Apr 2024
Dual DETRs for Multi-Label Temporal Action Detection Yuhan Zhu Guozhen Zhang Jing Tan Gangshan Wu Limin Wang 117 12 0 31 Mar 2024
Stitching for Neuroevolution: Recombining Deep Neural Networks without Breaking Them Arthur Guijt D. Thierens Tanja Alderliesten Peter A. N. Bosman 73 1 0 21 Mar 2024
Diversity-Aware Agnostic Ensemble of Sharpness Minimizers Anh-Vu Bui Vy Vo Tung Pham Dinh Q. Phung Trung Le FedML UQCV 72 1 0 19 Mar 2024
DiTMoS: Delving into Diverse Tiny-Model Selection on Microcontrollers Xiao Ma Shengfeng He Hezhe Qiao Dong-Lai Ma 83 1 0 14 Mar 2024
Bayesian Uncertainty Estimation by Hamiltonian Monte Carlo: Applications to Cardiac MRI Segmentation Yidong Zhao João Tourais Iain Pierce Christian Nitsche T. Treibel Sebastian Weingartner Artur M. Schweidtmann Qian Tao BDL UQCV 92 5 0 04 Mar 2024
A prediction rigidity formalism for low-cost uncertainties in trained neural networks Filippo Bigi Sanggyu Chong Michele Ceriotti Federico Grasselli 75 6 0 04 Mar 2024
Training Neural Networks from Scratch with Parallel Low-Rank Adapters Minyoung Huh Brian Cheung Jeremy Bernstein Phillip Isola Pulkit Agrawal 106 12 0 26 Feb 2024
Forecasting Events in Soccer Matches Through Language Tiago Mendes-Neves Luís Meireles João Mendes-Moreira 82 5 0 09 Feb 2024
Towards a Systematic Approach to Design New Ensemble Learning Algorithms João Mendes-Moreira Tiago Mendes-Neves FedML 60 2 0 09 Feb 2024
A Bandit Approach with Evolutionary Operators for Model Selection Margaux Brégere Lpsm Julie Keisler 51 1 0 07 Feb 2024
How Good is a Single Basin? Kai Lion Lorenzo Noci Thomas Hofmann Gregor Bachmann UQCV 53 3 0 05 Feb 2024
eXplainable Bayesian Multi-Perspective Generative Retrieval EuiYul Song Philhoon Oh Sangryul Kim James Thorne BDL 63 0 0 04 Feb 2024
ARGS: Alignment as Reward-Guided Search Maxim Khanov Jirayu Burapacheep Yixuan Li 130 62 0 23 Jan 2024
Stochastic Subnetwork Annealing: A Regularization Technique for Fine Tuning Pruned Subnetworks Tim Whitaker Darrell Whitley 95 0 0 16 Jan 2024
DiffHybrid-UQ: Uncertainty Quantification for Differentiable Hybrid Neural Modeling Deepak Akhare Tengfei Luo Jian-Xun Wang 82 6 0 30 Dec 2023
FedSDD: Scalable and Diversity-enhanced Distillation for Model Aggregation in Federated Learning Ho Man Kwan Shenghui Song FedML 77 2 0 28 Dec 2023
TinyGSM: achieving >80% on GSM8k with small language models Bingbin Liu Sébastien Bubeck Ronen Eldan Janardhan Kulkarni Yuanzhi Li Anh Nguyen Rachel A. Ward Yi Zhang ALM 95 52 0 14 Dec 2023
Mini-batch Gradient Descent with Buffer Haobo Qi Du Huang Yingqiu Zhu Danyang Huang Hansheng Wang 47 1 0 14 Dec 2023
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes Zhen Qin Daoyuan Chen Bingchen Qian Bolin Ding Yaliang Li Shuiguang Deng FedML 111 39 0 11 Dec 2023
PaSCo: Urban 3D Panoptic Scene Completion with Uncertainty Awareness Anh-Quan Cao Angela Dai Raoul de Charette UQCV 71 22 0 04 Dec 2023
ADM-Loc: Actionness Distribution Modeling for Point-supervised Temporal Action Localization Elahe Vahdani Yingli Tian 79 0 0 27 Nov 2023
MonoProb: Self-Supervised Monocular Depth Estimation with Interpretable Uncertainty Rémi Marsal F. Chabot Angélique Loesch William Grolleau H. Sahbi MDE UQCV 90 8 0 10 Nov 2023
A comprehensive survey on deep active learning in medical image analysis Haoran Wang Q. Jin Shiman Li Siyu Liu Manning Wang Zhijian Song VLM 136 31 0 22 Oct 2023
Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective Ming Zhong Chenxin An Weizhu Chen Jiawei Han Pengcheng He 101 12 0 17 Oct 2023
Relearning Forgotten Knowledge: on Forgetting, Overfit and Training-Free Ensembles of DNNs Uri Stern D. Weinshall CLL 74 0 0 17 Oct 2023
Why Do We Need Weight Decay in Modern Deep Learning? Maksym Andriushchenko Francesco DÁngelo Aditya Varre Nicolas Flammarion 98 38 0 06 Oct 2023
RRR-Net: Reusing, Reducing, and Recycling a Deep Backbone Network Haozhe Sun Isabelle M Guyon F. Mohr Hedi Tabia CVBM 81 2 0 02 Oct 2023
A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent Mingze Wang Lei Wu 88 3 0 01 Oct 2023
LoRA ensembles for large language model fine-tuning Xi Wang Laurence Aitchison Maja Rudolph UQCV 113 39 0 29 Sep 2023
A Primer on Bayesian Neural Networks: Review and Debates Federico Danieli Konstantinos Pitas M. Vladimirova Vincent Fortuin BDL AAML 114 20 0 28 Sep 2023
Deep Model Fusion: A Survey Weishi Li Yong Peng Miao Zhang Liang Ding Han Hu Li Shen FedML MoMe 117 62 0 27 Sep 2023
Adapt then Unlearn: Exploring Parameter Space Semantics for Unlearning in Generative Adversarial Networks Piyush Tiwary Atri Guha Subhodip Panda Prathosh A.P. MU GAN 139 9 0 25 Sep 2023
Improve Deep Forest with Learnable Layerwise Augmentation Policy Schedule Hongyu Zhu Sichu Liang Wentao Hu Fangqi Li Yali Yuan Shi-Lin Wang Guang Cheng 53 2 0 16 Sep 2023
Unveiling Invariances via Neural Network Pruning Derek Xu Yizhou Sun Wei Wang 77 0 0 15 Sep 2023
Exploring Flat Minima for Domain Generalization with Large Learning Rates Jian Zhang Lei Qi Yinghuan Shi Yang Gao 83 3 0 12 Sep 2023
POCO: 3D Pose and Shape Estimation with Confidence Sai Kumar Dwivedi Cordelia Schmid Hongwei Yi Michael J. Black Dimitrios Tzionas 3DH 67 17 0 24 Aug 2023
Uncertainty Quantification for Image-based Traffic Prediction across Cities Alexander Timans Nina Wiedemann Nishant Kumar Ye Hong Martin Raubal 91 1 0 11 Aug 2023
Out-of-Distribution Detection for Monocular Depth Estimation Julia Hornauer Adrian Holzbock Vasileios Belagiannis UQCV 77 4 0 11 Aug 2023
Learning to Generate Training Datasets for Robust Semantic Segmentation Marwane Hariat Olivier Laurent Rémi Kazmierczak Shihao Zhang Andrei Bursuc Angela Yao Gianni Franchi UQCV 83 2 0 01 Aug 2023
A survey on deep learning in medical image registration: new technologies, uncertainty, evaluation metrics, and beyond Junyu Chen Yihao Liu Shuwen Wei Zhangxing Bian Shalini Subramanian A. Carass Jerry L. Prince Yong Du OOD 119 46 0 28 Jul 2023
How to Scale Your EMA Dan Busbridge Jason Ramapuram Pierre Ablin Tatiana Likhomanenko Eeshan Gunesh Dhekane Xavier Suau Russ Webb 82 19 0 25 Jul 2023
Snapshot Spectral Clustering -- a costless approach to deep clustering ensembles generation Adam Piróg Halina Kwasnicka 49 1 0 17 Jul 2023
Quantification of Uncertainty with Adversarial Models Kajetan Schweighofer L. Aichberger Mykyta Ielanskyi Günter Klambauer Sepp Hochreiter UQCV 90 17 0 06 Jul 2023
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers Yineng Chen Z. Li Lefei Zhang Bo Du Hai Zhao 72 4 0 02 Jul 2023
Improving Online Continual Learning Performance and Stability with Temporal Ensembles Albin Soutif--Cormerais Antonio Carta Joost van de Weijer CLL 95 12 0 29 Jun 2023
Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging Max Zimmer Christoph Spiegel Sebastian Pokutta MoMe 131 14 0 29 Jun 2023
Traversing Between Modes in Function Space for Fast Ensembling Eunggu Yun Hyungi Lee G. Nam Juho Lee UQCV 69 3 0 20 Jun 2023
The Split Matters: Flat Minima Methods for Improving the Performance of GNNs N. Lell A. Scherp 77 1 0 15 Jun 2023
Integrating Uncertainty Awareness into Conformalized Quantile Regression Raphael Rossellini Rina Foygel Barber Rebecca Willett 195 10 0 14 Jun 2023