Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation

30 June 2022

Papers citing "Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation"

8 / 8 papers shown

Title
AST: Effective Dataset Distillation through Alignment with Smooth and High-Quality Expert Trajectories Jiyuan Shen Wenzhuo Yang Kwok-Yan Lam DD 35 1 0 16 Oct 2023
Deep Model Fusion: A Survey Weishi Li Yong Peng Miao Zhang Liang Ding Han Hu Li Shen FedML MoMe 46 53 0 27 Sep 2023
Lookaround Optimizer: $k$ steps around, 1 step average Jiangtao Zhang Shunyu Liu Mingli Song Tongtian Zhu Zhenxing Xu Mingli Song MoMe 39 6 0 13 Jun 2023
Towards Efficient Deep Hashing Retrieval: Condensing Your Data via Feature-Embedding Matching Tao Feng Jie Zhang Peizheng Wang Zhijie Wang Shengyuan Pang DD 53 0 0 29 May 2023
Accelerating Dataset Distillation via Model Augmentation Lei Zhang Jie M. Zhang Bowen Lei Subhabrata Mukherjee Xiang Pan Bo Zhao Caiwen Ding Heng Chang Dongkuan Xu DD 47 62 0 12 Dec 2022
PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation Reyhan Kevser Keser Aydin Ayanzadeh O. A. Aghdam Çaglar Kilcioglu B. U. Toreyin N. K. Üre 29 6 0 26 Feb 2021
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 276 5,683 0 05 Dec 2016
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 304 39,238 0 01 Sep 2014