Learning Deep Representations with Probabilistic Knowledge Transfer

28 March 2018

Nikolaos Passalis

Anastasios Tefas

Papers citing "Learning Deep Representations with Probabilistic Knowledge Transfer"

35 / 35 papers shown

Title
Distilling Stereo Networks for Performant and Efficient Leaner Networks Rafia Rahim Samuel Woerz A. Zell 171 0 0 24 Mar 2025
VRM: Knowledge Distillation via Virtual Relation Matching W. Zhang Fei Xie Weidong Cai Chao Ma 160 0 0 28 Feb 2025
Variational Bayesian Adaptive Learning of Deep Latent Variables for Acoustic Knowledge Transfer Hu Hu Sabato Marco Siniscalchi Chao-Han Huck Yang Chin-Hui Lee 114 0 0 28 Jan 2025
Exploring Feature-based Knowledge Distillation for Recommender System: A Frequency Perspective Zhangchi Zhu Wei Zhang 143 0 0 16 Nov 2024
Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head Penghui Yang Chen-Chen Zong Sheng-Jun Huang Lei Feng Bo An 110 1 0 13 Nov 2024
Bayesian Comparisons Between Representations Heiko H. Schütt FAtt 472 0 0 13 Nov 2024
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks S. Joshi Jiayi Ni Baharan Mirzasoleiman DD 159 2 0 03 Oct 2024
Classroom-Inspired Multi-Mentor Distillation with Adaptive Learning Strategies Shalini Sarode Muhammad Saif Ullah Khan Tahira Shehzadi Didier Stricker Muhammad Zeshan Afzal 70 0 0 30 Sep 2024
OW-Rep: Open World Object Detection with Instance Representation Learning Sunoh Lee Minsik Jeon Jihong Min Junwon Seo ObjD 420 0 0 24 Sep 2024
Relational Representation Distillation Nikolaos Giakoumoglou Tania Stathaki 97 0 0 16 Jul 2024
Direct Preference Knowledge Distillation for Large Language Models Yixing Li Yuxian Gu Li Dong Dequan Wang Yu Cheng Furu Wei 96 6 0 28 Jun 2024
ReDistill: Residual Encoded Distillation for Peak Memory Reduction of CNNs Fang Chen Gourav Datta Mujahid Al Rafi Hyeran Jeon Meng Tang 138 1 0 06 Jun 2024
Multi-fidelity Neural Architecture Search with Knowledge Distillation I. Trofimov Nikita Klyuchnikov Mikhail Salnikov Alexander N. Filippov Evgeny Burnaev 80 15 0 15 Jun 2020
SuperMix: Supervising the Mixing Data Augmentation Ali Dabouei Sobhan Soleymani Fariborz Taherkhani Nasser M. Nasrabadi 67 100 0 10 Mar 2020
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 151 1,049 0 23 Oct 2019
DSOD: Learning Deeply Supervised Object Detectors from Scratch Zhiqiang Shen Zhuang Liu Jianguo Li Yu-Gang Jiang Yurong Chen Xiangyang Xue ObjD 67 601 0 03 Aug 2017
Learning Bag-of-Features Pooling for Deep Convolutional Neural Networks Nikolaos Passalis Anastasios Tefas 46 70 0 25 Jul 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.2K 20,858 0 17 Apr 2017
Binarized Convolutional Landmark Localizers for Human Pose Estimation and Face Alignment with Limited Resources Adrian Bulat Georgios Tzimiropoulos CVBM 3DV 112 191 0 02 Mar 2017
YOLO9000: Better, Faster, Stronger Joseph Redmon Ali Farhadi VLM ObjD 181 15,619 0 25 Dec 2016
MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition Yandong Guo Lei Zhang Yuxiao Hu Xiaodong He Jianfeng Gao CVBM 166 1,961 0 27 Jul 2016
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size F. Iandola Song Han Matthew W. Moskewicz Khalid Ashraf W. Dally Kurt Keutzer 150 7,486 0 24 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Net2Net: Accelerating Learning via Knowledge Transfer Tianqi Chen Ian Goodfellow Jonathon Shlens 159 669 0 18 Nov 2015
Learning Multi-Domain Convolutional Neural Networks for Visual Tracking Hyeonseob Nam Bohyung Han 98 2,475 0 27 Oct 2015
Simultaneous Deep Transfer Across Domains and Tasks Eric Tzeng Judy Hoffman Trevor Darrell Kate Saenko OOD 80 1,370 0 08 Oct 2015
Bayesian Dark Knowledge Masashi Sugiyama Vivek Rathod R. Garnett Max Welling BDL UQCV 80 258 0 14 Jun 2015
You Only Look Once: Unified, Real-Time Object Detection Joseph Redmon S. Divvala Ross B. Girshick Ali Farhadi ObjD 699 36,958 0 08 Jun 2015
Knowledge Transfer Pre-training Zhiyuan Tang Dong Wang Yiqiao Pan Zhiyong Zhang 52 17 0 07 Jun 2015
Recurrent Neural Network Training with Dark Knowledge Transfer Zhiyuan Tang Dong Wang Zhiyong Zhang 62 109 0 18 May 2015
Transferring Knowledge from a RNN to a DNN William Chan Nan Rosemary Ke Ian Lane 54 75 0 07 Apr 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 362 19,660 0 09 Mar 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,305 0 11 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,115 0 22 Dec 2014
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 308 3,887 0 19 Dec 2014