Collaborative Knowledge Distillation via a Learning-by-Education Node Community

30 September 2024

Papers citing "Collaborative Knowledge Distillation via a Learning-by-Education Node Community"

32 / 32 papers shown

Title
Cautiously-Optimistic Knowledge Sharing for Cooperative Multi-Agent Reinforcement Learning Yanwen Ba Xuan Liu Xinning Chen Hao Wang Yang Xu Kenli Li Shigeng Zhang 48 2 0 19 Dec 2023
Curriculum Temperature for Knowledge Distillation Zheng Li Xiang Li Lingfeng Yang Borui Zhao Renjie Song Lei Luo Jun Yu Li Jian Yang 64 143 0 29 Nov 2022
Out-of-Distribution Detection with Semantic Mismatch under Masking Yijun Yang Ruiyuan Gao Qiang Xu OODD 75 28 0 31 Jul 2022
Igeood: An Information Geometry Approach to Out-of-Distribution Detection Eduardo Dadalto Camara Gomes F. Alberge Pierre Duhamel Pablo Piantanida OODD 170 29 0 15 Mar 2022
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 682 41,483 0 22 Oct 2020
A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learning Xingyu Chen Xuguang Lan F. Sun Nanning Zheng OODD 72 77 0 09 Aug 2020
Peer Collaborative Learning for Online Knowledge Distillation Guile Wu S. Gong FedML 54 129 0 07 Jun 2020
Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoder Zhisheng Xiao Qing Yan Y. Amit OODD 167 195 0 06 Mar 2020
An Efficient Transfer Learning Framework for Multiagent Reinforcement Learning Tianpei Yang Weixun Wang Hongyao Tang Jianye Hao Zhaopeng Meng ... Wulong Liu Chen Zhang Yujing Hu Yingfeng Chen Changjie Fan 64 24 0 19 Feb 2020
A Neural Dirichlet Process Mixture Model for Task-Free Continual Learning Soochan Lee Junsoo Ha Dongsu Zhang Gunhee Kim BDL CLL 90 212 0 03 Jan 2020
Input complexity and out-of-distribution detection with likelihood-based generative models Joan Serrà David Álvarez Vicencc Gómez Olga Slizovskaia José F. Núñez Jordi Luque OODD 150 277 0 25 Sep 2019
Self-Knowledge Distillation in Natural Language Processing Sangchul Hahn Heeyoul Choi 87 113 0 02 Aug 2019
Likelihood Ratios for Out-of-Distribution Detection Jie Jessie Ren Peter J. Liu Emily Fertig Jasper Snoek Ryan Poplin M. DePristo Joshua V. Dillon Balaji Lakshminarayanan OODD 209 728 0 07 Jun 2019
Feature Fusion for Online Mutual Knowledge Distillation Jangho Kim Minsung Hyun Inseop Chung Nojun Kwak FedML 67 91 0 19 Apr 2019
Relational Knowledge Distillation Wonpyo Park Dongju Kim Yan Lu Minsu Cho 87 1,425 0 10 Apr 2019
Structured Knowledge Distillation for Dense Prediction Yifan Liu Chris Liu Jingdong Wang Zhenbo Luo 88 584 0 11 Mar 2019
Improving Reconstruction Autoencoder Out-of-distribution Detection with Mahalanobis Distance Taylor Denouden Rick Salay Krzysztof Czarnecki Vahdat Abdelzad Buu Phan Sachin Vernekar OODD 61 123 0 06 Dec 2018
Do Deep Generative Models Know What They Don't Know? Eric T. Nalisnick Akihiro Matsukawa Yee Whye Teh Dilan Görür Balaji Lakshminarayanan OOD 87 759 0 22 Oct 2018
Out-of-Distribution Detection using Multiple Semantic Label Representations Gabi Shalev Yossi Adi Joseph Keshet OODD 79 85 0 20 Aug 2018
End-to-End Incremental Learning F. M. Castro M. Marín-Jiménez Nicolás Guil Mata Cordelia Schmid Alahari Karteek CLL 97 1,160 0 25 Jul 2018
Knowledge Distillation by On-the-Fly Native Ensemble Xu Lan Xiatian Zhu S. Gong 298 480 0 12 Jun 2018
Learning to Teach in Cooperative Multiagent Reinforcement Learning Shayegan Omidshafiei Dong-Ki Kim Miao Liu Gerald Tesauro Matthew D Riemer Chris Amato Murray Campbell Jonathan P. How 55 136 0 20 May 2018
Rocket Launching: A Universal and Efficient Framework for Training Well-performing Light Net Guorui Zhou Ying Fan Runpeng Cui Weijie Bian Xiaoqiang Zhu Kun Gai 76 118 0 14 Aug 2017
Deep Mutual Learning Ying Zhang Tao Xiang Timothy M. Hospedales Huchuan Lu FedML 155 1,656 0 01 Jun 2017
Encoder Based Lifelong Learning Amal Rannen Triki Rahaf Aljundi Mathew B. Blaschko Tinne Tuytelaars CLL 110 321 0 06 Apr 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 147 2,586 0 12 Dec 2016
Overcoming catastrophic forgetting in neural networks J. Kirkpatrick Razvan Pascanu Neil C. Rabinowitz J. Veness Guillaume Desjardins ... A. Grabska-Barwinska Demis Hassabis Claudia Clopath D. Kumaran R. Hadsell CLL 374 7,572 0 02 Dec 2016
iCaRL: Incremental Classifier and Representation Learning Sylvestre-Alvise Rebuffi Alexander Kolesnikov G. Sperl Christoph H. Lampert CLL OOD 162 3,782 0 23 Nov 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 308 4,432 0 29 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 356 8,002 0 23 May 2016
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 322 3,906 0 19 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.7K 100,529 0 04 Sep 2014