Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from
Mixture-of-Experts

Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts

8 October 2022

Papers citing "Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts"

14 / 64 papers shown

Title
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer Noam M. Shazeer Azalia Mirhoseini Krzysztof Maziarz Andy Davis Quoc V. Le Geoffrey E. Hinton J. Dean MoE 158 2,614 0 23 Jan 2017
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 626 36,599 0 25 Aug 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 246 10,412 0 21 Jul 2016
Deep CORAL: Correlation Alignment for Deep Domain Adaptation Baochen Sun Kate Saenko OOD 71 3,123 0 06 Jul 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 290 7,299 0 13 Jun 2016
Network of Experts for Large-Scale Image Categorization Karim Ahmed M. H. Baig Lorenzo Torresani 53 126 0 20 Apr 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.4K 192,638 0 10 Dec 2015
Domain Generalization for Object Recognition with Multi-task Autoencoders Muhammad Ghifary W. Kleijn Mengjie Zhang David Balduzzi ViT OOD 60 657 0 31 Aug 2015
Domain-Adversarial Training of Neural Networks Yaroslav Ganin E. Ustinova Hana Ajakan Pascal Germain Hugo Larochelle François Laviolette M. Marchand Victor Lempitsky GAN OOD 343 9,418 0 28 May 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 236 19,523 0 09 Mar 2015
Learning Transferable Features with Deep Adaptation Networks Mingsheng Long Yue Cao Jianmin Wang Michael I. Jordan OOD 189 5,177 0 10 Feb 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 813 149,474 0 22 Dec 2014
Deep Domain Confusion: Maximizing for Domain Invariance Eric Tzeng Judy Hoffman Ning Zhang Kate Saenko Trevor Darrell OOD 148 2,588 0 10 Dec 2014
Domain Generalization via Invariant Feature Representation Krikamol Muandet David Balduzzi Bernhard Schölkopf OOD 87 1,166 0 10 Jan 2013