Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts

8 October 2022

Papers citing "Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts"

50 / 64 papers shown

Title
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 316 5 0 10 Mar 2025
On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoning Yongyi Su Yushu Li Nanqing Liu Kui Jia Xulei Yang Chuan-Sheng Foo Xun Xu TTA AAML 79 1 0 07 Oct 2024
Improving ProtoNet for Few-Shot Video Object Recognition: Winner of ORBIT Challenge 2022 Liming Gu Zhixiang Chi Huan Liu Yuanhao Yu Yang Wang 57 7 0 01 Oct 2022
Gradient-based Bi-level Optimization for Deep Learning: A Survey Can Chen Xiangshan Chen Chen Ma Zixuan Liu Xue Liu 124 38 0 24 Jul 2022
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay Huan Liu Li Gu Zhixiang Chi Yang Wang Yuanhao Yu Jun Chen Jingshan Tang 55 84 0 22 Jul 2022
Self-supervised Spatiotemporal Representation Learning by Exploiting Video Continuity Hanwen Liang N. Quader Zhixiang Chi Lizhe Chen Peng Dai Juwei Lu Yang Wang SSL AI4TS 56 30 0 11 Dec 2021
Generalized Source-free Domain Adaptation Shiqi Yang Yaxing Wang Joost van de Weijer Luis Herranz Shangling Jui TTA 56 253 0 03 Aug 2021
Test-Time Personalization with a Transformer for Human Pose Estimation Yizhuo Li Miao Hao Zonglin Di N. B. Gundavarapu Xiaolong Wang ViT 44 46 0 05 Jul 2021
Meta-Learning with Fewer Tasks through Task Interpolation Huaxiu Yao Linjun Zhang Chelsea Finn 63 55 0 04 Jun 2021
ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition Daniela Massiceti L. Zintgraf J. Bronskill Lida Theodorou Matthew Tobias Harris Edward Cutrell C. Morrison Katja Hofmann Simone Stumpf 105 44 0 08 Apr 2021
Few-Shot Incremental Learning with Continually Evolved Classifiers Chi Zhang Nan Song Guosheng Lin Yun Zheng Pan Pan Yinghui Xu CLL 59 292 0 07 Apr 2021
Unsupervised Multi-source Domain Adaptation Without Access to Source Data Sk. Miraj Ahmed Dripta S. Raychaudhuri S. Paul Samet Oymak Amit K. Roy-Chowdhury 42 128 0 05 Apr 2021
Domain Impression: A Source Data Free Domain Adaptation Method V. Kurmi Venkatesh Subramanian Vinay P. Namboodiri TTA 171 150 0 17 Feb 2021
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity W. Fedus Barret Zoph Noam M. Shazeer MoE 52 2,136 0 11 Jan 2021
WILDS: A Benchmark of in-the-Wild Distribution Shifts Pang Wei Koh Shiori Sagawa Henrik Marklund Sang Michael Xie Marvin Zhang ... A. Kundaje Emma Pierson Sergey Levine Chelsea Finn Percy Liang OOD 141 1,406 0 14 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 312 40,217 0 22 Oct 2020
Learning to Balance Specificity and Invariance for In and Out of Domain Generalization Prithvijit Chattopadhyay Yogesh Balaji Judy Hoffman OOD 60 204 0 28 Aug 2020
Adaptive Risk Minimization: Learning to Adapt to Domain Shift Marvin Zhang Henrik Marklund Nikita Dhawan Abhishek Gupta Sergey Levine Chelsea Finn OOD 31 201 0 06 Jul 2020
In Search of Lost Domain Generalization Ishaan Gulrajani David Lopez-Paz OOD 57 1,129 0 02 Jul 2020
Curriculum Manager for Source Selection in Multi-Source Domain Adaptation Luyu Yang Yogesh Balaji Ser-Nam Lim Abhinav Shrivastava 45 110 0 02 Jul 2020
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding Dmitry Lepikhin HyoukJoong Lee Yuanzhong Xu Dehao Chen Orhan Firat Yanping Huang M. Krikun Noam M. Shazeer Zhiwen Chen MoE 76 1,142 0 30 Jun 2020
The iWildCam 2020 Competition Dataset Sara Beery Elijah Cole Arvi Gjoka 105 91 0 21 Apr 2020
Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot Learning Yinbo Chen Zhuang Liu Huijuan Xu Trevor Darrell Xiaolong Wang 192 344 0 09 Mar 2020
Learning to Continually Learn Shawn L. E. Beaulieu Lapo Frati Thomas Miconi Joel Lehman Kenneth O. Stanley Jeff Clune Nick Cheney KELM CLL 71 147 0 21 Feb 2020
Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptation Jian Liang Dapeng Hu Jiashi Feng 75 1,225 0 20 Feb 2020
Improved Few-Shot Visual Classification Peyman Bateni Raghav Goyal Vaden Masrani Frank Wood Leonid Sigal VLM 38 229 0 07 Dec 2019
Adversarial Domain Adaptation with Domain Mixup Minghao Xu Jian Zhang Bingbing Ni Teng Li Chengjie Wang Qi Tian Wenjun Zhang 33 443 0 04 Dec 2019
Multi-source Distilling Domain Adaptation Sicheng Zhao Guangzhi Wang Shanghang Zhang Yang Gu Yaxian Li Zhichao Song Pengfei Xu Runbo Hu Hua Chai Kurt Keutzer TTA 49 212 0 22 Nov 2019
Domain Generalization Using a Mixture of Multiple Latent Domains Toshihiko Matsuura Tatsuya Harada OOD 53 324 0 18 Nov 2019
Reducing Domain Gap by Reducing Style Bias Hyeonseob Nam HyunJae Lee Jongchan Park Wonjun Yoon Donggeun Yoo 39 61 0 25 Oct 2019
Domain Aggregation Networks for Multi-Source Domain Adaptation Junfeng Wen Russell Greiner Dale Schuurmans 28 71 0 11 Sep 2019
Invariant Risk Minimization Martín Arjovsky Léon Bottou Ishaan Gulrajani David Lopez-Paz OOD 146 2,190 0 05 Jul 2019
Fast and Flexible Multi-Task Classification Using Conditional Neural Adaptive Processes James Requeima Jonathan Gordon J. Bronskill Sebastian Nowozin Richard Turner 51 241 0 18 Jun 2019
AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence Jeff Clune 105 119 0 27 May 2019
Which Tasks Should Be Learned Together in Multi-task Learning? Trevor Scott Standley Amir Zamir Dawn Chen Leonidas Guibas Jitendra Malik Silvio Savarese 82 509 0 18 May 2019
Benchmarking Neural Network Robustness to Common Corruptions and Perturbations Dan Hendrycks Thomas G. Dietterich OOD VLM 103 3,399 0 28 Mar 2019
Moment Matching for Multi-Source Domain Adaptation Xingchao Peng Qinxun Bai Xide Xia Zijun Huang Kate Saenko Bo Wang OOD 106 1,769 0 04 Dec 2018
Multi-Adversarial Domain Adaptation Zhongyi Pei Zhangjie Cao Mingsheng Long Jianmin Wang OOD TTA 43 857 0 04 Sep 2018
Conditional Neural Processes M. Garnelo Dan Rosenbaum Chris J. Maddison Tiago Ramalho D. Saxton Murray Shanahan Yee Whye Teh Danilo Jimenez Rezende S. M. Ali Eslami UQCV BDL 48 688 0 04 Jul 2018
Generalizing to Unseen Domains via Adversarial Data Augmentation Riccardo Volpi Hongseok Namkoong Ozan Sener John C. Duchi Vittorio Murino Silvio Savarese OOD 94 773 0 30 May 2018
Generalizing Across Domains via Cross-Gradient Training Shiv Shankar Vihari Piratla Soumen Chakrabarti S. Chaudhuri Preethi Jyothi Sunita Sarawagi OOD 41 511 0 28 Apr 2018
Deep Cocktail Network: Multi-source Unsupervised Domain Adaptation with Category Shift Ruijia Xu Ziliang Chen W. Zuo Junjie Yan Liang Lin OOD 56 385 0 02 Mar 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 129 19,124 0 13 Jan 2018
Functional Map of the World Gordon A. Christie Neil Fendley James Wilson R. Mukherjee VGen 57 388 0 21 Nov 2017
Learning to Generalize: Meta-Learning for Domain Generalization Da Li Yongxin Yang Yi-Zhe Song Timothy M. Hospedales OOD 79 1,404 0 10 Oct 2017
Deeper, Broader and Artier Domain Generalization Da Li Yongxin Yang Yi-Zhe Song Timothy M. Hospedales OOD 94 1,427 0 09 Oct 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 427 129,831 0 12 Jun 2017
Hard Mixtures of Experts for Large Scale Weakly Supervised Vision Sam Gross MarcÁurelio Ranzato Arthur Szlam MoE 33 102 0 20 Apr 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 207 8,072 0 15 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 754 11,793 0 09 Mar 2017