v1v2 (latest)

Self-supervised Knowledge Distillation for Few-shot Learning

17 June 2020

Jathushan Rajasegaran

Salman Khan

ArXiv (abs)PDF HTML Github (98★)

Papers citing "Self-supervised Knowledge Distillation for Few-shot Learning"

42 / 42 papers shown

Title
Knowledge Distillation Meets Self-Supervision Guodong Xu Ziwei Liu Xiaoxiao Li Chen Change Loy FedML 79 285 0 12 Jun 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning Limeng Qiao Yemin Shi Jia Li Yaowei Wang Tiejun Huang Yonghong Tian 67 182 0 05 Oct 2019
Unsupervised Domain Adaptation through Self-Supervision Yu Sun Eric Tzeng Trevor Darrell Alexei A. Efros OOD SSL 62 238 0 26 Sep 2019
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML Aniruddh Raghu M. Raghu Samy Bengio Oriol Vinyals 300 644 0 19 Sep 2019
PARN: Position-Aware Relation Networks for Few-Shot Learning Ziyang Wu Yuwei Li Lihua Guo Kui Jia 59 86 0 10 Sep 2019
A Baseline for Few-Shot Image Classification Guneet Singh Dhillon Pratik Chaudhari Avinash Ravichandran Stefano Soatto 77 580 0 06 Sep 2019
Meta-Learning with Warped Gradient Descent Sebastian Flennerhag Andrei A. Rusu Razvan Pascanu Francesco Visin Hujun Yin R. Hadsell 85 210 0 30 Aug 2019
Few-Shot Learning with Global Class Representations Tiange Luo Aoxue Li Tao Xiang Weiran Huang Liwei Wang 118 114 0 14 Aug 2019
Boosting Few-Shot Visual Learning with Self-Supervision Spyros Gidaris Andrei Bursuc N. Komodakis P. Pérez Matthieu Cord SSL 77 405 0 12 Jun 2019
Few-Shot Learning with Embedded Class Models and Shot-Free Meta Training Avinash Ravichandran Rahul Bhotika Stefano Soatto 69 170 0 10 May 2019
S4L: Self-Supervised Semi-Supervised Learning Xiaohua Zhai Avital Oliver Alexander Kolesnikov Lucas Beyer SSL VLM 105 795 0 09 May 2019
Meta-Learning with Differentiable Convex Optimization Kwonjoon Lee Subhransu Maji Avinash Ravichandran Stefano Soatto 94 1,268 0 07 Apr 2019
Diversity with Cooperation: Ensemble Methods for Few-Shot Classification Nikita Dvornik Cordelia Schmid Julien Mairal VLM 72 197 0 27 Mar 2019
Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples Eleni Triantafillou Tyler Lixuan Zhu Vincent Dumoulin Pascal Lamblin Utku Evci ... Ross Goroshin Carles Gelada Kevin Swersky Pierre-Antoine Manzagol Hugo Larochelle 151 617 0 07 Mar 2019
Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey Longlong Jing Yingli Tian SSL 117 1,700 0 16 Feb 2019
Infinite Mixture Prototypes for Few-Shot Learning Kelsey R. Allen Evan Shelhamer Hanul Shin J. Tenenbaum 51 248 0 12 Feb 2019
Meta-Transfer Learning for Few-Shot Learning Qianru Sun Yaoyao Liu Tat-Seng Chua Bernt Schiele 199 1,071 0 06 Dec 2018
Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoders Edgar Schönfeld Sayna Ebrahimi Samarth Sinha Trevor Darrell Zeynep Akata DRL 79 597 0 05 Dec 2018
Self-Supervised GANs via Auxiliary Rotation Loss Ting Chen Xiaohua Zhai Marvin Ritter Mario Lucic N. Houlsby SSL GAN 76 302 0 27 Nov 2018
Meta-Learning with Latent Embedding Optimization Andrei A. Rusu Dushyant Rao Jakub Sygnowski Oriol Vinyals Razvan Pascanu Simon Osindero R. Hadsell 139 1,371 0 16 Jul 2018
Deep Clustering for Unsupervised Learning of Visual Features Mathilde Caron Piotr Bojanowski Armand Joulin Matthijs Douze SSL 88 1,898 0 15 Jul 2018
TADAM: Task dependent adaptive metric for improved few-shot learning Boris N. Oreshkin Pau Rodríguez López Alexandre Lacoste 96 1,313 0 23 May 2018
Meta-learning with differentiable closed-form solvers Luca Bertinetto João F. Henriques Philip Torr Andrea Vedaldi ODL 88 930 0 21 May 2018
Task-Agnostic Meta-Learning for Few-shot Learning Muhammad Abdullah Jamal Guo-Jun Qi M. Shah 84 460 0 20 May 2018
Dynamic Few-Shot Visual Learning without Forgetting Spyros Gidaris N. Komodakis VLM 59 1,130 0 25 Apr 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 258 3,290 0 21 Mar 2018
Meta-Learning for Semi-Supervised Few-Shot Classification Mengye Ren Eleni Triantafillou S. S. Ravi Jake C. Snell Kevin Swersky J. Tenenbaum Hugo Larochelle R. Zemel SSL 70 1,283 0 02 Mar 2018
Data Distillation: Towards Omni-Supervised Learning Ilija Radosavovic Piotr Dollár Ross B. Girshick Georgia Gkioxari Kaiming He 76 419 0 12 Dec 2017
Learning to Compare: Relation Network for Few-Shot Learning Flood Sung Yongxin Yang Li Zhang Tao Xiang Philip Torr Timothy M. Hospedales 295 4,050 0 16 Nov 2017
Representation Learning by Learning to Count M. Noroozi Hamed Pirsiavash Paolo Favaro SSL 73 369 0 22 Aug 2017
Meta-SGD: Learning to Learn Quickly for Few-Shot Learning Zhenguo Li Fengwei Zhou Fei Chen Hang Li 96 1,119 0 31 Jul 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 300 8,134 0 15 Mar 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 823 11,909 0 09 Mar 2017
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 373 7,323 0 13 Jun 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 171 2,980 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 133 3,530 0 28 Mar 2016
Unsupervised Visual Representation Learning by Context Prediction Carl Doersch Abhinav Gupta Alexei A. Efros DRL SSL 166 2,786 0 19 May 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 362 19,660 0 09 Mar 2015
Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks Alexey Dosovitskiy Philipp Fischer Jost Tobias Springenberg Martin Riedmiller Thomas Brox OOD SSL 87 1,021 0 26 Jun 2014
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 413 43,667 0 01 May 2014
Describing Textures in the Wild Mircea Cimpoi Subhransu Maji Iasonas Kokkinos S. Mohamed Andrea Vedaldi 3DV 138 2,674 0 14 Nov 2013