Distilling Self-Supervised Vision Transformers for Weakly-Supervised Few-Shot Classification & Segmentation

7 July 2023

Papers citing "Distilling Self-Supervised Vision Transformers for Weakly-Supervised Few-Shot Classification & Segmentation"

50 / 51 papers shown

Title
MSDNet: Multi-Scale Decoder for Few-Shot Semantic Segmentation via Transformer-Guided Prototyping Amirreza Fateh Mohammad Reza Mohammadi Mohammad Reza Jahed Motlagh ViT 239 6 0 17 Sep 2024
ScaleNet: An Unsupervised Representation Learning Method for Limited Information Huili Huang M. M. Roozbahani SSL 108 804 0 03 Oct 2023
Self-Support Few-Shot Semantic Segmentation Qi Fan Wenjie Pei Yu-Wing Tai Chi-Keung Tang 92 146 0 23 Jul 2022
One Weird Trick to Improve Your Semi-Weakly Supervised Semantic Segmentation Model Wonho Bae Junhyug Noh Milad Jalali Asadabadi Danica J. Sutherland VLM 31 5 0 02 May 2022
Integrative Few-Shot Learning for Classification and Segmentation Dahyun Kang Minsu Cho VLM 86 61 0 29 Mar 2022
Deep ViT Features as Dense Visual Descriptors Shirzad Amir Yossi Gandelsman Shai Bagon Tali Dekel MDE ViT 128 290 0 10 Dec 2021
TransFGU: A Top-down Approach to Fine-Grained Unsupervised Semantic Segmentation Zhao-Heng Yin Pichao Wang Fan Wang Xianzhe Xu Hanling Zhang Hao Li Rong Jin 78 41 0 02 Dec 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 477 7,827 0 11 Nov 2021
Localizing Objects with Self-Supervised Transformers and no Labels Oriane Siméoni Gilles Puy Huy V. Vo Simon Roburin Spyros Gidaris Andrei Bursuc P. Pérez Renaud Marlet Jean Ponce ViT 237 203 0 29 Sep 2021
Relational Embedding for Few-Shot Classification Dahyun Kang Heeseung Kwon Juhong Min Minsu Cho 81 187 0 22 Aug 2021
Learning Meta-class Memory for Few-Shot Semantic Segmentation Zhonghua Wu Xiangxi Shi Guosheng lin Jianfei Cai VLM 133 109 0 06 Aug 2021
Few-Shot Segmentation via Cycle-Consistent Transformer Gengwei Zhang Guoliang Kang Yi Yang Yunchao Wei ViT 80 185 0 04 Jun 2021
Segmenter: Transformer for Semantic Segmentation Robin Strudel Ricardo Garcia Pinel Ivan Laptev Cordelia Schmid ViT 218 1,473 0 12 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 730 6,135 0 29 Apr 2021
Hypercorrelation Squeeze for Few-Shot Segmentation Juhong Min Dahyun Kang Minsu Cho 86 296 0 04 Apr 2021
Mining Latent Classes for Few-shot Segmentation Lihe Yang Wei Zhuo Lei Qi Yinghuan Shi Yang Gao 67 126 0 29 Mar 2021
Scalable Vision Transformers with Hierarchical Pooling Zizheng Pan Bohan Zhuang Jing Liu Haoyu He Jianfei Cai ViT 80 130 0 19 Mar 2021
Anti-Adversarially Manipulated Attributions for Weakly and Semi-Supervised Semantic Segmentation Jungbeom Lee Eunji Kim Sungroh Yoon 75 229 0 16 Mar 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 537 3,740 0 24 Feb 2021
Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning Zeyuan Allen-Zhu Yuanzhi Li FedML 151 375 0 17 Dec 2020
Few-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need? Malik Boudiaf H. Kervadec Imtiaz Masud Ziko Pablo Piantanida Ismail Ben Ayed Jose Dolz VLM 243 190 0 11 Dec 2020
PseudoSeg: Designing Pseudo Labels for Semantic Segmentation Yuliang Zou Zizhao Zhang Han Zhang Chun-Liang Li Xiao Bian Jia-Bin Huang Tomas Pfister 88 299 0 19 Oct 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 267 4,101 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 401 6,844 0 13 Jun 2020
Self-Distillation as Instance-Specific Label Smoothing Zhilu Zhang M. Sabuncu 76 119 0 09 Jun 2020
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 90 235 0 05 Jun 2020
Negative Margin Matters: Understanding Margin in Few-shot Classification Bin Liu Yue Cao Yutong Lin Qi Li Zheng Zhang Mingsheng Long Han Hu 92 323 0 26 Mar 2020
Revisiting the Sibling Head in Object Detector Guanglu Song Yu Liu Xiaogang Wang ObjD 241 350 0 17 Mar 2020
Meta-Baseline: Exploring Simple Meta-Learning for Few-Shot Learning Yinbo Chen Zhuang Liu Huijuan Xu Trevor Darrell Xiaolong Wang 221 347 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 390 18,897 0 13 Feb 2020
Feature Weighting and Boosting for Few-Shot Segmentation Khoi Duc Minh Nguyen S. Todorovic 110 331 0 28 Sep 2019
PANet: Few-Shot Image Semantic Segmentation with Prototype Alignment Kaixin Wang Jun Hao Liew Yingtian Zou Daquan Zhou Jiashi Feng VLM 72 1,071 0 18 Aug 2019
Weakly Supervised Learning of Instance Segmentation with Inter-pixel Relations Jiwoon Ahn Sunghyun Cho Suha Kwak ISeg SSeg 173 545 0 10 Apr 2019
A Closer Look at Few-shot Classification Wei-Yu Chen Yen-Cheng Liu Z. Kira Y. Wang Jia-Bin Huang 116 1,769 0 08 Apr 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 95 447 0 29 Mar 2019
CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learning Chi Zhang Guosheng Lin Fayao Liu Rui Yao Chunhua Shen VLM SSeg 70 544 0 06 Mar 2019
FickleNet: Weakly and Semi-supervised Semantic Image Segmentation using Stochastic Inference Jungbeom Lee Eunji Kim Sungmin Lee Jangho Lee Sungroh Yoon 90 422 0 27 Feb 2019
Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey Longlong Jing Yingli Tian SSL 171 1,701 0 16 Feb 2019
Few-Shot Learning via Embedding Adaptation with Set-to-Set Functions Han-Jia Ye Hexiang Hu De-Chuan Zhan Fei Sha 138 667 0 10 Dec 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 185 3,468 0 05 May 2018
Group Normalization Yuxin Wu Kaiming He 245 3,672 0 22 Mar 2018
Tell Me Where to Look: Guided Attention Inference Network Kunpeng Li Ziyan Wu Kuan-Chuan Peng Jan Ernst Y. Fu 124 532 0 27 Feb 2018
Learning to Compare: Relation Network for Few-Shot Learning Flood Sung Yongxin Yang Li Zhang Tao Xiang Philip Torr Timothy M. Hospedales 311 4,054 0 16 Nov 2017
One-Shot Learning for Semantic Segmentation Amirreza Shaban Shray Bansal Ziqiang Liu Irfan Essa Byron Boots SSeg VLM 125 704 0 11 Sep 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 833 11,952 0 09 Mar 2017
Feature Pyramid Networks for Object Detection Nayeon Lee Piotr Dollár Ross B. Girshick Kaiming He Bharath Hariharan Serge J. Belongie ObjD 488 22,158 0 09 Dec 2016
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 335 20,110 0 07 Oct 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 378 7,343 0 13 Jun 2016
Learning Deep Features for Discriminative Localization Bolei Zhou A. Khosla Àgata Lapedriza A. Oliva Antonio Torralba SSL SSeg FAtt 253 9,342 0 14 Dec 2015
BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation Jifeng Dai Kaiming He Jian Sun 204 1,046 0 05 Mar 2015