v1v2 (latest)

Tiny models from tiny data: Textual and null-text inversion for few-shot distillation

5 June 2024

Papers citing "Tiny models from tiny data: Textual and null-text inversion for few-shot distillation"

27 / 77 papers shown

Title
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 391 6,813 0 23 Dec 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 684 41,563 0 22 Oct 2020
Denoising Diffusion Implicit Models Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 304 7,500 0 06 Oct 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 785 18,408 0 19 Jun 2020
Enhancing Few-Shot Image Classification with Unlabelled Examples Peyman Bateni Jarred Barber Jan-Willem van de Meent Frank Wood VLM SSL 121 57 0 17 Jun 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 207 2,993 0 09 Jun 2020
Associative Alignment for Few-shot Image Classification Arman Afrasiyabi Jean-François Lalonde Christian Gagné VLM 75 151 0 11 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 580 42,677 0 03 Dec 2019
Self-Supervised Learning For Few-Shot Image Classification Da Chen YueFeng Chen Yuhong Li Feng Mao Yuan He Hui Xue SSL 73 110 0 14 Nov 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 181 1,056 0 23 Oct 2019
Charting the Right Manifold: Manifold Mixup for Few-shot Learning Puneet Mangla M. Singh Abhishek Sinha Nupur Kumari V. Balasubramanian Balaji Krishnamurthy SSL 109 328 0 28 Jul 2019
Boosting Few-Shot Visual Learning with Self-Supervision Spyros Gidaris Andrei Bursuc N. Komodakis P. Pérez Matthieu Cord SSL 101 405 0 12 Jun 2019
Generating Diverse High-Fidelity Images with VQ-VAE-2 Ali Razavi Aaron van den Oord Oriol Vinyals DRL BDL 153 1,828 0 02 Jun 2019
Variational Information Distillation for Knowledge Transfer SungSoo Ahn S. Hu Andreas C. Damianou Neil D. Lawrence Zhenwen Dai 93 621 0 11 Apr 2019
Meta-Learning with Differentiable Convex Optimization Kwonjoon Lee Subhransu Maji Avinash Ravichandran Stefano Soatto 98 1,269 0 07 Apr 2019
Few-Shot Learning via Embedding Adaptation with Set-to-Set Functions Han-Jia Ye Hexiang Hu De-Chuan Zhan Fei Sha 142 667 0 10 Dec 2018
TADAM: Task dependent adaptive metric for improved few-shot learning Boris N. Oreshkin Pau Rodríguez López Alexandre Lacoste 104 1,315 0 23 May 2018
Meta-learning with differentiable closed-form solvers Luca Bertinetto João F. Henriques Philip Torr Andrea Vedaldi ODL 102 931 0 21 May 2018
Low-Shot Learning from Imaginary Data Yu-Xiong Wang Ross B. Girshick M. Hebert Bharath Hariharan VLM 124 677 0 16 Jan 2018
Few-Shot Image Recognition by Predicting Parameters from Activations Siyuan Qiao Chenxi Liu Wei Shen Alan Yuille VLM 101 554 0 12 Jun 2017
Prototypical Networks for Few-shot Learning Jake C. Snell Kevin Swersky R. Zemel 307 8,164 0 15 Mar 2017
Remote Sensing Image Scene Classification: Benchmark and State of the Art Gong Cheng Junwei Han Xiaoqiang Lu 108 2,269 0 01 Mar 2017
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 380 7,343 0 13 Jun 2016
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.9K 77,520 0 18 May 2015
Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Feature Babak Saleh Ahmed Elgammal 68 290 0 05 May 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 367 19,764 0 09 Mar 2015
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 442 43,875 0 01 May 2014