Embedding Compression for Teacher-to-Student Knowledge Transfer

9 February 2024

Papers citing "Embedding Compression for Teacher-to-Student Knowledge Transfer"

9 / 9 papers shown

Title
Feature-informed Embedding Space Regularization For Audio Classification Yun-Ning Hung Alexander Lerch 59 5 0 10 Jun 2022
Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution Ananya Kumar Aditi Raghunathan Robbie Jones Tengyu Ma Percy Liang OODD 120 681 0 21 Feb 2022
Efficient Training of Audio Transformers with Patchout Khaled Koutini Jan Schluter Hamid Eghbalzadeh Gerhard Widmer ViT 128 260 0 11 Oct 2021
Contrastive Learning of General-Purpose Audio Representations Aaqib Saeed David Grangier Neil Zeghidour VLM SSL 74 269 0 21 Oct 2020
Evaluation of CNN-based Automatic Music Tagging Models Minz Won Andrés Ferraro Dmitry Bogdanov Xavier Serra VLM 363 100 0 01 Jun 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition Qiuqiang Kong Yin Cao Turab Iqbal Yuxuan Wang Wenwu Wang Mark D. Plumbley VLM SSL 192 1,082 0 21 Dec 2019
FMA: A Dataset For Music Analysis M. Defferrard Kirell Benzi P. Vandergheynst Xavier Bresson 111 440 0 06 Dec 2016
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 308 3,887 0 19 Dec 2014