ResearchTrend.AI
Predicting Multi-Codebook Vector Quantization Indexes for Knowledge Distillation

Predicting Multi-Codebook Vector Quantization Indexes for Knowledge Distillation

Liyong Guo
Xiaoyu Yang
Quandong Wang
Yuxiang Kong
Zengwei Yao
Fan Cui
Fangjun Kuang
Wei Kang
Long Lin
Mingshuang Luo
Piotr Żelasko
Daniel Povey
    VLM
ArXiv (abs)PDFHTML

Papers citing "Predicting Multi-Codebook Vector Quantization Indexes for Knowledge Distillation"

4 / 4 papers shown
Title
MT2KD: Towards A General-Purpose Encoder for Speech, Speaker, and Audio Events
MT2KD: Towards A General-Purpose Encoder for Speech, Speaker, and Audio Events
Xiaoyu Yang
Qiujia Li
Chao Zhang
P. Woodland
132
1
0
25 Sep 2024
Compact Speech Translation Models via Discrete Speech Units Pretraining
Compact Speech Translation Models via Discrete Speech Units Pretraining
Tsz Kin Lam
Alexandra Birch
Barry Haddow
128
3
0
29 Feb 2024
DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes
DeCoR: Defy Knowledge Forgetting by Predicting Earlier Audio Codes
Xilin Jiang
Yinghao Aaron Li
N. Mesgarani
CLL
50
1
0
29 May 2023
Knowledge Distillation from Multiple Foundation Models for End-to-End Speech Recognition
Knowledge Distillation from Multiple Foundation Models for End-to-End Speech Recognition
Xiaoyu Yang
Qiujia Li
Chuxu Zhang
P. Woodland
87
7
0
20 Mar 2023

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.