Towards Automatic Assessment of Self-Supervised Speech Models using Rank

Towards Automatic Assessment of Self-Supervised Speech Models using Rank

16 September 2024

Zakaria Aldeneh

Tatiana Likhomanenko

Papers citing "Towards Automatic Assessment of Self-Supervised Speech Models using Rank"

13 / 13 papers shown

Title
A Large-Scale Evaluation of Speech Foundation Models Shu-Wen Yang Heng-Jui Chang Zili Huang Andy T. Liu Cheng-I Jeff Lai ... Kushal Lakhotia Shang-Wen Li Abdelrahman Mohamed Shinji Watanabe Hung-yi Lee 68 25 0 15 Apr 2024
LiDAR: Sensing Linear Probing Performance in Joint Embedding SSL Architectures Vimal Thilak Chen Huang Omid Saremi Laurent Dinh Hanlin Goh Preetum Nakkiran Josh Susskind Etai Littwin 73 9 0 07 Dec 2023
Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute William Chen Xuankai Chang Yifan Peng Zhaoheng Ni Soumi Maiti Shinji Watanabe SSL 58 27 0 11 Jun 2023
How to Estimate Model Transferability of Pre-Trained Speech Models? Zih-Ching Chen Chao-Han Huck Yang Yue Liu Yu Zhang Nanxin Chen Shoufeng Chang Rohit Prabhavalkar Hung-yi Lee Tara N. Sainath 93 9 0 01 Jun 2023
Unsupervised Embedding Quality Evaluation Anton Tsitsulin Marina Munkhoeva Bryan Perozzi SSL 34 7 0 26 May 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 55 34 0 27 Mar 2023
RankMe: Assessing the downstream performance of pretrained self-supervised representations by their rank Q. Garrido Randall Balestriero Laurent Najman Yann LeCun SSL 90 76 0 05 Oct 2022
Self-Supervised Speech Representation Learning: A Review Abdel-rahman Mohamed Hung-yi Lee Lasse Borgholt Jakob Drachmann Havtorn Joakim Edin ... Shang-Wen Li Karen Livescu Lars Maaløe Tara N. Sainath Shinji Watanabe SSL AI4TS 159 364 0 21 May 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features Neha Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi Soheil Feizi SSL 66 8 0 03 Mar 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing Sanyuan Chen Chengyi Wang Zhengyang Chen Yu-Huan Wu Shujie Liu ... Yao Qian Jian Wu Micheal Zeng Xiangzhan Yu Furu Wei SSL 206 1,846 0 26 Oct 2021
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units Wei-Ning Hsu Benjamin Bolte Yao-Hung Hubert Tsai Kushal Lakhotia Ruslan Salakhutdinov Abdel-rahman Mohamed SSL 147 2,939 0 14 Jun 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 168 191 0 02 May 2021
VoxCeleb: a large-scale speaker identification dataset Arsha Nagrani Joon Son Chung Andrew Zisserman 117 2,273 0 26 Jun 2017