Orthogonality and isotropy of speaker and phonetic information in
self-supervised speech representations

Orthogonality and isotropy of speaker and phonetic information in self-supervised speech representations

13 June 2024

Mukhtar Mohamed

Sharon Goldwater

Papers citing "Orthogonality and isotropy of speaker and phonetic information in self-supervised speech representations"

13 / 13 papers shown

Title
Self-supervised Predictive Coding Models Encode Speaker and Phonetic Information in Orthogonal Subspaces Oli Danyi Liu Hao Tang Sharon Goldwater SSL 43 12 0 21 May 2023
Analyzing the Representational Geometry of Acoustic Word Embeddings Badr M. Abdullah Dietrich Klakow 37 3 0 08 Jan 2023
Opening the Black Box of wav2vec Feature Encoder Kwanghee Choi Eunjung Yeo SSL 60 16 0 27 Oct 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 89 852 0 07 Feb 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing Sanyuan Chen Chengyi Wang Zhengyang Chen Yu-Huan Wu Shujie Liu ... Yao Qian Jian Wu Micheal Zeng Xiangzhan Yu Furu Wei SSL 206 1,846 0 26 Oct 2021
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality William Timkey Marten van Schijndel 260 113 0 09 Sep 2021
Layer-wise Analysis of a Self-supervised Speech Representation Model Ankita Pasad Ju-Chieh Chou Karen Livescu SSL 49 302 0 10 Jul 2021
Do Acoustic Word Embeddings Capture Phonological Similarity? An Empirical Study Badr M. Abdullah Marius Mosbach Iuliia Zaitova Bernd Möbius Dietrich Klakow 57 14 0 16 Jun 2021
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units Wei-Ning Hsu Benjamin Bolte Yao-Hung Hubert Tsai Kushal Lakhotia Ruslan Salakhutdinov Abdel-rahman Mohamed SSL 147 2,939 0 14 Jun 2021
Probing Acoustic Representations for Phonetic Properties Danni Ma Neville Ryant M. Liberman 37 45 0 25 Oct 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 225 5,767 0 20 Jun 2020
Fairness by Learning Orthogonal Disentangled Representations Mhd Hasan Sarhan Nassir Navab Abouzar Eslami Shadi Albarqouni FaML OOD CML 81 97 0 12 Mar 2020
Untangling in Invariant Speech Recognition Cory Stephenson J. Feather Suchismita Padhy Oguz H. Elibol Hanlin Tang Josh H. McDermott SueYeon Chung SSL 57 30 0 03 Mar 2020