Orthogonality and isotropy of speaker and phonetic information in
self-supervised speech representations

Orthogonality and isotropy of speaker and phonetic information in self-supervised speech representations

13 June 2024

Mukhtar Mohamed

Sharon Goldwater

Papers citing "Orthogonality and isotropy of speaker and phonetic information in self-supervised speech representations"

12 / 12 papers shown

Title
Self-supervised Predictive Coding Models Encode Speaker and Phonetic Information in Orthogonal Subspaces Oli Danyi Liu Hao Tang Sharon Goldwater SSL 43 12 0 21 May 2023
Analyzing the Representational Geometry of Acoustic Word Embeddings Badr M. Abdullah Dietrich Klakow 37 3 0 08 Jan 2023
Opening the Black Box of wav2vec Feature Encoder Kwanghee Choi Eunjung Yeo SSL 60 16 0 27 Oct 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 89 852 0 07 Feb 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing Sanyuan Chen Chengyi Wang Zhengyang Chen Yu-Huan Wu Shujie Liu ... Yao Qian Jian Wu Micheal Zeng Xiangzhan Yu Furu Wei SSL 204 1,846 0 26 Oct 2021
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality William Timkey Marten van Schijndel 260 113 0 09 Sep 2021
Do Acoustic Word Embeddings Capture Phonological Similarity? An Empirical Study Badr M. Abdullah Marius Mosbach Iuliia Zaitova Bernd Möbius Dietrich Klakow 54 14 0 16 Jun 2021
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units Wei-Ning Hsu Benjamin Bolte Yao-Hung Hubert Tsai Kushal Lakhotia Ruslan Salakhutdinov Abdel-rahman Mohamed SSL 145 2,939 0 14 Jun 2021
Probing Acoustic Representations for Phonetic Properties Danni Ma Neville Ryant M. Liberman 37 45 0 25 Oct 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 217 5,767 0 20 Jun 2020
Fairness by Learning Orthogonal Disentangled Representations Mhd Hasan Sarhan Nassir Navab Abouzar Eslami Shadi Albarqouni FaML OOD CML 73 97 0 12 Mar 2020
Untangling in Invariant Speech Recognition Cory Stephenson J. Feather Suchismita Padhy Oguz H. Elibol Hanlin Tang Josh H. McDermott SueYeon Chung SSL 57 30 0 03 Mar 2020

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.