v1v2 (latest)

Toward a realistic model of speech processing in the brain with self-supervised learning

3 June 2022

Charlotte Caucheteux

Papers citing "Toward a realistic model of speech processing in the brain with self-supervised learning"

24 / 24 papers shown

Title
Improving Semantic Understanding in Speech Language Models via Brain-tuning Omer Moussa Dietrich Klakow Mariya Toneva 73 8 0 11 Oct 2024
Predicting non-native speech perception using the Perceptual Assimilation Model and state-of-the-art acoustic models Juliette Millet I. Chitoran Ewan Dunbar 50 5 0 31 May 2022
Do self-supervised speech models develop human-like perception biases? Juliette Millet Ewan Dunbar SSL 65 23 0 31 May 2022
Self-supervised models of audio effectively explain human cortical responses to speech Aditya R. Vaidya Shailee Jain Alexander G. Huth 75 48 0 27 May 2022
A Brief Overview of Unsupervised Neural Speech Representation Learning Lasse Borgholt Jakob Drachmann Havtorn Joakim Edin Lars Maaløe Christian Igel BDL AI4TS SSL 71 11 0 01 Mar 2022
Long-range and hierarchical language predictions in brains and algorithms Charlotte Caucheteux Alexandre Gramfort J. King 42 22 0 28 Nov 2021
Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects Charlotte Caucheteux Alexandre Gramfort J. King 90 32 0 12 Oct 2021
Layer-wise Analysis of a Self-supervised Speech Representation Model Ankita Pasad Ju-Chieh Chou Karen Livescu SSL 74 308 0 10 Jul 2021
Low-Dimensional Structure in the Space of Language Representations is Reflected in Brain Responses Richard Antonello Javier S. Turek Vy A. Vo Alexander G. Huth 71 41 0 09 Jun 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 153 944 0 11 May 2021
Disentangling Syntax and Semantics in the Brain with Deep Networks Charlotte Caucheteux Alexandre Gramfort J. King 101 72 0 02 Mar 2021
Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech Juliette Millet J. King 111 33 0 25 Feb 2021
Can RNNs learn Recursive Nested Subject-Verb Agreements? Yair Lakretz T. Desbordes J. King Benoît Crabbé Maxime Oquab S. Dehaene 173 19 0 06 Jan 2021
VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation Changhan Wang M. Rivière Ann Lee Anne Wu Chaitanya Talnikar Daniel Haziza Mary Williamson J. Pino Emmanuel Dupoux SSL 100 490 0 02 Jan 2021
Self-training and Pre-training are Complementary for Speech Recognition Qiantong Xu Alexei Baevski Tatiana Likhomanenko Paden Tomasello Alexis Conneau R. Collobert Gabriel Synnaeve Michael Auli SSL VLM 133 173 0 22 Oct 2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 288 5,837 0 20 Jun 2020
Untangling in Invariant Speech Recognition Cory Stephenson J. Feather Suchismita Padhy Oguz H. Elibol Hanlin Tang Josh H. McDermott SueYeon Chung SSL 71 31 0 03 Mar 2020
Common Voice: A Massively-Multilingual Speech Corpus Rosana Ardila Megan Branson Kelly Davis Michael Henretty M. Kohler Josh Meyer Reuben Morais Lindsay Saunders Francis M. Tyers Gregor Weber VLM 91 1,614 0 13 Dec 2019
Inducing brain-relevant bias in natural language processing models Dan Schwartz Mariya Toneva Leila Wehbe 51 80 0 29 Oct 2019
Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain) Mariya Toneva Leila Wehbe MILM AI4CE 77 229 0 28 May 2019
Cognitive Science in the era of Artificial Intelligence: A roadmap for reverse-engineering the infant language-learner Emmanuel Dupoux 66 158 0 29 Jul 2016
Bridging LSTM Architecture and the Neural Dynamics during Reading Peng Qian Xipeng Qiu Xuanjing Huang 39 19 0 22 Apr 2016
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin Dario Amodei Rishita Anubhai Eric Battenberg Carl Case Jared Casper ... Chong-Jun Wang Bo Xiao Dani Yogatama J. Zhan Zhenyao Zhu 137 2,974 0 08 Dec 2015
Machine Learning for Neuroimaging with Scikit-Learn Alexandre Abraham Fabian Pedregosa Michael Eickenberg Philippe Gervais A. Mueller Jean Kossaifi Alexandre Gramfort Bertrand Thirion Gaël Varoquaux AI4CE 66 1,821 0 12 Dec 2014