Unsupervised pretraining transfers well across languages

7 February 2020

M. Rivière

Armand Joulin

Pierre-Emmanuel Mazaré

Papers citing "Unsupervised pretraining transfers well across languages"

21 / 21 papers shown

Title
Yeah, Un, Oh: Continuous and Real-time Backchannel Prediction with Fine-tuning of Voice Activity Projection K. Inoue Divesh Lala Gabriel Skantze Tatsuya Kawahara 50 3 0 21 Oct 2024
Efficient Training of Self-Supervised Speech Foundation Models on a Compute Budget Andy T. Liu Yi-Cheng Lin Haibin Wu Stefan Winkler Hung-yi Lee 82 2 0 09 Sep 2024
Losses Can Be Blessings: Routing Self-Supervised Speech Representations Towards Efficient Multilingual and Multitask Speech Processing Yonggan Fu Yang Zhang Kaizhi Qian Zhifan Ye Zhongzhi Yu Cheng-I Jeff Lai Yingyan Lin 132 9 0 02 Nov 2022
Learning Robust and Multilingual Speech Representations Kazuya Kawakami Luyu Wang Chris Dyer Phil Blunsom Aaron van den Oord SSL 71 100 0 29 Jan 2020
Libri-Light: A Benchmark for ASR with Limited or No Supervision Jacob Kahn M. Rivière Weiyi Zheng Evgeny Kharitonov Qiantong Xu ... Tatiana Likhomanenko Gabriel Synnaeve Armand Joulin Abdel-rahman Mohamed Emmanuel Dupoux AuLLM 65 670 0 17 Dec 2019
Multilingual Speech Recognition with Corpus Relatedness Sampling Xinjian Li Siddharth Dalmia A. Black Florian Metze 31 17 0 02 Aug 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 166 2,399 0 13 Jun 2019
wav2vec: Unsupervised Pre-training for Speech Recognition Steffen Schneider Alexei Baevski R. Collobert Michael Auli SSL 71 418 0 11 Apr 2019
Massively Multilingual Adversarial Speech Recognition Oliver Adams Sanjeev Khudanpur Shinji Watanabe David Yarowsky 43 76 0 03 Apr 2019
Unsupervised speech representation learning using WaveNet autoencoders J. Chorowski Ron J. Weiss Samy Bengio Aaron van den Oord SSL 72 318 0 25 Jan 2019
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 315 2,661 0 20 Aug 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 318 10,284 0 10 Jul 2018
Sequence-based Multi-lingual Low Resource Speech Recognition Siddharth Dalmia Ramon Sanabria Florian Metze A. Black 55 94 0 21 Feb 2018
The Zero Resource Speech Challenge 2017 Maarten Versteegh Xuan-Nga Cao Roland Thiollière Thomas Schatz Mathieu Bernard A. Jansen Xavier Anguera Miró Emmanuel Dupoux 65 203 0 12 Dec 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 695 131,526 0 12 Jun 2017
Unsupervised Learning by Predicting Noise Piotr Bojanowski Armand Joulin OOD SSL 56 295 0 18 Apr 2017
Unsupervised Feature Extraction by Time-Contrastive Learning and Nonlinear ICA Aapo Hyvarinen H. Morioka CML OOD AI4TS 61 409 0 20 May 2016
FaceNet: A Unified Embedding for Face Recognition and Clustering Florian Schroff Dmitry Kalenichenko James Philbin 3DH 370 13,143 0 12 Mar 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 463 43,289 0 11 Feb 2015
Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks Alexey Dosovitskiy Philipp Fischer Jost Tobias Springenberg Martin Riedmiller Thomas Brox OOD SSL 84 1,018 0 26 Jun 2014
Distributed Representations of Words and Phrases and their Compositionality Tomas Mikolov Ilya Sutskever Kai Chen G. Corrado J. Dean NAI OCL 394 33,521 0 16 Oct 2013