Robust Multi-Modal Speech In-Painting: A Sequence-to-Sequence Approach

2 June 2024

Papers citing "Robust Multi-Modal Speech In-Painting: A Sequence-to-Sequence Approach"

21 / 21 papers shown

Title
Sequence-to-Sequence Multi-Modal Speech In-Painting Mahsa Kadkhodaei Elyaderani S. Shirani 59 1 0 03 Jun 2024
Speech inpainting: Context-based speech synthesis guided by video Juan F. Montesinos Daniel Michelsanti G. Haro Zheng-Hua Tan Jesper Jensen 68 3 0 01 Jun 2023
Multimodal Learning with Transformers: A Survey Peng Xu Xiatian Zhu David Clifton ViT 191 567 0 13 Jun 2022
SpeechPainter: Text-conditioned Speech Inpainting Zalan Borsos Matthew Sharifi Marco Tagliasacchi 93 28 0 15 Feb 2022
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction Bowen Shi Wei-Ning Hsu Kushal Lakhotia Abdel-rahman Mohamed SSL 98 320 0 05 Jan 2022
Perceiver IO: A General Architecture for Structured Inputs & Outputs Andrew Jaegle Sebastian Borgeaud Jean-Baptiste Alayrac Carl Doersch Catalin Ionescu ... Olivier J. Hénaff M. Botvinick Andrew Zisserman Oriol Vinyals João Carreira MLLM VLM GNN 82 584 0 30 Jul 2021
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units Wei-Ning Hsu Benjamin Bolte Yao-Hung Hubert Tsai Kushal Lakhotia Ruslan Salakhutdinov Abdel-rahman Mohamed SSL 180 2,993 0 14 Jun 2021
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations Alexei Baevski Henry Zhou Abdel-rahman Mohamed Michael Auli SSL 295 5,837 0 20 Jun 2020
Audio inpainting with generative adversarial network P. Ebner Amr Eltelt GAN 53 24 0 13 Mar 2020
Deep Long Audio Inpainting Ya-Liang Chang Kuan-Ying Lee Po-Yu Wu Hung-yi Lee Winston H. Hsu 56 33 0 15 Nov 2019
Vision-Infused Deep Audio Inpainting Hang Zhou Ziwei Liu Lingfeng Guo Ping Luo Dahua Lin 140 88 0 24 Oct 2019
Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments Yufei Wang Luca Pasa Lantao Yu Rohit Singh Luciano Fadiga L. Joppa CVBM 60 60 0 06 Nov 2018
Learn to Combine Modalities in Multimodal Deep Learning Kuan Liu Yanen Li N. Xu Premkumar Natarajan 68 150 0 29 May 2018
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions Jonathan Shen Ruoming Pang Ron J. Weiss M. Schuster Navdeep Jaitly ... Yuxuan Wang RJ Skerry-Ryan Rif A. Saurous Yannis Agiomyrgiannakis Yonghui Wu 79 2,703 0 16 Dec 2017
Parallel WaveNet: Fast High-Fidelity Speech Synthesis Aaron van den Oord Yazhe Li Igor Babuschkin Karen Simonyan Oriol Vinyals ... Alex Graves Helen King T. Walters Dan Belov Demis Hassabis 218 859 0 28 Nov 2017
SampleRNN: An Unconditional End-to-End Neural Audio Generation Model Soroush Mehri Kundan Kumar Ishaan Gulrajani Rithesh Kumar Shubham Jain Jose M. R. Sotelo Aaron Courville Yoshua Bengio 111 599 0 22 Dec 2016
LipNet: End-to-End Sentence-level Lipreading Yannis Assael Brendan Shillingford Shimon Whiteson Nando de Freitas 82 397 0 05 Nov 2016
WaveNet: A Generative Model for Raw Audio Aaron van den Oord Sander Dieleman Heiga Zen Karen Simonyan Oriol Vinyals Alex Graves Nal Kalchbrenner A. Senior Koray Kavukcuoglu DiffM 406 7,414 0 12 Sep 2016
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 338 18,651 0 06 Feb 2015
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling Junyoung Chung Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 601 12,734 0 11 Dec 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 443 20,584 0 10 Sep 2014