v1v2 (latest)

Lip Reading Sentences in the Wild

16 November 2016

Joon Son Chung

Papers citing "Lip Reading Sentences in the Wild"

50 / 344 papers shown

Title
Learn an Effective Lip Reading Model without Pains Dalu Feng Shuang Yang Shiguang Shan Xilin Chen 89 62 0 15 Nov 2020
Augmenting Images for ASR and TTS through Single-loop and Dual-loop Multimodal Chain Framework Johanes Effendi Andros Tjandra S. Sakti Satoshi Nakamura 28 3 0 04 Nov 2020
Watch, read and lookup: learning to spot signs from multiple supervisors Liliane Momeni Gül Varol Samuel Albanie Triantafyllos Afouras Andrew Zisserman 75 44 0 08 Oct 2020
Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognition Srinivas Parthasarathy Shiva Sundaram 84 79 0 02 Oct 2020
Lip-reading with Densely Connected Temporal Convolutional Networks Pingchuan Ma Yujiang Wang Jie Shen Stavros Petridis Maja Pantic 83 58 0 29 Sep 2020
Correlating Subword Articulation with Lip Shapes for Embedding Aware Audio-Visual Speech Enhancement Hang Chen Jun Du Yu Hu Lirong Dai Baocai Yin Chin-Hui Lee 86 20 0 21 Sep 2020
Temporally Guided Music-to-Body-Movement Generation Hsuan-Kai Kao Li Su 124 43 0 17 Sep 2020
Silent Speech Interfaces for Speech Restoration: A Review Jose Andres Gonzalez Lopez Alejandro Gomez-Alanis Juan M. Martín-Donas J. L. Pérez-Córdoba A. Gómez 77 88 0 04 Sep 2020
Seeing wake words: Audio-visual Keyword Spotting Liliane Momeni Triantafyllos Afouras Themos Stafylakis Samuel Albanie Andrew Zisserman 99 44 0 02 Sep 2020
Multi-channel Transformers for Multi-articulatory Sign Language Translation Necati Cihan Camgöz Oscar Koller Simon Hadfield Richard Bowden 58 123 0 01 Sep 2020
Attentive Fusion Enhanced Audio-Visual Encoding for Transformer Based Robust Speech Recognition L. Wei Jie Zhang Junfeng Hou Lirong Dai 64 14 0 06 Aug 2020
FastLR: Non-Autoregressive Lipreading Model with Integrate-and-Fire Jinglin Liu Yi Ren Zhou Zhao Chen Zhang Baoxing Huai Jing Yuan 75 12 0 06 Aug 2020
Families In Wild Multimedia: A Multimodal Database for Recognizing Kinship Joseph P. Robinson Zaid Khan Yu Yin Ming Shao Y. Fu 56 7 0 28 Jul 2020
Multimodal Integration for Large-Vocabulary Audio-Visual Speech Recognition Wentao Yu Steffen Zeiler D. Kolossa 63 10 0 28 Jul 2020
Foley Music: Learning to Generate Music from Videos Chuang Gan Deng Huang Peihao Chen J. Tenenbaum Antonio Torralba VGen 75 139 0 21 Jul 2020
CSLNSpeech: solving extended speech separation problem with the help of Chinese sign language Jiasong Wu Xuan Li Taotao Li Fanman Meng Youyong Kong Guanyu Yang L. Senhadji Huazhong Shu CVBM 84 0 0 21 Jul 2020
Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation Hang Zhou Xudong Xu Dahua Lin Xiaogang Wang Ziwei Liu DiffM 80 84 0 20 Jul 2020
Towards Practical Lipreading with Distilled and Efficient Models Pingchuan Ma Brais Martínez Stavros Petridis Maja Pantic 93 97 0 13 Jul 2020
"Notic My Speech" -- Blending Speech Patterns With Multimedia Dhruva Sahrawat Yaman Kumar Singla Shashwat Aggarwal Yifang Yin R. Shah Roger Zimmermann 72 3 0 12 Jun 2020
Speech Fusion to Face: Bridging the Gap Between Human's Vocal Characteristics and Facial Imaging Yeqi Bai Tao Ma Lipo Wang Zhenjie Zhang CVBM 27 9 0 10 Jun 2020
Modality Dropout for Improved Performance-driven Talking Faces Ahmed Hussen Abdelaziz B. Theobald Paul Dixon Reinhard Knothe N. Apostoloff Sachin Kajareker 69 37 0 27 May 2020
SpotFast Networks with Memory Augmented Lateral Transformers for Lipreading Peratham Wiriyathammabhum 62 8 0 21 May 2020
Active Speakers in Context Juan Carlos León Alcázar Fabian Caba Heilbron Long Mai Federico Perazzi Joon-Young Lee Pablo Arbelaez Guohao Li 72 62 0 20 May 2020
Should we hard-code the recurrence concept or learn it instead ? Exploring the Transformer architecture for Audio-Visual Speech Recognition George Sterpu Christian Saam N. Harte 41 7 0 19 May 2020
End-to-End Lip Synchronisation Based on Pattern Classification You Jin Kim Hee-Soo Heo Soo-Whan Chung Bong-Jin Lee CVBM 40 0 0 18 May 2020
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis Prajwal K R Rudrabha Mukhopadhyay Vinay P. Namboodiri C. V. Jawahar 71 113 0 17 May 2020
Discriminative Multi-modality Speech Recognition Bo Xu Cheng Lu Yandong Guo Jacob Wang 91 99 0 12 May 2020
Synchronous Bidirectional Learning for Multilingual Lip Reading Mingshuang Luo Shuang Yang Xilin Chen Zitao Liu Shiguang Shan 94 16 0 08 May 2020
Seeing voices and hearing voices: learning discriminative embeddings using cross-modal self-supervision Soo-Whan Chung Hong-Goo Kang Joon Son Chung SSL 48 39 0 29 Apr 2020
Neural Head Reenactment with Latent Pose Descriptors Egor Burkov I. Pasechnik Artur Grigorev Victor Lempitsky 3DH 128 131 0 24 Apr 2020
Music Gesture for Visual Sound Separation Chuang Gan Deng Huang Hang Zhao J. Tenenbaum Antonio Torralba 97 205 0 20 Apr 2020
How to Teach DNNs to Pay Attention to the Visual Modality in Speech Recognition George Sterpu Christian Saam N. Harte 74 29 0 17 Apr 2020
From Inference to Generation: End-to-end Fully Self-supervised Generation of Human Face from Speech Hyeong-Seok Choi Changdae Park Kyogu Lee CVBM 48 29 0 13 Apr 2020
Vocoder-Based Speech Synthesis from Silent Videos Daniel Michelsanti Olga Slizovskaia G. Haro Emilia Gómez Zheng-Hua Tan Jesper Jensen 90 32 0 06 Apr 2020
Mutual Information Maximization for Effective Lip Reading Xingyuan Zhao Shuang Yang Shiguang Shan Xilin Chen 74 59 0 13 Mar 2020
Deformation Flow Based Two-Stream Network for Lip Reading Jingyun Xiao Shuang Yang Yuanhang Zhang Shiguang Shan Xilin Chen 56 64 0 12 Mar 2020
Pseudo-Convolutional Policy Gradient for Sequence-to-Sequence Lip-Reading Mingshuang Luo Shuang Yang Shiguang Shan Xilin Chen 87 41 0 09 Mar 2020
Self-supervised learning for audio-visual speaker diarization Yifan Ding Yong-mei Xu Shi-Xiong Zhang Yahuan Cong Liqiang Wang VLM 78 29 0 13 Feb 2020
Audiovisual SlowFast Networks for Video Recognition Fanyi Xiao Yong Jae Lee Kristen Grauman Jitendra Malik Christoph Feichtenhofer 282 209 0 23 Jan 2020
Lipreading using Temporal Convolutional Networks Brais Martínez Pingchuan Ma Stavros Petridis Maja Pantic 241 241 0 23 Jan 2020
Deep Audio-Visual Learning: A Survey Hao Zhu Mandi Luo Rui Wang A. Zheng Ran He 75 162 0 14 Jan 2020
A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs S. Fresca Luca Dede' Andrea Manzoni AI4CE 100 267 0 12 Jan 2020
Audio-visual Recognition of Overlapped speech for the LRS2 dataset Jianwei Yu Shi-Xiong Zhang Jian Wu Shahram Ghorbani Bo Wu Shiyin Kang Shansong Liu Xunying Liu Helen Meng Dong Yu 93 73 0 06 Jan 2020
Multimodal Self-Supervised Learning for Medical Image Analysis Aiham Taleb C. Lippert T. Klein Moin Nabi SSL 99 98 0 11 Dec 2019
Multimodal Machine Translation through Visuals and Speech U. Sulubacak Ozan Caglayan Stig-Arne Gronroos Aku Rouhe Desmond Elliott Lucia Specia Jörg Tiedemann 101 77 0 28 Nov 2019
ASR is all you need: cross-modal distillation for lip reading Triantafyllos Afouras Joon Son Chung Andrew Zisserman 72 135 0 28 Nov 2019
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers Ya Zhao Rui Xu Xinchao Wang Peng Hou Haihong Tang Xiuming Zhang 68 91 0 26 Nov 2019
Towards Pose-invariant Lip-Reading Shiyang Cheng Pingchuan Ma Georgios Tzimiropoulos Stavros Petridis Adrian Bulat Jie Shen Maja Pantic 71 26 0 14 Nov 2019
Recurrent Neural Network Transducer for Audio-Visual Speech Recognition Takaki Makino H. Liao Yannis Assael Brendan Shillingford Basi García Otavio Braga Olivier Siohan 89 131 0 08 Nov 2019
Vision-Infused Deep Audio Inpainting Hang Zhou Ziwei Liu Lingfeng Guo Ping Luo Dahua Lin 145 88 0 24 Oct 2019