A Cascade Sequence-to-Sequence Model for Chinese Mandarin Lip Reading

14 August 2019

Papers citing "A Cascade Sequence-to-Sequence Model for Chinese Mandarin Lip Reading"

24 / 24 papers shown

Title
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides Jinghua Zhao Yuhang Jia Shiyao Wang Jiaming Zhou Hui Wang Yong Qin 39 0 0 21 Apr 2025
STSA: Spatial-Temporal Semantic Alignment for Visual Dubbing Zijun Ding Mingdie Xiong Congcong Zhu Jingrun Chen DiffM 61 0 0 29 Mar 2025
RAL:Redundancy-Aware Lipreading Model Based on Differential Learning with Symmetric Views Zejun gu Junxia jiang 36 0 0 09 Sep 2024
A Large-scale Universal Evaluation Benchmark For Face Forgery Detection Yijun Bei Hengrui Lou Jinsong Geng Erteng Liu Lechao Cheng Jie Song Mingli Song Zunlei Feng CVBM 51 0 0 13 Jun 2024
Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization Linzhi Wu Xingyu Zhang Yakun Zhang Changyan Zheng Tiejun Liu Liang Xie Ye Yan Erwei Yin 35 1 0 24 Mar 2024
JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition Chang Sun Hong Yang Bo Qin VLM 35 1 0 04 Mar 2024
MCF-VC: Mitigate Catastrophic Forgetting in Class-Incremental Learning for Multimodal Video Captioning Huiyu Xiong Lanxiao Wang Heqian Qiu Taijin Zhao Benliu Qiu Hongliang Li CLL 46 1 0 27 Feb 2024
AnnoTheia: A Semi-Automatic Annotation Toolkit for Audio-Visual Speech Technologies José-M. Acosta-Triana David Gimeno-Gómez Carlos David Martínez Hinarejos VLM VGen 47 2 0 20 Feb 2024
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge Minsu Kim Jeong Hun Yeo J. Choi Y. Ro 34 16 0 18 Aug 2023
Improving Audio-Visual Speech Recognition by Lip-Subword Correlation Based Visual Pre-training and Cross-Modal Fusion Encoder Yusheng Dai Hang Chen Jun Du xiao-ying Ding Ning Ding Feijun Jiang Chin-Hui Lee 29 7 0 14 Aug 2023
Automated Speaker Independent Visual Speech Recognition: A Comprehensive Survey Praneeth Nemani G. S. Krishna Kundrapu Supriya BDL 34 3 0 14 Jun 2023
Learning Cross-lingual Visual Speech Representations Andreas Zinonos A. Haliassos Pingchuan Ma Stavros Petridis M. Pantic SSL 22 8 0 14 Mar 2023
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition Xize Cheng Lin Li Tao Jin Rongjie Huang Wang Lin Zehan Wang Huangdai Liu Yejin Wang Aoxiong Yin Zhou Zhao 26 24 0 09 Mar 2023
MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation Mohamed Anwar Bowen Shi Vedanuj Goswami Wei-Ning Hsu J. Pino Changhan Wang 47 37 0 01 Mar 2023
LipFormer: Learning to Lipread Unseen Speakers based on Visual-Landmark Transformers Feng Xue Yu Li Deyin Liu Yincen Xie Lin Wu Richang Hong 41 12 0 04 Feb 2023
A Multi-Purpose Audio-Visual Corpus for Multi-Modal Persian Speech Recognition: the Arman-AV Dataset J. Peymanfard Samin Heydarian Ali Lashini Hossein Zeinali Mohammad Reza Mohammadi N. Mozayani 29 10 0 21 Jan 2023
Visual Speech Recognition for Multiple Languages in the Wild Pingchuan Ma Stavros Petridis M. Pantic VLM 130 145 0 26 Feb 2022
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading Leyuan Qu C. Weber S. Wermter 38 23 0 09 Dec 2021
Advances and Challenges in Deep Lip Reading Marzieh Oghbaie Arian Sabaghi Kooshan Hashemifard Mohammad Akbari VLM 30 15 0 15 Oct 2021
Perception Point: Identifying Critical Learning Periods in Speech for Bilingual Networks Anuj Saraswat Mehar Bhatia Yaman Kumar Singla Changyou Chen R. Shah 16 0 0 13 Oct 2021
Synchronous Bidirectional Learning for Multilingual Lip Reading Mingshuang Luo Shuang Yang Xilin Chen Zitao Liu Shiguang Shan 30 15 0 08 May 2020
Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition Yuanhang Zhang Shuang Yang Jingyun Xiao Shiguang Shan Xilin Chen 15 64 0 06 Mar 2020
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers Ya Zhao Rui Xu Xinchao Wang Peng Hou Haihong Tang Xiuming Zhang 9 89 0 26 Nov 2019
Lip Reading Sentences in the Wild Joon Son Chung A. Senior Oriol Vinyals Andrew Zisserman 185 784 0 16 Nov 2016