Isometric MT: Neural Machine Translation for Automatic Dubbing

Isometric MT: Neural Machine Translation for Automatic Dubbing

16 December 2021

Surafel Melaku Lakew

Prashant Mathur

Marcello Federico

Papers citing "Isometric MT: Neural Machine Translation for Automatic Dubbing"

17 / 17 papers shown

Title
Improving Lip-synchrony in Direct Audio-Visual Speech-to-Speech Translation Lucas Goncalves Prashant Mathur Xing Niu Brady Houston Chandrashekhar Lavania Srikanth Vishnubhotla Lijia Sun Anthony Ferritto 69 0 0 21 Dec 2024
IsoChronoMeter: A simple and effective isochronic translation evaluation metric Nikolai Rozanov Vikentiy Pankov Dmitrii Mukhutdinov Dima Vypirailenko 30 1 0 14 Oct 2024
SBAAM! Eliminating Transcript Dependency in Automatic Subtitling Marco Gaido Sara Papi Matteo Negri Mauro Cettolo L. Bentivogli 35 1 0 17 May 2024
Isometric Neural Machine Translation using Phoneme Count Ratio Reward-based Reinforcement Learning Shivam Mhaskar Nirmesh J. Shah Mohammadi Zaki Ashish Gudmalwar Pankaj Wasnik R. Shah 19 0 0 20 Mar 2024
ANIM-400K: A Large-Scale Dataset for Automated End-To-End Dubbing of Video Kevin Cai Chonghua Liu David M. Chan VGen 31 3 0 10 Jan 2024
Improving Isochronous Machine Translation with Target Factors and Auxiliary Counters Proyag Pal Brian Thompson Yogesh Virkar Prashant Mathur Alexandra Chronopoulou Marcello Federico 32 4 0 22 May 2023
Evaluating the Efficacy of Length-Controllable Machine Translation Hao Cheng Meng Zhang Weixuan Wang Liangyou Li Qun Liu Zhihua Zhang 32 0 0 03 May 2023
Jointly Optimizing Translations and Speech Timing to Improve Isochrony in Automatic Dubbing Alexandra Chronopoulou Brian Thompson Prashant Mathur Yogesh Virkar Surafel Melaku Lakew Marcello Federico 26 7 0 25 Feb 2023
Dubbing in Practice: A Large Scale Study of Human Localization With Insights for Automatic Dubbing William Brannon Yogesh Virkar Brian Thompson 42 21 0 23 Dec 2022
VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing Yihan Wu Junliang Guo Xuejiao Tan Chen Zhang Bohan Li Ruihua Song Lei He Sheng Zhao Arul Menezes Jiang Bian 32 15 0 30 Nov 2022
Direct Speech Translation for Automatic Subtitling Sara Papi Marco Gaido Alina Karakanta Mauro Cettolo Matteo Negri Marco Turchi 54 11 0 27 Sep 2022
Sockeye 3: Fast Neural Machine Translation with PyTorch Felix Hieber Michael J. Denkowski Tobias Domhan Barbara Darques Barros Celina Dong Ye ... Maria Nadejde Surafel Melaku Lakew Prashant Mathur Anna Currey Marcello Federico OSLM 32 10 0 12 Jul 2022
Face-Dubbing++: Lip-Synchronous, Voice Preserving Translation of Videos Alexander Waibel M. Behr Fevziye Irem Eyiokur Dogucan Yaman Tuan-Nam Nguyen Carlos Mullov Mehmet Arif Demirtas Alperen Kantarci Stefan Constantin H. K. Ekenel CVBM 15 14 0 09 Jun 2022
Prosodic Alignment for off-screen automatic dubbing Yogesh Virkar Marcello Federico Robert Enyedi Roberto Barra-Chicote 22 9 0 06 Apr 2022
Isochrony-Aware Neural Machine Translation for Automatic Dubbing Derek Tam Surafel Melaku Lakew Yogesh Virkar Prashant Mathur Marcello Federico 24 8 0 16 Dec 2021
Revisiting Self-Training for Neural Sequence Generation Junxian He Jiatao Gu Jiajun Shen MarcÁurelio Ranzato SSL LRM 244 269 0 30 Sep 2019
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016