Multimodal Machine Translation through Visuals and Speech

Multimodal Machine Translation through Visuals and Speech

28 November 2019

Stig-Arne Gronroos

Desmond Elliott

Jörg Tiedemann

Papers citing "Multimodal Machine Translation through Visuals and Speech"

16 / 16 papers shown

Title
AnyTrans: Translate AnyText in the Image with Large Scale Models Zhipeng Qian Pei Zhang Baosong Yang Kai Fan Yiwei Ma Derek F. Wong Xiaoshuai Sun Rongrong Ji VLM 40 1 0 17 Jun 2024
Silo NLP's Participation at WAT2022 Shantipriya Parida Subhadarshi Panda Stig-Arne Gronroos Mark Granroth-Wilding Mika Koistinen 18 3 0 02 Aug 2022
Multimodal Feature Extraction for Memes Sentiment Classification Sofiane Ouaari Tsegaye Misikir Tashu Tomáš Horváth 13 6 0 07 Jul 2022
EMMT: A simultaneous eye-tracking, 4-electrode EEG and audio corpus for multi-modal reading and translation scenarios Sunit Bhattacharya Vvera Kloudová Vilém Zouhar Ondrej Bojar 9 4 0 06 Apr 2022
VISA: An Ambiguous Subtitles Dataset for Visual Scene-Aware Machine Translation Yihang Li Shuichiro Shimizu Weiqi Gu Chenhui Chu Sadao Kurohashi 11 13 0 20 Jan 2022
Literature review on vulnerability detection using NLP technology Jiajie Wu 39 14 0 23 Apr 2021
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation Julia Ive A. Li Yishu Miao Ozan Caglayan Pranava Madhyastha Lucia Specia 22 10 0 22 Feb 2021
Fine-Grained Grounding for Multimodal Speech Recognition Tejas Srinivasan Ramon Sanabria Florian Metze Desmond Elliott 19 11 0 05 Oct 2020
Speech Translation and the End-to-End Promise: Taking Stock of Where We Are Matthias Sperber Matthias Paulik 30 106 0 14 Apr 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,956 0 20 Apr 2018
Tied Multitask Learning for Neural Speech Translation Antonios Anastasopoulos David Chiang 95 171 0 19 Feb 2018
End-to-End Automatic Speech Translation of Audiobooks Alexandre Berard Laurent Besacier A. Kocabiyikoglu Olivier Pietquin 75 190 0 12 Feb 2018
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 317 11,681 0 09 Mar 2017
OpenNMT: Open-Source Toolkit for Neural Machine Translation Guillaume Klein Yoon Kim Yuntian Deng Jean Senellart Alexander M. Rush 259 1,896 0 10 Jan 2017
Lip Reading Sentences in the Wild Joon Son Chung A. Senior Oriol Vinyals Andrew Zisserman 162 784 0 16 Nov 2016
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding Akira Fukui Dong Huk Park Daylen Yang Anna Rohrbach Trevor Darrell Marcus Rohrbach 152 1,465 0 06 Jun 2016