Does Multimodality Help Human and Machine for Translation and Image
Captioning?

Does Multimodality Help Human and Machine for Translation and Image Captioning?

30 May 2016

Mercedes García-Martínez

Joost van de Weijer

Papers citing "Does Multimodality Help Human and Machine for Translation and Image Captioning?"

19 / 19 papers shown

Title
Memory Reviving, Continuing Learning and Beyond: Evaluation of Pre-trained Encoders and Decoders for Multimodal Machine Translation Zhuang Yu Shiliang Sun Jing Zhao Tengfei Song Hao Yang 48 0 0 25 Apr 2025
Detecting Concrete Visual Tokens for Multimodal Machine Translation Braeden Bowen Vipin Vijayan Scott Grigsby Timothy Anderson Jeremy Gwinnup 34 2 0 05 Mar 2024
Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages Baban Gain Dibyanayan Bandyopadhyay Subhabrata Mukherjee Chandranath Adak Asif Ekbal 29 2 0 30 Aug 2023
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation Julia Ive A. Li Yishu Miao Ozan Caglayan Pranava Madhyastha Lucia Specia 29 10 0 22 Feb 2021
Visual Pivoting for (Unsupervised) Entity Alignment Fangyu Liu Muhao Chen Dan Roth Nigel Collier OCL 21 117 0 28 Sep 2020
Multimodal Machine Translation through Visuals and Speech U. Sulubacak Ozan Caglayan Stig-Arne Gronroos Aku Rouhe Desmond Elliott Lucia Specia Jörg Tiedemann 49 73 0 28 Nov 2019
Transformer-based Cascaded Multimodal Speech Translation Zixiu "Alex" Wu Ozan Caglayan Julia Ive Josiah Wang Lucia Specia 25 7 0 29 Oct 2019
Input Combination Strategies for Multi-Source Transformer Decoder Jindrich Libovický Jindřich Helcl David Marecek 27 73 0 12 Nov 2018
CUNI System for the WMT18 Multimodal Translation Task Jindřich Helcl Jindrich Libovický Dušan Variš 16 57 0 12 Nov 2018
Doubly Attentive Transformer Machine Translation Hasan Sait Arslan Mark Fishel G. Anbarjafari 32 13 0 30 Jul 2018
Zero-Resource Neural Machine Translation with Multi-Agent Communication Game Yun Chen Yang Liu V. Li 41 47 0 09 Feb 2018
Visually Grounded Word Embeddings and Richer Visual Features for Improving Multimodal Neural Machine Translation Jean-Benoit Delbrouck Stéphane Dupont Omar Seddati 25 8 0 04 Jul 2017
Attention Strategies for Multi-Source Sequence-to-Sequence Learning Jindrich Libovický Jindřich Helcl AIMat 22 183 0 21 Apr 2017
Multimodal Compact Bilinear Pooling for Multimodal Neural Machine Translation Jean-Benoit Delbrouck Stéphane Dupont 37 30 0 23 Mar 2017
Doubly-Attentive Decoder for Multi-modal Neural Machine Translation Iacer Calixto Qun Liu N. Campbell 40 179 0 04 Feb 2017
Incorporating Global Visual Features into Attention-Based Neural Machine Translation Iacer Calixto Qun Liu Nick Campbell 32 154 0 23 Jan 2017
Neural Machine Translation with Latent Semantic of Image and Text Joji Toyama Masanori Misono Masahiro Suzuki Kotaro Nakayama Y. Matsuo 11 14 0 25 Nov 2016
Zero-Resource Translation with Multi-Lingual Neural Machine Translation Orhan Firat B. Sankaran Yaser Al-Onaizan Fatoş T. Yarman Vural Kyunghyun Cho 16 275 0 13 Jun 2016
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Orhan Firat Kyunghyun Cho Yoshua Bengio LRM AIMat 231 623 0 06 Jan 2016