Multimodal Attention for Neural Machine Translation

13 September 2016

Papers citing "Multimodal Attention for Neural Machine Translation"

40 / 40 papers shown

Title
Chitranuvad: Adapting Multi-Lingual LLMs for Multimodal Translation Shaharukh Khan Ayush Tarun Ali Faraz Palash Kamble Vivek Dahiya Praveen Kumar Pokala Ashish Kulkarni Chandra Khatri Abhinav Ravi Shubham Agarwal 163 0 0 27 Feb 2025
DAT: Dialogue-Aware Transformer with Modality-Group Fusion for Human Engagement Estimation Jia Li Yangchen Yu Yin Chen Yu Zhang Peng Jia Yunbo Xu Ziqiang Li Hao Wu Richang Hong 35 1 0 11 Oct 2024
AnyTrans: Translate AnyText in the Image with Large Scale Models Zhipeng Qian Pei Zhang Baosong Yang Kai Fan Yiwei Ma Derek F. Wong Xiaoshuai Sun Rongrong Ji VLM 47 1 0 17 Jun 2024
A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges Huangjun Shen Liangying Shao Wenbo Li Zhibin Lan Zhanyu Liu Jinsong Su 41 2 0 21 May 2024
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset Xinyu Ma Xuebo Liu Derek F. Wong Jun Rao Bei Li Liang Ding Lidia S. Chao Dacheng Tao Min Zhang 41 2 0 29 Apr 2024
Exploring the Necessity of Visual Modality in Multimodal Machine Translation using Authentic Datasets Zi Long Zhenhao Tang Xianghua Fu Jian Chen Shilong Hou Jinze Lyu 44 2 0 09 Apr 2024
Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs Yuxin Zuo Bei Li Chuanhao Lv Tong Zheng Tong Xiao Jingbo Zhu 22 2 0 26 Oct 2023
Exploring Better Text Image Translation with Multimodal Codebook Zhibin Lan Jiawei Yu Xiang-Yang Li Wen Zhang Jian Luan Bin Wang Degen Huang Jinsong Su 34 8 0 27 May 2023
Generalization algorithm of multimodal pre-training model based on graph-text self-supervised training Xiaobing Zhang Zhenhao Tang Zi Long Xianghua Fu SSL 9 0 0 16 Feb 2023
Low-resource Neural Machine Translation with Cross-modal Alignment Zhe Yang Qingkai Fang Yang Feng VLM 37 9 0 13 Oct 2022
Multimodal Neural Machine Translation with Search Engine Based Image Retrieval Zhenhao Tang Xiaobing Zhang Zi Long Xianghua Fu 6 3 0 26 Jul 2022
A Multi-stage deep architecture for summary generation of soccer videos Melissa Sanabria F. Precioso Pierre-Alexandre Mattei Thomas Menguy 28 6 0 02 May 2022
Learning Multi-View Aggregation In the Wild for Large-Scale 3D Semantic Segmentation Damien Robert Bruno Vallet Loic Landrieu 3DPC 31 69 0 15 Apr 2022
Neural Machine Translation with Phrase-Level Universal Visual Representations Qingkai Fang Yang Feng 33 40 0 19 Mar 2022
Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training Yuqing Song Shizhe Chen Qin Jin Wei Luo Jun Xie Fei Huang 24 18 0 25 Aug 2021
Visual Cues and Error Correction for Translation Robustness Zhenhao Li Marek Rei Lucia Specia 20 3 0 12 Mar 2021
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish Begum Citamak Ozan Caglayan Menekse Kuyu Erkut Erdem Aykut Erdem Pranava Madhyastha Lucia Specia 23 8 0 13 Dec 2020
Multimodal Research in Vision and Language: A Review of Current and Emerging Trends Shagun Uppal Sarthak Bhagat Devamanyu Hazarika Navonil Majumdar Soujanya Poria Roger Zimmermann Amir Zadeh 23 6 0 19 Oct 2020
Generative Imagination Elevates Machine Translation Quanyu Long Mingxuan Wang Lei Li 24 34 0 21 Sep 2020
Dynamic Context-guided Capsule Network for Multimodal Machine Translation Huan Lin Fandong Meng Jinsong Su Yongjing Yin Zhengyuan Yang Yubin Ge Jie Zhou Jiebo Luo 16 78 0 04 Sep 2020
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation Yongjing Yin Fandong Meng Jinsong Su Chulun Zhou Zhengyuan Yang Jie Zhou Jiebo Luo 35 138 0 17 Jul 2020
Multimodal Data Fusion based on the Global Workspace Theory C. Bao Z. Fountas Temitayo A. Olugbade N. Bianchi-Berthouze 30 7 0 26 Jan 2020
Multimodal Machine Translation through Visuals and Speech U. Sulubacak Ozan Caglayan Stig-Arne Gronroos Aku Rouhe Desmond Elliott Lucia Specia Jörg Tiedemann 49 73 0 28 Nov 2019
On Leveraging the Visual Modality for Neural Machine Translation Vikas Raunak Sang Keun Choe Quanyang Lu Yi Xu Florian Metze 15 11 0 07 Oct 2019
VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research Xin Eric Wang Jiawei Wu Junkun Chen Lei Li Yuan-fang Wang William Yang Wang 32 540 0 06 Apr 2019
Probing the Need for Visual Context in Multimodal Machine Translation Ozan Caglayan Pranava Madhyastha Lucia Specia Loïc Barrault 27 142 0 20 Mar 2019
Latent Variable Model for Multi-modal Translation Iacer Calixto Miguel Rios Wilker Aziz 17 3 0 01 Nov 2018
LIUM-CVC Submissions for WMT18 Multimodal Translation Task Ozan Caglayan Adrien Bardet Fethi Bougares Loïc Barrault M. García-Martínez Marc Masana Luis Herranz Joost van de Weijer 22 43 0 01 Sep 2018
Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than Character Level Lifeng Han Shaohui Kuang 17 6 0 03 May 2018
Crossmodal Attentive Skill Learner Shayegan Omidshafiei Dong-Ki Kim Jason Pazis Jonathan P. How 29 13 0 28 Nov 2017
Evaluating Discourse Phenomena in Neural Machine Translation Rachel Bawden Rico Sennrich Alexandra Birch Barry Haddow 29 260 0 01 Nov 2017
Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description Desmond Elliott Stella Frank Loïc Barrault Fethi Bougares Lucia Specia VLM 25 218 0 19 Oct 2017
Emergent Translation in Multi-Agent Communication Jason D. Lee Kyunghyun Cho Jason Weston Douwe Kiela 24 68 0 12 Oct 2017
LIUM-CVC Submissions for WMT17 Multimodal Translation Task Ozan Caglayan Walid Aransa Adrien Bardet Mercedes García-Martínez Fethi Bougares Loïc Barrault Marc Masana Luis Herranz Joost van de Weijer 28 57 0 14 Jul 2017
NMTPY: A Flexible Toolkit for Advanced Neural Machine Translation Systems Ozan Caglayan Mercedes García-Martínez Adrien Bardet Walid Aransa Fethi Bougares Loïc Barrault 27 65 0 01 Jun 2017
Imagination improves Multimodal Translation Desmond Elliott Ákos Kádár 29 136 0 11 May 2017
Does Neural Machine Translation Benefit from Larger Context? Sébastien Jean Stanislas Lauly Orhan Firat Kyunghyun Cho AI4CE 22 143 0 17 Apr 2017
Doubly-Attentive Decoder for Multi-modal Neural Machine Translation Iacer Calixto Qun Liu N. Campbell 40 179 0 04 Feb 2017
Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism Orhan Firat Kyunghyun Cho Yoshua Bengio LRM AIMat 231 623 0 06 Jan 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,925 0 17 Aug 2015