Doubly-Attentive Decoder for Multi-modal Neural Machine Translation

4 February 2017

Qun Liu

Papers citing "Doubly-Attentive Decoder for Multi-modal Neural Machine Translation"

50 / 80 papers shown

Title
Memory Reviving, Continuing Learning and Beyond: Evaluation of Pre-trained Encoders and Decoders for Multimodal Machine Translation Zhuang Yu Shiliang Sun Jing Zhao Tengfei Song Hao Yang 48 0 0 25 Apr 2025
Brotherhood at WMT 2024: Leveraging LLM-Generated Contextual Conversations for Cross-Lingual Image Captioning Siddharth Betala Ishan Chokshi VLM 30 0 0 23 Sep 2024
AnyTrans: Translate AnyText in the Image with Large Scale Models Zhipeng Qian Pei Zhang Baosong Yang Kai Fan Yiwei Ma Derek F. Wong Xiaoshuai Sun Rongrong Ji VLM 47 1 0 17 Jun 2024
A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges Huangjun Shen Liangying Shao Wenbo Li Zhibin Lan Zhanyu Liu Jinsong Su 41 2 0 21 May 2024
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset Xinyu Ma Xuebo Liu Derek F. Wong Jun Rao Bei Li Liang Ding Lidia S. Chao Dacheng Tao Min Zhang 41 2 0 29 Apr 2024
Exploring the Necessity of Visual Modality in Multimodal Machine Translation using Authentic Datasets Zi Long Zhenhao Tang Xianghua Fu Jian Chen Shilong Hou Jinze Lyu 41 2 0 09 Apr 2024
Incorporating Probing Signals into Multimodal Machine Translation via Visual Question-Answering Pairs Yuxin Zuo Bei Li Chuanhao Lv Tong Zheng Tong Xiao Jingbo Zhu 22 2 0 26 Oct 2023
Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation Wenyu Guo Qingkai Fang Dong Yu Yang Feng 22 6 0 20 Oct 2023
Impact of Visual Context on Noisy Multimodal NMT: An Empirical Study for English to Indian Languages Baban Gain Dibyanayan Bandyopadhyay Subhabrata Mukherjee Chandranath Adak Asif Ekbal 29 2 0 30 Aug 2023
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation Devaansh Gupta Siddhant Kharbanda Jiawei Zhou Wanhua Li Hanspeter Pfister D. Wei VLM 39 9 0 29 Aug 2023
CFSum: A Coarse-to-Fine Contribution Network for Multimodal Summarization Min Xiao Junnan Zhu Haitao Lin Yu Zhou Chengqing Zong 33 8 0 06 Jul 2023
Exploring Better Text Image Translation with Multimodal Codebook Zhibin Lan Jiawei Yu Xiang-Yang Li Wen Zhang Jian Luan Bin Wang Degen Huang Jinsong Su 34 8 0 27 May 2023
Accessible Instruction-Following Agent Kairui Zhou 34 1 0 08 May 2023
Few-shot Domain-Adaptive Visually-fused Event Detection from Text Farhad Moghimifar Fatemeh Shiri Van Nguyen Gholamreza Haffari Yuanyou Li VLM 35 2 0 04 May 2023
Generalization algorithm of multimodal pre-training model based on graph-text self-supervised training Xiaobing Zhang Zhenhao Tang Zi Long Xianghua Fu SSL 9 0 0 16 Feb 2023
Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation Yaoming Zhu Zewei Sun Shanbo Cheng Yuyang Huang Liwei Wu Mingxuan Wang 28 10 0 20 Dec 2022
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation Matthieu Futeral Cordelia Schmid Ivan Laptev Benoît Sagot Rachel Bawden 31 26 0 20 Dec 2022
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation Hongcheng Guo Jiaheng Liu Haoyang Huang Jian Yang Zhoujun Li Dongdong Zhang Zheng Cui Furu Wei 37 22 0 19 Oct 2022
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective Baijun Ji Tong Zhang Yicheng Zou Bojie Hu Sitian Shen 25 12 0 16 Oct 2022
Low-resource Neural Machine Translation with Cross-modal Alignment Zhe Yang Qingkai Fang Yang Feng VLM 37 9 0 13 Oct 2022
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation Ru Peng Yawen Zeng J. Zhao 28 16 0 10 Oct 2022
Multimodal Neural Machine Translation with Search Engine Based Image Retrieval Zhenhao Tang Xiaobing Zhang Zi Long Xianghua Fu 6 3 0 26 Jul 2022
VALHALLA: Visual Hallucination for Machine Translation Yi Li Yikang Shen Yoon Kim Chun-Fu Chen Rogerio Feris David D. Cox Nuno Vasconcelos MLLM 40 38 0 31 May 2022
Neural Machine Translation with Phrase-Level Universal Visual Representations Qingkai Fang Yang Feng 33 40 0 19 Mar 2022
MSCTD: A Multimodal Sentiment Chat Translation Dataset Yunlong Liang Fandong Meng Jinan Xu Jinan Xu Jie Zhou 19 20 0 28 Feb 2022
Supervised Visual Attention for Simultaneous Multimodal Machine Translation Veneta Haralampieva Ozan Caglayan Lucia Specia LRM 48 4 0 23 Jan 2022
The JDDC 2.0 Corpus: A Large-Scale Multimodal Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service Nan Zhao Haoran Li Youzheng Wu Xiaodong He Bowen Zhou 27 8 0 27 Sep 2021
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models Jiaoda Li Duygu Ataman Rico Sennrich 23 28 0 08 Sep 2021
Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training Yuqing Song Shizhe Chen Qin Jin Wei Luo Jun Xie Fei Huang 24 18 0 25 Aug 2021
ICAF: Iterative Contrastive Alignment Framework for Multimodal Abstractive Summarization Zijian Zhang Chang Shu Youxin Chen Jing Xiao Qian Zhang Lu Zheng 23 5 0 11 Aug 2021
A Survey on Low-Resource Neural Machine Translation Rui Wang Xu Tan Renqian Luo Tao Qin Tie-Yan Liu 3DV 33 58 0 09 Jul 2021
IITP at WAT 2021: System description for English-Hindi Multimodal Translation Task Baban Gain Dibyanayan Bandyopadhyay Asif Ekbal 19 9 0 04 Jul 2021
ViTA: Visual-Linguistic Translation by Aligning Object Tags Kshitij Gupta Devansh Gautam R. Mamidi 12 14 0 01 Jun 2021
Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation Zhiyong Wu Lingpeng Kong W. Bi Xiang Li B. Kao LRM 23 77 0 30 May 2021
Semantic Representation for Dialogue Modeling Xuefeng Bai Yulong Chen Linfeng Song Yue Zhang 83 53 0 21 May 2021
UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training Mingyang Zhou Luowei Zhou Shuohang Wang Yu Cheng Linjie Li Zhou Yu Jingjing Liu MLLM VLM 31 89 0 01 Apr 2021
Gumbel-Attention for Multi-modal Machine Translation Pengbo Liu Hailong Cao T. Zhao 26 23 0 16 Mar 2021
Visual Cues and Error Correction for Translation Robustness Zhenhao Li Marek Rei Lucia Specia 20 3 0 12 Mar 2021
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation Julia Ive A. Li Yishu Miao Ozan Caglayan Pranava Madhyastha Lucia Specia 29 10 0 22 Feb 2021
Narration Generation for Cartoon Videos Nikos Papasarantopoulos Shay B. Cohen VGen 20 2 0 17 Jan 2021
Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT Rik van Noord Antonio Toral Johan Bos 21 4 0 09 Nov 2020
A Corpus for English-Japanese Multimodal Neural Machine Translation with Comparable Sentences Andrew C. Merritt Chenhui Chu Yuki Arase 15 5 0 17 Oct 2020
Generative Imagination Elevates Machine Translation Quanyu Long Mingxuan Wang Lei Li 24 34 0 21 Sep 2020
Dynamic Context-guided Capsule Network for Multimodal Machine Translation Huan Lin Fandong Meng Jinsong Su Yongjing Yin Zhengyuan Yang Yubin Ge Jie Zhou Jiebo Luo 16 78 0 04 Sep 2020
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation Yongjing Yin Fandong Meng Jinsong Su Chulun Zhou Zhengyuan Yang Jie Zhou Jiebo Luo 35 138 0 17 Jul 2020
Neural Machine Translation: Challenges, Progress and Future Jiajun Zhang Chengqing Zong 26 52 0 13 Apr 2020
Towards Multimodal Simultaneous Neural Machine Translation Aizhan Imankulova Masahiro Kaneko Tosho Hirasawa Mamoru Komachi 14 15 0 07 Apr 2020
Visual Agreement Regularized Training for Multi-Modal Machine Translation Pengcheng Yang Boxing Chen Pei Zhang Xu Sun 82 30 0 27 Dec 2019
Multimodal Machine Translation through Visuals and Speech U. Sulubacak Ozan Caglayan Stig-Arne Gronroos Aku Rouhe Desmond Elliott Lucia Specia Jörg Tiedemann 49 73 0 28 Nov 2019
Probing Contextualized Sentence Representations with Visual Awareness Zhuosheng Zhang Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita Hai Zhao 14 2 0 07 Nov 2019