A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation

17 July 2020

Jie Zhou

Papers citing "A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation"

48 / 48 papers shown

Title
TopicVD: A Topic-Based Dataset of Video-Guided Multimodal Machine Translation for Documentaries Jinze Lv Jian Chen Zi Long Xianghua Fu Yin Chen VGen 42 0 0 09 May 2025
Low-Resource Neural Machine Translation Using Recurrent Neural Networks and Transfer Learning: A Case Study on English-to-Igbo Ocheme Anthony Ekle Biswarup Das 29 0 0 24 Apr 2025
ViSymRe: Vision-guided Multimodal Symbolic Regression Da Li Junping Yin Jin Xu Xinxin Li Juan Zhang 82 1 0 15 Dec 2024
Towards Zero-Shot Multimodal Machine Translation Matthieu Futeral Cordelia Schmid Benoît Sagot Rachel Bawden 35 3 0 18 Jul 2024
Translatotron-V(ison): An End-to-End Model for In-Image Machine Translation Zhibin Lan Liqiang Niu Fandong Meng Jie Zhou Min Zhang Jinsong Su VLM 31 5 0 03 Jul 2024
A Survey on Multi-modal Machine Translation: Tasks, Methods and Challenges Huangjun Shen Liangying Shao Wenbo Li Zhibin Lan Zhanyu Liu Jinsong Su 38 2 0 21 May 2024
m3P: Towards Multimodal Multilingual Translation with Multimodal Prompt Jian Yang Hongcheng Guo Yuwei Yin Jiaqi Bai Bing Wang Jiaheng Liu Xinnian Liang Linzheng Cahi Liqun Yang Zhoujun Li 40 9 0 26 Mar 2024
Adding Multimodal Capabilities to a Text-only Translation Model Vipin Vijayan Braeden Bowen Scott Grigsby Timothy Anderson Jeremy Gwinnup LRM 26 5 0 05 Mar 2024
The Case for Evaluating Multimodal Translation Models on Text Datasets Vipin Vijayan Braeden Bowen Scott Grigsby Timothy Anderson Jeremy Gwinnup 33 3 0 05 Mar 2024
Unified Lattice Graph Fusion for Chinese Named Entity Recognition Di Zhang Junyu Lu Pingjian Zhang 24 2 0 28 Dec 2023
Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models Liqi He Zuchao Li Xiantao Cai Ping Wang LRM 33 18 0 14 Dec 2023
Video-Helpful Multimodal Machine Translation Yihang Li Shuichiro Shimizu Chenhui Chu Sadao Kurohashi Wei Li 26 2 0 31 Oct 2023
TMac: Temporal Multi-Modal Graph Learning for Acoustic Event Classification Meng Liu K. Liang Dayu Hu Hao Yu Yue Liu Lingyuan Meng Wenxuan Tu Sihang Zhou Xinwang Liu 18 25 0 21 Sep 2023
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise Filtering Yifan Dong Suhang Wu Fandong Meng Jie Zhou Xiaoli Wang Jianxin Lin Jinsong Su 25 3 0 09 Sep 2023
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation Devaansh Gupta Siddhant Kharbanda Jiawei Zhou Wanhua Li Hanspeter Pfister D. Wei VLM 31 9 0 29 Aug 2023
DualHGNN: A Dual Hypergraph Neural Network for Semi-Supervised Node Classification based on Multi-View Learning and Density Awareness Jianpeng Liao Jun Yan Qian Tao 15 1 0 07 Jun 2023
MemeGraphs: Linking Memes to Knowledge Graphs Vasiliki Kougia Simon Fetzel Thomas Kirchmair Erion cCano Sina Moayed Baharlou Sahand Sharifzadeh Benjamin Roth 24 10 0 28 May 2023
Exploring Better Text Image Translation with Multimodal Codebook Zhibin Lan Jiawei Yu Xiang-Yang Li Wen Zhang Jian Luan Bin Wang Degen Huang Jinsong Su 34 8 0 27 May 2023
BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translation Liyan Kang Luyang Huang Ningxin Peng Peihao Zhu Zewei Sun Shanbo Cheng Mingxuan Wang Degen Huang Jinsong Su 23 9 0 23 May 2023
Unified Model Learning for Various Neural Machine Translation Yunlong Liang Fandong Meng Jinan Xu Jiaan Wang Yufeng Chen Jie Zhou 37 1 0 04 May 2023
Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applications Muhammad Arslan Manzoor S. Albarri Ziting Xian Zaiqiao Meng Preslav Nakov Shangsong Liang AI4TS 25 26 0 01 Feb 2023
Universal Multimodal Representation for Language Understanding Zhuosheng Zhang Kehai Chen Rui Wang Masao Utiyama Eiichiro Sumita Z. Li Hai Zhao SSL 19 21 0 09 Jan 2023
Beyond Triplet: Leveraging the Most Data for Multimodal Machine Translation Yaoming Zhu Zewei Sun Shanbo Cheng Yuyang Huang Liwei Wu Mingxuan Wang 26 10 0 20 Dec 2022
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation Matthieu Futeral Cordelia Schmid Ivan Laptev Benoît Sagot Rachel Bawden 31 26 0 20 Dec 2022
Getting the Most out of Simile Recognition Xiaoyue Wang Linfeng Song Xin Liu Chulun Zhou Jinsong Su 23 4 0 11 Nov 2022
Leveraging Graph-based Cross-modal Information Fusion for Neural Sign Language Translation Jiangbin Zheng Siyuan Li Cheng Tan Chong Wu Yidong Chen Stan Z. Li SLR 29 7 0 01 Nov 2022
LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation Hongcheng Guo Jiaheng Liu Haoyang Huang Jian Yang Zhoujun Li Dongdong Zhang Zheng Cui Furu Wei 37 22 0 19 Oct 2022
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective Baijun Ji Tong Zhang Yicheng Zou Bojie Hu Sitian Shen 25 12 0 16 Oct 2022
Low-resource Neural Machine Translation with Cross-modal Alignment Zhe Yang Qingkai Fang Yang Feng VLM 37 9 0 13 Oct 2022
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation Ru Peng Yawen Zeng J. Zhao 28 15 0 10 Oct 2022
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 18 60 0 07 Sep 2022
Flat Multi-modal Interaction Transformer for Named Entity Recognition Junyu Lu Di Zhang Pingjian Zhang 24 11 0 23 Aug 2022
VALHALLA: Visual Hallucination for Machine Translation Yi Li Rameswar Panda Yoon Kim Chun-Fu Chen Rogerio Feris David D. Cox Nuno Vasconcelos MLLM 38 38 0 31 May 2022
Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehension Huibin Zhang Zhengkun Zhang Yao Zhang Jun Wang Yufan Li Ning Jiang Xinde Wei Zhenglu Yang 12 5 0 06 Apr 2022
Neural Machine Translation with Phrase-Level Universal Visual Representations Qingkai Fang Yang Feng 33 40 0 19 Mar 2022
MSCTD: A Multimodal Sentiment Chat Translation Dataset Yunlong Liang Fandong Meng Jinan Xu Yufeng Chen Jie Zhou 19 20 0 28 Feb 2022
GAME-ON: Graph Attention Network based Multimodal Fusion for Fake News Detection Mudit Dhawan Shakshi Sharma Aditya Kadam Rajesh Sharma Ponnurangam Kumaraguru GNN 14 35 0 25 Feb 2022
VLP: A Survey on Vision-Language Pre-training Feilong Chen Duzhen Zhang Minglun Han Xiuyi Chen Jing Shi Shuang Xu Bo Xu VLM 82 213 0 18 Feb 2022
Density-Aware Hyper-Graph Neural Networks for Graph-based Semi-supervised Node Classification Jianpeng Liao Qian Tao Jun Yan GNN 28 3 0 27 Jan 2022
R $^3$ Net:Relation-embedded Representation Reconstruction Network for Change Captioning Yunbin Tu Liang Li C. Yan Shengxiang Gao Zhengtao Yu 22 22 0 20 Oct 2021
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models Jiaoda Li Duygu Ataman Rico Sennrich 18 28 0 08 Sep 2021
Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training Yuqing Song Shizhe Chen Qin Jin Wei Luo Jun Xie Fei Huang 18 18 0 25 Aug 2021
Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation Zhiyong Wu Lingpeng Kong W. Bi Xiang Li B. Kao LRM 15 76 0 30 May 2021
Cross-lingual Visual Pre-training for Multimodal Machine Translation Ozan Caglayan Menekse Kuyu Mustafa Sercan Amac Pranava Madhyastha Erkut Erdem Aykut Erdem Lucia Specia VLM 19 42 0 25 Jan 2021
Efficient Object-Level Visual Context Modeling for Multimodal Machine Translation: Masking Irrelevant Objects Helps Grounding Dexin Wang Deyi Xiong 12 35 0 18 Dec 2020
MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences Jianing Yang Yongxin Wang Ruitao Yi Yuying Zhu Azaan Rehman Amir Zadeh Soujanya Poria Louis-Philippe Morency 31 11 0 22 Oct 2020
Generative Imagination Elevates Machine Translation Quanyu Long Mingxuan Wang Lei Li 19 34 0 21 Sep 2020
Dynamic Context-guided Capsule Network for Multimodal Machine Translation Huan Lin Fandong Meng Jinsong Su Yongjing Yin Zhengyuan Yang Yubin Ge Jie Zhou Jiebo Luo 16 77 0 04 Sep 2020