Multimodal Machine Translation with Visual Scene Graph Pruning

26 May 2025

Papers citing "Multimodal Machine Translation with Visual Scene Graph Pruning"

27 / 27 papers shown

Title
Adding Multimodal Capabilities to a Text-only Translation Model Vipin Vijayan Braeden Bowen Scott Grigsby Timothy Anderson Jeremy Gwinnup LRM 51 6 0 05 Mar 2024
Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation Wenyu Guo Qingkai Fang Dong Yu Yang Feng 35 7 0 20 Oct 2023
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation Devaansh Gupta Siddhant Kharbanda Jiawei Zhou Wanhua Li Hanspeter Pfister D. Wei VLM 47 11 0 29 Aug 2023
Scene Graph as Pivoting: Inference-time Image-free Unsupervised Multimodal Machine Translation with Visual Scene Hallucination Hao Fei Qianfeng Liu Meishan Zhang Hao Fei Tat-Seng Chua LRM 77 49 0 20 May 2023
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation Matthieu Futeral Cordelia Schmid Ivan Laptev Benoît Sagot Rachel Bawden 47 29 0 20 Dec 2022
ERNIE-UniX2: A Unified Cross-lingual Cross-modal Framework for Understanding and Generation Bin Shan Yaqian Han Weichong Yin Shuohuan Wang Yu Sun Hao Tian Hua Wu Haifeng Wang MLLM VLM 53 8 0 09 Nov 2022
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation Ru Peng Yawen Zeng Jiaqi Zhao 38 17 0 10 Oct 2022
VALHALLA: Visual Hallucination for Machine Translation Yi Li Yikang Shen Yoon Kim Chun-Fu Chen Rogerio Feris David D. Cox Nuno Vasconcelos MLLM 86 39 0 31 May 2022
Neural Machine Translation with Phrase-Level Universal Visual Representations Qingkai Fang Yang Feng 45 42 0 19 Mar 2022
Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models Jiaoda Li Duygu Ataman Rico Sennrich 33 32 0 08 Sep 2021
Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation Zhiyong Wu Lingpeng Kong W. Bi Xiang Li B. Kao LRM 33 80 0 30 May 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 671 28,659 0 26 Feb 2021
COMET: A Neural Framework for MT Evaluation Ricardo Rei Craig Alan Stewart Ana C. Farinha A. Lavie 92 1,075 0 18 Sep 2020
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation Yongjing Yin Fandong Meng Jinsong Su Chulun Zhou Zhengyuan Yang Jie Zhou Jiebo Luo 53 142 0 17 Jul 2020
Unbiased Scene Graph Generation from Biased Training Kaihua Tang Yulei Niu Jianqiang Huang Jiaxin Shi Hanwang Zhang CML 58 689 0 27 Feb 2020
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 76 3,141 0 01 Apr 2019
Auto-Encoding Scene Graphs for Image Captioning Xu Yang Kaihua Tang Hanwang Zhang Jianfei Cai 120 698 0 06 Dec 2018
Scene Graph Parsing as Dependency Parsing Yu-Siang Wang Chenxi Liu Fangyin Wei Alan Yuille GNN 3DV 33 52 0 25 Mar 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 435 129,831 0 12 Jun 2017
Imagination improves Multimodal Translation Desmond Elliott Ákos Kádár 113 137 0 11 May 2017
Doubly-Attentive Decoder for Multi-modal Neural Machine Translation Iacer Calixto Qun Liu N. Campbell 114 182 0 04 Feb 2017
Incorporating Global Visual Features into Attention-Based Neural Machine Translation Iacer Calixto Qun Liu Nick Campbell 90 155 0 23 Jan 2017
CUNI System for WMT16 Automatic Post-Editing and Multimodal Translation Tasks Jindrich Libovický Jindřich Helcl Marek Tlustý Pavel Pecina Ondrej Bojar 41 68 0 23 Jun 2016
Does Multimodality Help Human and Machine for Translation and Image Captioning? Ozan Caglayan Walid Aransa Yaxing Wang Marc Masana Mercedes García-Martínez Fethi Bougares Loïc Barrault Joost van de Weijer 47 86 0 30 May 2016
Multi30K: Multilingual English-German Image Descriptions Desmond Elliott Stella Frank K. Simaán Lucia Specia VLM 119 583 0 02 May 2016
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 153 7,683 0 31 Aug 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 806 149,474 0 22 Dec 2014