Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models

8 September 2021

Papers citing "Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models"

21 / 21 papers shown

Title
Multimodal Machine Translation with Visual Scene Graph Pruning Chenyu Lu Shiliang Sun Jing Zhao N. Zhang Tengfei Song Hao Yang 204 0 0 26 May 2025
Towards Zero-Shot Multimodal Machine Translation Matthieu Futeral Cordelia Schmid Benoît Sagot Rachel Bawden 68 4 0 18 Jul 2024
Good for Misconceived Reasons: An Empirical Revisiting on the Need for Visual Context in Multimodal Machine Translation Zhiyong Wu Lingpeng Kong W. Bi Xiang Li B. Kao LRM 37 81 0 30 May 2021
Measuring and Increasing Context Usage in Context-Aware Machine Translation Patrick Fernandes Kayo Yin Graham Neubig André F. T. Martins 58 57 0 07 May 2021
MultiSubs: A Large-scale Multimodal and Multilingual Dataset Josiah Wang Pranava Madhyastha J. Figueiredo Chiraag Lala Lucia Specia VGen 47 11 0 02 Mar 2021
Dynamic Context-guided Capsule Network for Multimodal Machine Translation Huan Lin Fandong Meng Jinsong Su Yongjing Yin Zhengyuan Yang Yubin Ge Jie Zhou Jiebo Luo 56 80 0 04 Sep 2020
A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation Yongjing Yin Fandong Meng Jinsong Su Chulun Zhou Zhengyuan Yang Jie Zhou Jiebo Luo 60 144 0 17 Jul 2020
On Leveraging the Visual Modality for Neural Machine Translation Vikas Raunak Sang Keun Choe Quanyang Lu Yi Xu Florian Metze 25 11 0 07 Oct 2019
Distilling Translations with Visual Awareness Julia Ive Pranava Madhyastha Lucia Specia VLM 139 76 0 18 Jun 2019
Cross-lingual Visual Verb Sense Disambiguation Spandana Gella Desmond Elliott Frank Keller 97 20 0 10 Apr 2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling Myle Ott Sergey Edunov Alexei Baevski Angela Fan Sam Gross Nathan Ng David Grangier Michael Auli VLM FaML 103 3,149 0 01 Apr 2019
Probing the Need for Visual Context in Multimodal Machine Translation Ozan Caglayan Pranava Madhyastha Lucia Specia Loïc Barrault 71 142 0 20 Mar 2019
CUNI System for the WMT18 Multimodal Translation Task Jindřich Helcl Jindrich Libovický Dušan Variš 85 57 0 12 Nov 2018
Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description Desmond Elliott Stella Frank Loïc Barrault Fethi Bougares Lucia Specia VLM 68 220 0 19 Oct 2017
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints Jieyu Zhao Tianlu Wang Mark Yatskar Vicente Ordonez Kai-Wei Chang FaML 90 970 0 29 Jul 2017
Doubly-Attentive Decoder for Multi-modal Neural Machine Translation Iacer Calixto Qun Liu N. Campbell 126 183 0 04 Feb 2017
Multi30K: Multilingual English-German Image Descriptions Desmond Elliott Stella Frank K. Simaán Lucia Specia VLM 128 588 0 02 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 193,878 0 10 Dec 2015
Improving Neural Machine Translation Models with Monolingual Data Rico Sennrich Barry Haddow Alexandra Birch 243 2,716 0 20 Nov 2015
Generating Sentences from a Continuous Space Samuel R. Bowman Luke Vilnis Oriol Vinyals Andrew M. Dai Rafal Jozefowicz Samy Bengio DRL 105 2,360 0 19 Nov 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,039 0 22 Dec 2014