Gumbel-Attention for Multi-modal Machine Translation

16 March 2021

Papers citing "Gumbel-Attention for Multi-modal Machine Translation"

16 / 16 papers shown

Title
MoMa: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts Xi Victoria Lin Akshat Shrivastava Liang Luo Srinivasan Iyer Mike Lewis Gargi Gosh Luke Zettlemoyer Armen Aghajanyan MoE 40 20 0 31 Jul 2024
Towards Zero-Shot Multimodal Machine Translation Matthieu Futeral Cordelia Schmid Benoît Sagot Rachel Bawden 35 3 0 18 Jul 2024
Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation Wangbo Zhao Jiasheng Tang Yizeng Han Yibing Song Kai Wang Gao Huang F. Wang Yang You 37 11 0 18 Mar 2024
Decoupling Weighing and Selecting for Integrating Multiple Graph Pre-training Tasks Tianyu Fan Lirong Wu Yufei Huang Haitao Lin Cheng Tan Zhangyang Gao Stan Z. Li 32 3 0 03 Mar 2024
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation Devaansh Gupta Siddhant Kharbanda Jiawei Zhou Wanhua Li Hanspeter Pfister D. Wei VLM 31 9 0 29 Aug 2023
Iterative Adversarial Attack on Image-guided Story Ending Generation Youze Wang Wenbo Hu Richang Hong 32 3 0 16 May 2023
Tackling Ambiguity with Images: Improved Multimodal Machine Translation and Contrastive Evaluation Matthieu Futeral Cordelia Schmid Ivan Laptev Benoît Sagot Rachel Bawden 29 26 0 20 Dec 2022
Increasing Visual Awareness in Multimodal Neural Machine Translation from an Information Theoretic Perspective Baijun Ji Tong Zhang Yicheng Zou Bojie Hu Sitian Shen 25 12 0 16 Oct 2022
Low-resource Neural Machine Translation with Cross-modal Alignment Zhe Yang Qingkai Fang Yang Feng VLM 34 9 0 13 Oct 2022
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation Ru Peng Yawen Zeng J. Zhao 20 15 0 10 Oct 2022
VALHALLA: Visual Hallucination for Machine Translation Yi Li Rameswar Panda Yoon Kim Chun-Fu Chen Rogerio Feris David D. Cox Nuno Vasconcelos MLLM 38 38 0 31 May 2022
Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translation Idris Abdulmumin S. Dash Musa Abdullahi Dawud Shantipriya Parida Shamsuddeen Hassan Muhammad I. Ahmad Subhadarshi Panda Ondrej Bojar B. Galadanci Bello Shehu Bello 16 16 0 02 May 2022
Neural Machine Translation with Phrase-Level Universal Visual Representations Qingkai Fang Yang Feng 31 40 0 19 Mar 2022
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling Hongyu Gong Yun Tang J. Pino Xian Li 21 11 0 21 Jun 2021
How Does Selective Mechanism Improve Self-Attention Networks? Xinwei Geng Longyue Wang Xing Wang Bing Qin Ting Liu Zhaopeng Tu AAML 39 35 0 03 May 2020
OpenNMT: Open-Source Toolkit for Neural Machine Translation Guillaume Klein Yoon Kim Yuntian Deng Jean Senellart Alexander M. Rush 259 1,896 0 10 Jan 2017