Supervised Visual Attention for Simultaneous Multimodal Machine Translation

23 January 2022

Papers citing "Supervised Visual Attention for Simultaneous Multimodal Machine Translation"

49 / 49 papers shown

Title
Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation Julia Ive A. Li Yishu Miao Ozan Caglayan Pranava Madhyastha Lucia Specia 61 12 0 22 Feb 2021
Curious Case of Language Generation Evaluation Metrics: A Cautionary Tale Ozan Caglayan Pranava Madhyastha Lucia Specia ELM 67 35 0 26 Oct 2020
Simultaneous Machine Translation with Visual Context Ozan Caglayan Julia Ive Veneta Haralampieva Pranava Madhyastha Loïc Barrault Lucia Specia 35 30 0 15 Sep 2020
Efficient Wait-k Models for Simultaneous Machine Translation Maha Elbayad Laurent Besacier Jakob Verbeek VLM 54 80 0 18 May 2020
Re-translation versus Streaming for Simultaneous Translation N. Arivazhagan Colin Cherry Wolfgang Macherey George F. Foster 89 63 0 07 Apr 2020
Towards Multimodal Simultaneous Neural Machine Translation Aizhan Imankulova Masahiro Kaneko Tosho Hirasawa Mamoru Komachi 45 15 0 07 Apr 2020
Learning Coupled Policies for Simultaneous Machine Translation using Imitation Learning Philip Arthur Trevor Cohn Gholamreza Haffari 95 18 0 11 Feb 2020
Multimodal Machine Translation through Visuals and Speech U. Sulubacak Ozan Caglayan Stig-Arne Gronroos Aku Rouhe Desmond Elliott Lucia Specia Jörg Tiedemann 92 75 0 28 Nov 2019
Monotonic Multihead Attention Xutai Ma J. Pino James Cross Liezl Puzon Jiatao Gu 63 139 0 26 Sep 2019
Jointly Learning to Align and Translate with Transformer Models Sarthak Garg Stephan Peitz Udhyakumar Nallasamy Matthias Paulik 34 172 0 04 Sep 2019
Simpler and Faster Learning of Adaptive Policies for Simultaneous Translation Baigong Zheng Renjie Zheng Mingbo Ma Liang Huang 41 77 0 04 Sep 2019
Phrase Localization Without Paired Training Examples Josiah Wang Lucia Specia 60 44 0 20 Aug 2019
LXMERT: Learning Cross-Modality Encoder Representations from Transformers Hao Hao Tan Joey Tianyi Zhou VLM MLLM 237 2,479 0 20 Aug 2019
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Jiasen Lu Dhruv Batra Devi Parikh Stefan Lee SSL VLM 226 3,678 0 06 Aug 2019
Monotonic Infinite Lookback Attention for Simultaneous Machine Translation N. Arivazhagan Colin Cherry Wolfgang Macherey Chung-Cheng Chiu Semih Yavuz Ruoming Pang Wei Li Colin Raffel CLL 38 195 0 12 Jun 2019
Learning Deep Transformer Models for Machine Translation Qiang Wang Bei Li Tong Xiao Jingbo Zhu Changliang Li Derek F. Wong Lidia S. Chao 76 671 0 05 Jun 2019
Input Combination Strategies for Multi-Source Transformer Decoder Jindrich Libovický Jindřich Helcl David Marecek 104 74 0 12 Nov 2018
LIUM-CVC Submissions for WMT18 Multimodal Translation Task Ozan Caglayan Adrien Bardet Fethi Bougares Loïc Barrault M. García-Martínez Marc Masana Luis Herranz Joost van de Weijer 62 42 0 01 Sep 2018
A Visual Attention Grounding Neural Model for Multimodal Machine Translation Mingyang Zhou Runxiang Cheng Yong Jae Lee Zhou Yu 84 79 0 24 Aug 2018
Low-Latency Neural Speech Translation Jan Niehues Ngoc-Quan Pham Thanh-Le Ha Matthias Sperber A. Waibel 62 77 0 01 Aug 2018
Incremental Decoding and Training Methods for Simultaneous Translation in Neural Machine Translation Fahim Dalvi Nadir Durrani Hassan Sajjad S. Vogel CLL 51 97 0 10 Jun 2018
Modulating and attending the source image during encoding improves Multimodal Translation Jean-Benoit Delbrouck Stéphane Dupont 56 20 0 09 Dec 2017
Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description Desmond Elliott Stella Frank Loïc Barrault Fethi Bougares Lucia Specia VLM 68 220 0 19 Oct 2017
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering Peter Anderson Xiaodong He Chris Buehler Damien Teney Mark Johnson Stephen Gould Lei Zhang AIMat 121 4,215 0 25 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 690 131,526 0 12 Jun 2017
Imagination improves Multimodal Translation Desmond Elliott Ákos Kádár 138 137 0 11 May 2017
Attention Strategies for Multi-Source Sequence-to-Sequence Learning Jindrich Libovický Jindřich Helcl AIMat 74 183 0 21 Apr 2017
Doubly-Attentive Decoder for Multi-modal Neural Machine Translation Iacer Calixto Qun Liu N. Campbell 126 183 0 04 Feb 2017
Incorporating Global Visual Features into Attention-Based Neural Machine Translation Iacer Calixto Qun Liu Nick Campbell 107 156 0 23 Jan 2017
Learning to Translate in Real-time with Neural Machine Translation Jiatao Gu Graham Neubig Kyunghyun Cho Victor O.K. Li 81 218 0 03 Oct 2016
Neural Machine Translation with Supervised Attention Lemao Liu Masao Utiyama A. Finch Eiichiro Sumita 68 156 0 14 Sep 2016
Using the Output Embedding to Improve Language Models Ofir Press Lior Wolf 69 733 0 20 Aug 2016
Supervised Attentions for Neural Machine Translation Haitao Mi Zhiguo Wang Abe Ittycheriah 78 134 0 30 Jul 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 410 10,482 0 21 Jul 2016
Can neural machine translation do simultaneous translation? Kyunghyun Cho Masha Esipova 42 156 0 07 Jun 2016
Adversarial Feature Learning Jiasen Lu Philipp Krahenbuhl Trevor Darrell GAN 109 1,831 0 31 May 2016
Does Multimodality Help Human and Machine for Translation and Image Captioning? Ozan Caglayan Walid Aransa Yaxing Wang Marc Masana Mercedes García-Martínez Fethi Bougares Loïc Barrault Joost van de Weijer 57 86 0 30 May 2016
Multi30K: Multilingual English-German Image Descriptions Desmond Elliott Stella Frank K. Simaán Lucia Specia VLM 128 588 0 02 May 2016
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations Ranjay Krishna Yuke Zhu Oliver Groth Justin Johnson Kenji Hata ... Yannis Kalantidis Li Li David A. Shamma Michael S. Bernstein Fei-Fei Li 215 5,743 0 23 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 193,878 0 10 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 883 27,358 0 02 Dec 2015
Grounding of Textual Phrases in Images by Reconstruction Anna Rohrbach Marcus Rohrbach Ronghang Hu Trevor Darrell Bernt Schiele 75 497 0 12 Nov 2015
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 502 62,270 0 04 Jun 2015
Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Models Bryan A. Plummer Liwei Wang Christopher M. Cervantes Juan C. Caicedo Julia Hockenmaier Svetlana Lazebnik 196 2,056 0 19 May 2015
Microsoft COCO Captions: Data Collection and Evaluation Server Xinlei Chen Hao Fang Nayeon Lee Ramakrishna Vedantam Saurabh Gupta Piotr Dollar C. L. Zitnick 211 2,475 0 01 Apr 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,039 0 22 Dec 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 434 20,553 0 10 Sep 2014
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 552 27,300 0 01 Sep 2014
How to Construct Deep Recurrent Neural Networks Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 116 1,009 0 20 Dec 2013