Learning Visually Grounded Sentence Representations

Learning Visually Grounded Sentence Representations

19 July 2017

Douwe Kiela

Maximilian Nickel

Papers citing "Learning Visually Grounded Sentence Representations"

15 / 15 papers shown

Title
How direct is the link between words and images? Hassan Shahmohammadi Maria Heitmeier Elnaz Shafaei-Bajestan Hendrik P. A. Lensch Harald Baayen 32 0 0 30 Jun 2022
VALHALLA: Visual Hallucination for Machine Translation Yi Li Yikang Shen Yoon Kim Chun-Fu Chen Rogerio Feris David D. Cox Nuno Vasconcelos MLLM 40 38 0 31 May 2022
MCSE: Multimodal Contrastive Learning of Sentence Embeddings Miaoran Zhang Marius Mosbach David Ifeoluwa Adelani Michael A. Hedderich Dietrich Klakow 36 34 0 22 Apr 2022
UNIMO-2: End-to-End Unified Vision-Language Grounded Learning Wei Li Can Gao Guocheng Niu Xinyan Xiao Hao Liu Jiachen Liu Hua Wu Haifeng Wang MLLM 19 21 0 17 Mar 2022
Seeing the advantage: visually grounding word embeddings to better capture human semantic knowledge Danny Merkx S. Frank M. Ernestus 19 4 0 21 Feb 2022
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages Emanuele Bugliarello Fangyu Liu Jonas Pfeiffer Siva Reddy Desmond Elliott Edoardo Ponti Ivan Vulić MLLM VLM ELM 50 62 0 27 Jan 2022
UniT: Multimodal Multitask Learning with a Unified Transformer Ronghang Hu Amanpreet Singh ViT 25 295 0 22 Feb 2021
Visually Grounded Compound PCFGs Yanpeng Zhao Ivan Titov 29 43 0 25 Sep 2020
MULE: Multimodal Universal Language Embedding Donghyun Kim Kuniaki Saito Kate Saenko Stan Sclaroff Bryan A. Plummer VLM 32 40 0 08 Sep 2019
Fusion of Detected Objects in Text for Visual Question Answering Chris Alberti Jeffrey Ling Michael Collins David Reitter 17 173 0 14 Aug 2019
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension Najoung Kim Roma Patel Adam Poliak Alex Jinpeng Wang Patrick Xia ... Alexis Ross Tal Linzen Benjamin Van Durme Samuel R. Bowman Ellie Pavlick 28 105 0 25 Apr 2019
No Training Required: Exploring Random Encoders for Sentence Classification John Wieting Douwe Kiela 32 98 0 29 Jan 2019
Supervised Learning of Universal Sentence Representations from Natural Language Inference Data Alexis Conneau Douwe Kiela Holger Schwenk Loïc Barrault Antoine Bordes AI4TS SSL 52 2,096 0 05 May 2017
Learning Deep Representations of Fine-grained Visual Descriptions Scott E. Reed Zeynep Akata Bernt Schiele Honglak Lee OCL VLM 176 840 0 17 May 2016
From Frequency to Meaning: Vector Space Models of Semantics Peter D. Turney Patrick Pantel 110 2,981 0 04 Mar 2010