Visually Grounded Neural Syntax Acquisition

7 June 2019

Jiayuan Mao

Papers citing "Visually Grounded Neural Syntax Acquisition"

37 / 37 papers shown

Title
Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrations Ziqiao Ma Zekun Wang Joyce Chai 97 4 0 22 May 2024
Multimodal Deep Learning Cem Akkus Jiquan Ngiam Vladana Djakovic Steffen Jauch-Walser A. Khosla ... Jann Goschenhofer Honglak Lee A. Ng Daniel Schalk Matthias Aßenmacher 74 3,161 0 12 Jan 2023
The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision Jiayuan Mao Chuang Gan Pushmeet Kohli J. Tenenbaum Jiajun Wu NAI 98 694 0 26 Apr 2019
Unsupervised Recurrent Neural Network Grammars Yoon Kim Alexander M. Rush Lei Yu A. Kuncoro Chris Dyer Gábor Melis LRM RALM SSL 44 115 0 07 Apr 2019
Unsupervised Latent Tree Induction with Deep Inside-Outside Recursive Autoencoders Andrew Drozdov Pat Verga Mohit Yadav Mohit Iyyer Andrew McCallum 30 123 0 03 Apr 2019
Cooperative Learning of Disjoint Syntax and Semantics Serhii Havrylov Germán Kruszewski Armand Joulin 35 48 0 25 Feb 2019
Learning to Embed Sentences Using Attentive Recursive Trees Jiaxin Shi Lei Hou Meng-Ying Lei Yongqian Li Hanwang Zhang 17 3 0 06 Nov 2018
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks Songlin Yang Shawn Tan Alessandro Sordoni Aaron Courville 95 324 0 22 Oct 2018
Visual Coreference Resolution in Visual Dialog using Neural Module Networks Satwik Kottur José M. F. Moura Devi Parikh Dhruv Batra Marcus Rohrbach 54 165 0 06 Sep 2018
On Tree-Based Neural Sentence Modeling Freda Shi Hao Zhou Jiaze Chen Lei Li AI4CE 46 42 0 29 Aug 2018
Learning Visually-Grounded Semantics from Contrastive Adversarial Samples Freda Shi Jiayuan Mao Tete Xiao Yuning Jiang Jian Sun ObjD 52 51 0 27 Jun 2018
Straight to the Tree: Constituency Parsing with Neural Syntactic Distance Songlin Yang Zhouhan Lin Athul Paul Jacob Alessandro Sordoni Aaron Courville Yoshua Bengio 39 91 0 11 Jun 2018
Latent Tree Learning with Differentiable Parsers: Shift-Reduce Parsing and Chart Parsing Jean Maillard S. Clark 35 18 0 03 Jun 2018
Word learning and the acquisition of syntactic--semantic overhypotheses Jon Gauthier R. Levy J. Tenenbaum 15 10 0 14 May 2018
Constituency Parsing with a Self-Attentive Encoder Nikita Kitaev Dan Klein 56 537 0 02 May 2018
Quantifying the visual concreteness of words and topics in multimodal datasets Jack Hessel David M. Mimno Lillian Lee 35 39 0 18 Apr 2018
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 57 178 0 02 Nov 2017
Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description Desmond Elliott Stella Frank Loïc Barrault Fethi Bougares Lucia Specia VLM 64 219 0 19 Oct 2017
Dependency Grammar Induction with Neural Lexicalization and Big Training Data Wenjuan Han Yong Jiang Kewei Tu AI4CE 31 20 0 02 Aug 2017
Learning to Compose Task-Specific Tree Structures Jihun Choi Kang Min Yoo Sang-goo Lee 57 189 0 10 Jul 2017
FastText.zip: Compressing text classification models Armand Joulin Edouard Grave Piotr Bojanowski Matthijs Douze Hervé Jégou Tomas Mikolov MQ 74 1,201 0 12 Dec 2016
Learning to Compose Words into Sentences with Reinforcement Learning Dani Yogatama Phil Blunsom Chris Dyer Edward Grefenstette Wang Ling NAI 53 158 0 28 Nov 2016
Categorical Reparameterization with Gumbel-Softmax Eric Jang S. Gu Ben Poole BDL 227 5,323 0 03 Nov 2016
Visual Relationship Detection with Language Priors Cewu Lu Ranjay Krishna Michael S. Bernstein Li Fei-Fei VLM 60 1,137 0 31 Jul 2016
Learning Aligned Cross-Modal Representations from Weakly Aligned Data Lluis Castrejon Y. Aytar Carl Vondrick Hamed Pirsiavash Antonio Torralba SSL DRL AI4TS 56 167 0 25 Jul 2016
Multi30K: Multilingual English-German Image Descriptions Desmond Elliott Stella Frank K. Simaán Lucia Specia VLM 123 583 0 02 May 2016
Resolving Language and Vision Ambiguities Together: Joint Segmentation & Prepositional Attachment Resolution in Captioned Scenes Gordon A. Christie A. Laddha Aishwarya Agrawal Stanislaw Antol Yash Goyal K. Kochersberger Dhruv Batra 39 30 0 07 Apr 2016
Reasoning About Pragmatics with Neural Listeners and Speakers Jacob Andreas Dan Klein ReLM LRM 49 174 0 02 Apr 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.5K 192,638 0 10 Dec 2015
Ask Your Neurons: A Neural-based Approach to Answering Questions about Images Mateusz Malinowski Marcus Rohrbach Mario Fritz 98 597 0 05 May 2015
Multimodal Convolutional Neural Networks for Matching Image and Sentence Lin Ma Zhengdong Lu Lifeng Shang Hang Li 86 337 0 23 Apr 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.0K 149,474 0 22 Dec 2014
Deep Visual-Semantic Alignments for Generating Image Descriptions A. Karpathy Li Fei-Fei 65 5,569 0 07 Dec 2014
Unifying Visual-Semantic Embeddings with Multimodal Neural Language Models Ryan Kiros Ruslan Salakhutdinov R. Zemel VLM 97 1,395 0 10 Nov 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.2K 39,383 0 01 Sep 2014
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 297 43,290 0 01 May 2014
Seeing What You're Told: Sentence-Guided Activity Recognition In Video Siddharth Narayanaswamy Andrei Barbu J. Siskind 36 40 0 19 Aug 2013