A Benchmark for Systematic Generalization in Grounded Language Understanding

11 March 2020

Papers citing "A Benchmark for Systematic Generalization in Grounded Language Understanding"

45 / 45 papers shown

Title
LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning Silin Meng Yiwei Wang Cheng-Fu Yang Nanyun Peng Kai-Wei Chang 59 17 0 20 Jun 2024
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks Jacob Russin Sam Whitman McGrath Danielle J. Williams Lotem Elber-Dorozko AI4CE 75 3 0 24 May 2024
Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models Wenshan Wu Shaoguang Mao Yadong Zhang Yan Xia Li Dong Lei Cui Furu Wei LRM 56 20 0 04 Apr 2024
Compositional learning of functions in humans and machines Yanli Zhou Brenden M. Lake Adina Williams CoGe 43 1 0 18 Mar 2024
Specification Overfitting in Artificial Intelligence Benjamin Roth Pedro Henrique Luz de Araujo Yuxi Xia Saskia Kaltenbrunner Christoph Korab 58 0 0 13 Mar 2024
On the generalization capacity of neural networks during generic multimodal reasoning Takuya Ito Soham Dan Mattia Rigotti James Kozloski Murray Campbell LRM 40 2 0 26 Jan 2024
Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments Danial Kamali Parisa Kordjamshidi 36 1 0 07 Nov 2023
D3: Data Diversity Design for Systematic Generalization in Visual Question Answering Amir Rahimi Vanessa D’Amario Moyuru Yamada Kentaro Takemoto Tomotake Sasaki Xavier Boix 36 1 0 15 Sep 2023
COLLIE: Systematic Construction of Constrained Text Generation Tasks Shunyu Yao Howard Chen Austin W. Hanjie Runzhe Yang Karthik Narasimhan 47 32 0 17 Jul 2023
Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text Zhun Yang Adam Ishay Joohyung Lee LRM ELM 36 52 0 15 Jul 2023
Pento-DIARef: A Diagnostic Dataset for Learning the Incremental Algorithm for Referring Expression Generation from Examples P. Sadler David Schlangen 26 2 0 24 May 2023
HICO-DET-SG and V-COCO-SG: New Data Splits for Evaluating the Systematic Generalization Performance of Human-Object Interaction Detection Models Kenta Takemoto Moyuru Yamada Tomotake Sasaki H. Akima 37 0 0 17 May 2023
ReCOGS: How Incidental Details of a Logical Form Overshadow an Evaluation of Semantic Interpretation Zhengxuan Wu Christopher D. Manning Christopher Potts 32 22 0 24 Mar 2023
A Short Survey of Systematic Generalization Yuanpeng Li AI4CE 43 1 0 22 Nov 2022
On the Complexity of Bayesian Generalization Yuge Shi Manjie Xu J. Hopcroft Kun He J. Tenenbaum Song-Chun Zhu Ying Nian Wu Wenjuan Han Yixin Zhu 28 4 0 20 Nov 2022
Logical Tasks for Measuring Extrapolation and Rule Comprehension Ippei Fujisawa Ryota Kanai ELM LRM 28 4 0 14 Nov 2022
When Can Transformers Ground and Compose: Insights from Compositional Generalization Benchmarks Ankur Sikarwar Arkil Patel Navin Goyal ViT 33 10 0 23 Oct 2022
Neural-Symbolic Recursive Machine for Systematic Generalization Qing Li Yixin Zhu Yitao Liang Ying Nian Wu Song-Chun Zhu Siyuan Huang NAI 38 9 0 04 Oct 2022
Equivariant Transduction through Invariant Alignment Jennifer C. White Ryan Cotterell 19 4 0 22 Sep 2022
Benchmarking Compositionality with Formal Languages Josef Valvoda Naomi Saphra Jonathan Rawski Adina Williams Ryan Cotterell NAI CoGe 33 8 0 17 Aug 2022
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks Andrew M. Saxe Shagun Sodhani Sam Lewallen AI4CE 30 34 0 21 Jul 2022
Intra-agent speech permits zero-shot task acquisition Chen Yan Federico Carnevale Petko Georgiev Adam Santoro Aurelia Guy Alistair Muldal Chia-Chun Hung Josh Abramson Timothy Lillicrap Greg Wayne LM&Ro 36 9 0 07 Jun 2022
RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning Xiaojian Ma Weili Nie Zhiding Yu Huaizu Jiang Chaowei Xiao Yuke Zhu Song-Chun Zhu Anima Anandkumar ViT LRM 30 19 0 24 Apr 2022
One-Shot Learning from a Demonstration with Hierarchical Latent Language Nathaniel Weir Xingdi Yuan Marc-Alexandre Côté Matthew J. Hausknecht Romain Laroche Ida Momennejad H. V. Seijen Benjamin Van Durme BDL 27 6 0 09 Mar 2022
Improving Systematic Generalization Through Modularity and Augmentation Laura Ruis Brenden M. Lake 43 16 0 22 Feb 2022
Inducing Causal Structure for Interpretable Neural Networks Atticus Geiger Zhengxuan Wu Hanson Lu J. Rozner Elisa Kreiss Thomas Icard Noah D. Goodman Christopher Potts CML OOD 35 71 0 01 Dec 2021
Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking Ronen Tamari Kyle Richardson Aviad Sar-Shalom Noam Kahlon Nelson F. Liu Reut Tsarfaty Dafna Shahaf 43 5 0 30 Nov 2021
Compositional Generalization in Dependency Parsing Emily Goodwin Siva Reddy Timothy J. O'Donnell Dzmitry Bahdanau CoGe 44 5 0 13 Oct 2021
Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks Yichen Jiang Joey Tianyi Zhou 98 25 0 30 Sep 2021
Systematic Generalization on gSCAN: What is Nearly Solved and What is Next? Linlu Qiu Hexiang Hu Bowen Zhang Peter Shaw Fei Sha 33 21 0 25 Sep 2021
ReaSCAN: Compositional Reasoning in Language Grounding Zhengxuan Wu Elisa Kreiss Desmond C. Ong Christopher Potts CoGe LRM 29 22 0 18 Sep 2021
Generalization in Multimodal Language Learning from Simulation Aaron Eisermann Jae Hee Lee C. Weber S. Wermter 25 9 0 03 Aug 2021
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization Chiyuan Zhang M. Raghu Jon M. Kleinberg Samy Bengio OOD 32 30 0 27 Jul 2021
Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning Maxwell Nye Michael Henry Tessler J. Tenenbaum Brenden M. Lake 33 117 0 06 Jul 2021
SocialAI: Benchmarking Socio-Cognitive Abilities in Deep Reinforcement Learning Agents Grgur Kovač Rémy Portelas Katja Hofmann Pierre-Yves Oudeyer ALM 27 6 0 02 Jul 2021
Grounding Spatio-Temporal Language with Transformers Tristan Karch Laetitia Teodorescu Katja Hofmann Clément Moulin-Frier Pierre-Yves Oudeyer LM&Ro 22 11 0 16 Jun 2021
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World Rowan Zellers Ari Holtzman Matthew E. Peters Roozbeh Mottaghi Aniruddha Kembhavi Ali Farhadi Yejin Choi 24 68 0 01 Jun 2021
gComm: An environment for investigating generalization in Grounded Language Acquisition Rishi Hazra Sonu Dixit 31 0 0 09 May 2021
Intrinsically Motivated Compositional Language Emergence Rishi Hazra Sonu Dixit Sayambhu Sen 11 1 0 09 Dec 2020
Improving Compositional Generalization in Semantic Parsing I. Oren Jonathan Herzig Nitish Gupta Matt Gardner Jonathan Berant 29 63 0 12 Oct 2020
Think before you act: A simple baseline for compositional generalization C. Heinze-Deml Diane Bouchacourt CoGe 15 16 0 29 Sep 2020
Systematic Generalization on gSCAN with Language Conditioned Embedding Tong Gao Qi Huang Raymond J. Mooney 24 22 0 11 Sep 2020
Compositional Networks Enable Systematic Generalization for Grounded Language Understanding Yen-Ling Kuo Boris Katz Andrei Barbu 34 22 0 06 Aug 2020
Word meaning in minds and machines Brenden M. Lake G. Murphy NAI 15 117 0 04 Aug 2020
Compositional Generalization in Semantic Parsing: Pre-training vs. Specialized Architectures Daniel Furrer Marc van Zee Nathan Scales Nathanael Scharli CoGe 26 113 0 17 Jul 2020