Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks

30 September 2021

Papers citing "Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks"

20 / 20 papers shown

Title
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks Jacob Russin Sam Whitman McGrath Danielle J. Williams Lotem Elber-Dorozko AI4CE 73 3 0 24 May 2024
Towards Understanding the Relationship between In-context Learning and Compositional Generalization Sungjun Han Sebastian Padó CoGe 21 2 0 18 Mar 2024
Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings Yichen Jiang Xiang Zhou Mohit Bansal 35 1 0 09 Feb 2024
Language-Guided World Models: A Model-Based Approach to AI Control Alex Zhang Khanh Nguyen Jens Tuyls Albert Lin Karthik Narasimhan LLMAG 31 5 0 24 Jan 2024
Data Factors for Better Compositional Generalization Xiang Zhou Yichen Jiang Mohit Bansal CoGe OOD 24 3 0 08 Nov 2023
Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments Danial Kamali Parisa Kordjamshidi 36 1 0 07 Nov 2023
Layer-wise Representation Fusion for Compositional Generalization Yafang Zheng Lei Lin Shantao Liu Binling Wang Zhaohong Lai Wenhao Rao Biao Fu Yidong Chen Xiaodon Shi AI4CE 43 2 0 20 Jul 2023
Improved Compositional Generalization by Generating Demonstrations for Meta-Learning Sam Spilsbury Alexander Ilin 42 1 0 22 May 2023
Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization Lei Lin Shuangtao Li Yafang Zheng Biao Fu Shantao Liu Yidong Chen Xiaodon Shi CoGe 25 2 0 20 May 2023
Uncontrolled Lexical Exposure Leads to Overestimation of Compositional Generalization in Pretrained Models Najoung Kim Tal Linzen P. Smolensky 21 30 0 21 Dec 2022
Mutual Exclusivity Training and Primitive Augmentation to Induce Compositionality Yichen Jiang Xiang Zhou Mohit Bansal 21 10 0 28 Nov 2022
A Short Survey of Systematic Generalization Yuanpeng Li AI4CE 38 1 0 22 Nov 2022
On the Compositional Generalization Gap of In-Context Learning Arian Hosseini Ankit Vani Dzmitry Bahdanau Alessandro Sordoni Aaron C. Courville 19 24 0 15 Nov 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 114 93 0 06 Oct 2022
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing Linlu Qiu Peter Shaw Panupong Pasupat Tianze Shi Jonathan Herzig Emily Pitler Fei Sha Kristina Toutanova AI4CE LRM 25 52 0 24 May 2022
Improving Systematic Generalization Through Modularity and Augmentation Laura Ruis Brenden Lake 43 16 0 22 Feb 2022
Improving Compositional Generalization with Latent Structure and Data Augmentation Linlu Qiu Peter Shaw Panupong Pasupat Pawel Krzysztof Nowak Tal Linzen Fei Sha Kristina Toutanova CoGe 23 57 0 14 Dec 2021
Revisiting Iterative Back-Translation from the Perspective of Compositional Generalization Yinuo Guo Hualei Zhu Zeqi Lin Bei Chen Jian-Guang Lou Dongmei Zhang BDL 182 26 0 08 Dec 2020
Revisit Systematic Generalization via Meaningful Learning Ning Shi Boxin Wang Wei Wang Xiangyu Liu Zhouhan Lin 14 2 0 14 Mar 2020
Building machines that adapt and compute like brains Brenden Lake J. Tenenbaum AI4CE FedML NAI AILaw 254 890 0 11 Nov 2017