Unlocking Compositional Generalization in Pre-trained Models Using Intermediate Representations

15 April 2021

Yuan Zhang

Papers citing "Unlocking Compositional Generalization in Pre-trained Models Using Intermediate Representations"

29 / 29 papers shown

Title
Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings Yichen Jiang Xiang Zhou Mohit Bansal 35 1 0 09 Feb 2024
Layer-wise Representation Fusion for Compositional Generalization Yafang Zheng Lei Lin Shantao Liu Binling Wang Zhaohong Lai Wenhao Rao Biao Fu Yidong Chen Xiaodon Shi AI4CE 43 2 0 20 Jul 2023
On Evaluating Multilingual Compositional Generalization with Translated Datasets Zi Wang Daniel Hershcovich 25 7 0 20 Jun 2023
Learning to Substitute Spans towards Improving Compositional Generalization Zhaoyi Li Ying Wei Defu Lian 10 9 0 05 Jun 2023
Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques Daking Rai Bailin Wang Yilun Zhou Ziyu Yao 37 27 0 27 May 2023
Learning to Compose Representations of Different Encoder Layers towards Improving Compositional Generalization Lei Lin Shuangtao Li Yafang Zheng Biao Fu Shantao Liu Yidong Chen Xiaodon Shi CoGe 25 2 0 20 May 2023
How Do In-Context Examples Affect Compositional Generalization? Shengnan An Zeqi Lin Qiang Fu B. Chen Nanning Zheng Jian-Guang Lou Dongmei Zhang 34 49 0 08 May 2023
LeafAI: query generator for clinical cohort discovery rivaling a human programmer Nicholas J. Dobbins Bin Han Weipeng Zhou Kristine Lan H. N. Kim R. Harrington Özlem Uzuner Meliha Yetisgen-Yildiz 24 7 0 13 Apr 2023
Knowledge-augmented Few-shot Visual Relation Detection Tianyu Yu Yongqian Li Jiaoyan Chen Hai-Tao Zheng Haitao Zheng ... Qingbin Liu Wenqiang Liu Dongxiao Huang Bei Wu Yexin Wang 52 6 0 09 Mar 2023
A Short Survey of Systematic Generalization Yuanpeng Li AI4CE 38 1 0 22 Nov 2022
On the Compositional Generalization Gap of In-Context Learning Arian Hosseini Ankit Vani Dzmitry Bahdanau Alessandro Sordoni Aaron C. Courville 21 24 0 15 Nov 2022
Generalization Differences between End-to-End and Neuro-Symbolic Vision-Language Reasoning Systems Wang Zhu Jesse Thomason Robin Jia VLM OOD NAI LRM 28 6 0 26 Oct 2022
Modern Baselines for SPARQL Semantic Parsing Debayan Banerjee Pranav Ajit Nair Jivat Neet Kaur Ricardo Usbeck Chris Biemann 30 29 0 27 Apr 2022
Compositional Generalization and Decomposition in Neural Program Synthesis Kensen Shi Joey Hong Manzil Zaheer Pengcheng Yin Charles Sutton 34 5 0 07 Apr 2022
Pay More Attention to History: A Context Modelling Strategy for Conversational Text-to-SQL Yuntao Li Hanchun Zhang Yutian Li Sirui Wang Wei Yu Wu Yan Zhang 19 8 0 16 Dec 2021
Improving Compositional Generalization with Latent Structure and Data Augmentation Linlu Qiu Peter Shaw Panupong Pasupat Pawel Krzysztof Nowak Tal Linzen Fei Sha Kristina Toutanova CoGe 28 57 0 14 Dec 2021
Reason first, then respond: Modular Generation for Knowledge-infused Dialogue Leonard Adolphs Kurt Shuster Jack Urbanek Arthur Szlam Jason Weston KELM LRM 204 41 0 09 Nov 2021
Learning to Generalize Compositionally by Transferring Across Semantic Parsing Tasks Wang Zhu Peter Shaw Tal Linzen Fei Sha 32 7 0 09 Nov 2021
Grounded Graph Decoding Improves Compositional Generalization in Question Answering Yu Gai Paras Jain Wendi Zhang Joseph E. Gonzalez D. Song Ion Stoica BDL OOD 29 8 0 05 Nov 2021
On The Ingredients of an Effective Zero-shot Semantic Parser Pengcheng Yin John Wieting Avirup Sil Graham Neubig 50 15 0 15 Oct 2021
Compositional Generalization in Dependency Parsing Emily Goodwin Siva Reddy Timothy J. O'Donnell Dzmitry Bahdanau CoGe 31 5 0 13 Oct 2021
Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks Yichen Jiang Joey Tianyi Zhou 98 25 0 30 Sep 2021
Natural SQL: Making SQL Easier to Infer from Natural Language Specifications Yujian Gan Xinyun Chen Jinxia Xie Matthew Purver J. Woodward J. Drake Qiaofu Zhang 80 91 0 11 Sep 2021
Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization I. Oren Jonathan Herzig Jonathan Berant 27 31 0 06 Sep 2021
The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers Róbert Csordás Kazuki Irie Jürgen Schmidhuber ViT 30 128 0 26 Aug 2021
Making Transformers Solve Compositional Tasks Santiago Ontañón Joshua Ainslie Vaclav Cvicek Zachary Kenneth Fisher 38 70 0 09 Aug 2021
Revisiting Iterative Back-Translation from the Perspective of Compositional Generalization Yinuo Guo Hualei Zhu Zeqi Lin Bei Chen Jian-Guang Lou Dongmei Zhang BDL 182 26 0 08 Dec 2020
SmBoP: Semi-autoregressive Bottom-up Semantic Parsing Ohad Rubin Jonathan Berant 138 150 0 23 Oct 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 258 1,589 0 21 Jan 2020