ReCOGS: How Incidental Details of a Logical Form Overshadow an
Evaluation of Semantic Interpretation

v1v2 (latest)

ReCOGS: How Incidental Details of a Logical Form Overshadow an Evaluation of Semantic Interpretation

24 March 2023

Christopher D. Manning

Christopher Potts

ArXiv (abs)PDF HTML

Papers citing "ReCOGS: How Incidental Details of a Logical Form Overshadow an Evaluation of Semantic Interpretation"

17 / 17 papers shown

Title
Reasoning Bias of Next Token Prediction Training Pengxiao Lin Zhongwang Zhang Zhi-Qin John Xu LRM 181 2 0 21 Feb 2025
Language model acceptability judgements are not always robust to context Koustuv Sinha Jon Gauthier Aaron Mueller Kanishka Misra Keren Fuentes R. Levy Adina Williams 77 18 0 18 Dec 2022
Hierarchical Phrase-based Sequence-to-Sequence Learning Bailin Wang Ivan Titov Jacob Andreas Yoon Kim 55 7 0 15 Nov 2022
Structural generalization is hard for sequence-to-sequence models Yuekun Yao Alexander Koller 77 22 0 24 Oct 2022
Revisiting the Compositional Generalization Abilities of Neural Sequence Models Arkil Patel S. Bhattamishra Phil Blunsom Navin Goyal BDL CoGe 68 32 0 14 Mar 2022
Improving Compositional Generalization with Latent Structure and Data Augmentation Linlu Qiu Peter Shaw Panupong Pasupat Pawel Krzysztof Nowak Tal Linzen Fei Sha Kristina Toutanova CoGe 86 57 0 14 Dec 2021
Systematic Generalization with Edge Transformers Leon Bergen Timothy J. O'Donnell Dzmitry Bahdanau 55 47 0 01 Dec 2021
Making Transformers Solve Compositional Tasks Santiago Ontañón Joshua Ainslie Vaclav Cvicek Zachary Kenneth Fisher 98 73 0 09 Aug 2021
Meta-Learning to Compositionally Generalize Henry Conklin Bailin Wang Kenny Smith Ivan Titov OOD 102 76 0 08 Jun 2021
Lexicon Learning for Few-Shot Neural Sequence Modeling Ekin Akyürek Jacob Andreas 79 33 0 07 Jun 2021
Compositional Generalization via Semantic Tagging Hao Zheng Mirella Lapata 71 35 0 22 Oct 2020
Improving Compositional Generalization in Semantic Parsing I. Oren Jonathan Herzig Nitish Gupta Matt Gardner Jonathan Berant 73 63 0 12 Oct 2020
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation Najoung Kim Tal Linzen CoGe 48 280 0 12 Oct 2020
Span-based Semantic Parsing for Compositional Generalization Jonathan Herzig Jonathan Berant ReLM LRM 58 102 0 13 Sep 2020
Measuring Compositional Generalization: A Comprehensive Method on Realistic Data Daniel Keysers Nathanael Scharli Nathan Scales Hylke Buisman Daniel Furrer ... Tibor Tihon Dmitry Tsarkov Tianlin Li Marc van Zee Olivier Bousquet CoGe 68 354 0 20 Dec 2019
Posing Fair Generalization Tasks for Natural Language Inference Atticus Geiger Ignacio Cases L. Karttunen Christopher Potts 60 48 0 03 Nov 2019
Universal Semantic Parsing Siva Reddy Oscar Täckström Slav Petrov Mark Steedman Mirella Lapata 41 105 0 10 Feb 2017

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.