SLOG: A Structural Generalization Benchmark for Semantic Parsing

SLOG: A Structural Generalization Benchmark for Semantic Parsing

23 October 2023

Alexander Koller

ArXiv (abs)PDF HTML

Papers citing "SLOG: A Structural Generalization Benchmark for Semantic Parsing"

13 / 13 papers shown

Title
Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directions Kun Zhang Le Wu Kui Yu Guangyi Lv Dacao Zhang AAML ELM 36 0 0 08 Jun 2025
Behavioural vs. Representational Systematicity in End-to-End Models: An Opinionated Survey Ivan Vegner Sydelle de Souza Valentin Forch Martha Lewis Leonidas A.A. Doumas 59 0 0 04 Jun 2025
Exploring Compositional Generalization (in ReCOGS_pos) by Transformers using Restricted Access Sequence Processing (RASP) William Bruns 108 0 0 21 Apr 2025
Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases Michael Y. Hu Jackson Petty Chuan Shi William Merrill Tal Linzen AI4CE 135 2 0 26 Feb 2025
Analyzing the Inner Workings of Transformers in Compositional Generalization Ryoma Kumon Hitomi Yanaka 103 0 0 24 Feb 2025
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations Paul Soulos Henry Conklin Mattia Opper P. Smolensky Jianfeng Gao Roland Fernandez 138 5 0 18 Dec 2024
Strengthening Structural Inductive Biases by Pre-training to Perform Syntactic Transformations Matthias Lindemann Alexander Koller Ivan Titov AI4CE NAI 73 4 0 05 Jul 2024
Evaluating Structural Generalization in Neural Machine Translation Ryoma Kumon Daiki Matsuoka Hitomi Yanaka NAI 73 2 0 19 Jun 2024
Representations as Language: An Information-Theoretic Framework for Interpretability Henry Conklin Kenny Smith MILM 71 1 0 04 Jun 2024
Neural Semantic Parsing with Extremely Rich Symbolic Meaning Representations Xiao Zhang Gosse Bouma Johan Bos NAI 64 1 0 19 Apr 2024
LIEDER: Linguistically-Informed Evaluation for Discourse Entity Recognition Xiaomeng Zhu Robert Frank 83 0 0 10 Mar 2024
AMR Parsing is Far from Solved: GrAPES, the Granular AMR Parsing Evaluation Suite Jonas Groschwitz Shay B. Cohen L. Donatelli Meaghan Fowlie 80 10 0 06 Dec 2023
Predicting generalization performance with correctness discriminators Yuekun Yao Alexander Koller 113 1 0 15 Nov 2023

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.