SLOG: A Structural Generalization Benchmark for Semantic Parsing

SLOG: A Structural Generalization Benchmark for Semantic Parsing

23 October 2023

Alexander Koller

ArXiv (abs)PDF HTML

Papers citing "SLOG: A Structural Generalization Benchmark for Semantic Parsing"

13 / 13 papers shown

Title
Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directions Kun Zhang Le Wu Kui Yu Guangyi Lv Dacao Zhang AAML ELM 38 0 0 08 Jun 2025
Behavioural vs. Representational Systematicity in End-to-End Models: An Opinionated Survey Ivan Vegner Sydelle de Souza Valentin Forch Martha Lewis Leonidas A.A. Doumas 59 0 0 04 Jun 2025
Exploring Compositional Generalization (in ReCOGS_pos) by Transformers using Restricted Access Sequence Processing (RASP) William Bruns 108 0 0 21 Apr 2025
Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases Michael Y. Hu Jackson Petty Chuan Shi William Merrill Tal Linzen AI4CE 135 2 0 26 Feb 2025
Analyzing the Inner Workings of Transformers in Compositional Generalization Ryoma Kumon Hitomi Yanaka 103 0 0 24 Feb 2025
Compositional Generalization Across Distributional Shifts with Sparse Tree Operations Paul Soulos Henry Conklin Mattia Opper P. Smolensky Jianfeng Gao Roland Fernandez 140 5 0 18 Dec 2024
Strengthening Structural Inductive Biases by Pre-training to Perform Syntactic Transformations Matthias Lindemann Alexander Koller Ivan Titov AI4CE NAI 73 4 0 05 Jul 2024
Evaluating Structural Generalization in Neural Machine Translation Ryoma Kumon Daiki Matsuoka Hitomi Yanaka NAI 73 2 0 19 Jun 2024
Representations as Language: An Information-Theoretic Framework for Interpretability Henry Conklin Kenny Smith MILM 71 1 0 04 Jun 2024
Neural Semantic Parsing with Extremely Rich Symbolic Meaning Representations Xiao Zhang Gosse Bouma Johan Bos NAI 64 1 0 19 Apr 2024
LIEDER: Linguistically-Informed Evaluation for Discourse Entity Recognition Xiaomeng Zhu Robert Frank 83 0 0 10 Mar 2024
AMR Parsing is Far from Solved: GrAPES, the Granular AMR Parsing Evaluation Suite Jonas Groschwitz Shay B. Cohen L. Donatelli Meaghan Fowlie 80 10 0 06 Dec 2023
Predicting generalization performance with correctness discriminators Yuekun Yao Alexander Koller 113 1 0 15 Nov 2023