Symbolic Brittleness in Sequence Models: on Systematic Generalization in Symbolic Mathematics

28 September 2021

Yejin Choi

Papers citing "Symbolic Brittleness in Sequence Models: on Systematic Generalization in Symbolic Mathematics"

28 / 28 papers shown

Title
Mitigating Data Scarcity in Time Series Analysis: A Foundation Model with Series-Symbol Data Generation Wenxuan Wang K. Wu Yujian Betterest Li Dan Wang Xinsong Zhang Jiaheng Liu AI4TS 68 0 0 24 Feb 2025
SetLexSem Challenge: Using Set Operations to Evaluate the Lexical and Semantic Robustness of Language Models Bardiya Akhbari Manish Gawali Nicholas A. Dronen AAML 42 0 0 11 Nov 2024
MLissard: Multilingual Long and Simple Sequential Reasoning Benchmarks M. Bueno R. Lotufo Rodrigo Nogueira LRM 31 0 0 08 Oct 2024
AlphaIntegrator: Transformer Action Search for Symbolic Integration Proofs Mert Ünsal Timon Gehr Martin Vechev 18 0 0 03 Oct 2024
Unsupervised Dynamics Prediction with Object-Centric Kinematics Yeon-Ji Song Suhyung Choi Jaein Kim Jin-Hwa Kim Byoung-Tak Zhang 43 0 0 29 Apr 2024
Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions Jordan Meadows Tamsin James André Freitas ReLM LRM AI4CE 38 1 0 29 Apr 2024
Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders Yingji Zhang Danilo S. Carvalho Marco Valentino Ian Pratt-Hartmann André Freitas DRL 56 5 0 01 Feb 2024
Multi-Operational Mathematical Derivations in Latent Space Marco Valentino Jordan Meadows Lan Zhang André Freitas 29 5 0 02 Nov 2023
What Algorithms can Transformers Learn? A Study in Length Generalization Hattie Zhou Arwen Bradley Etai Littwin Noam Razin Omid Saremi Josh Susskind Samy Bengio Preetum Nakkiran 34 110 0 24 Oct 2023
SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-training Kazem Meidani Parshin Shojaee Chandan K. Reddy A. Farimani 20 18 0 03 Oct 2023
Learning the greatest common divisor: explaining transformer predictions Franccois Charton 20 17 0 29 Aug 2023
Faith and Fate: Limits of Transformers on Compositionality Nouha Dziri Ximing Lu Melanie Sclar Xiang Lorraine Li Liwei Jian ... Sean Welleck Xiang Ren Allyson Ettinger Zaïd Harchaoui Yejin Choi ReLM LRM 30 329 0 29 May 2023
A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers Jordan Meadows Marco Valentino Damien Teney André Freitas 33 8 0 21 May 2023
Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models Alberto Testolin AIMat 35 20 0 14 Mar 2023
Towards Autoformalization of Mathematics and Code Correctness: Experiments with Elementary Proofs Garett Cunningham Razvan C. Bunescu D. Juedes LRM 18 16 0 05 Jan 2023
A Survey of Deep Learning for Mathematical Reasoning Pan Lu Liang Qiu Wenhao Yu Sean Welleck Kai-Wei Chang ReLM LRM 40 137 0 20 Dec 2022
What is my math transformer doing? -- Three results on interpretability and generalization Franccois Charton 11 19 0 31 Oct 2022
Lila: A Unified Benchmark for Mathematical Reasoning Swaroop Mishra Matthew Finlayson Pan Lu Leonard Tang Sean Welleck ... Tanmay Rajpurohit Oyvind Tafjord Ashish Sabharwal Peter Clark Ashwin Kalyan ELM AIMat ReLM LRM 30 0 0 31 Oct 2022
A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models Alessandro Stolfo Zhijing Jin Kumar Shridhar Bernhard Schölkopf Mrinmaya Sachan ELM OOD LRM 35 61 0 21 Oct 2022
Induced Natural Language Rationales and Interleaved Markup Tokens Enable Extrapolation in Large Language Models M. Bueno Carlos Gemmel Jeffrey Stephen Dalton R. Lotufo Rodrigo Nogueira LRM 37 12 0 24 Aug 2022
SALSA: Attacking Lattice Cryptography with Transformers Emily Wenger Mingjie Chen Franccois Charton Kristin E. Lauter AAML 33 35 0 11 Jul 2022
NaturalProver: Grounded Mathematical Proof Generation with Language Models Sean Welleck Jiacheng Liu Ximing Lu Hannaneh Hajishirzi Yejin Choi AIMat LRM 30 66 0 25 May 2022
End-to-end symbolic regression with transformers Pierre-Alexandre Kamienny Stéphane dÁscoli Guillaume Lample Franccois Charton 25 163 0 22 Apr 2022
Linear algebra with transformers Franccois Charton AIMat 29 56 0 03 Dec 2021
Iterated learning for emergent systematicity in VQA Ankit Vani Max Schwarzer Yucheng Lu Eeshan Gunesh Dhekane Rameswar Panda 70 24 0 03 May 2021
Enhancing the Transformer Decoder with Transition-based Syntax Leshem Choshen Omri Abend 33 1 0 29 Jan 2021
Certified Robustness to Adversarial Word Substitutions Robin Jia Aditi Raghunathan Kerem Göksel Percy Liang AAML 183 291 0 03 Sep 2019
Generating Natural Language Adversarial Examples M. Alzantot Yash Sharma Ahmed Elgohary Bo-Jhang Ho Mani B. Srivastava Kai-Wei Chang AAML 245 915 0 21 Apr 2018