When can transformers reason with abstract symbols?

When can transformers reason with abstract symbols?

15 October 2023

Enric Boix-Adserà

Papers citing "When can transformers reason with abstract symbols?"

13 / 13 papers shown

Title
Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows Wenhao Li Bo Jin Mingyi Hong Changhong Lu Xiangfeng Wang 48 0 0 07 May 2025
Lost in Cultural Translation: Do LLMs Struggle with Math Across Cultural Contexts? Aabid Karim Abdul Karim Bhoomika Lohana Matt Keon Jaswinder Singh A. Sattar 47 0 0 23 Mar 2025
Enhancing Time Series Forecasting via Logic-Inspired Regularization Jianqi Zhang Jingyao Wang Xingchen Shen Wenwen Qiang AI4TS 39 0 0 10 Mar 2025
Exact Learning of Permutations for Nonzero Binary Inputs with Logarithmic Training Size and Quadratic Ensemble Complexity George Giapitzakis Artur Back de Luca K. Fountoulakis 54 0 0 24 Feb 2025
FACTR: Force-Attending Curriculum Training for Contact-Rich Policy Learning Jason Jingzhou Liu Yulong Li Kenneth Shaw Tony Tao Ruslan Salakhutdinov Deepak Pathak OffRL 59 1 0 24 Feb 2025
Out-of-distribution generalization via composition: a lens through induction heads in Transformers Jiajun Song Zhuoyan Xu Yiqiao Zhong 82 4 0 31 Dec 2024
Transformer Normalisation Layers and the Independence of Semantic Subspaces S. Menary Samuel Kaski Andre Freitas 44 2 0 25 Jun 2024
What Can Transformer Learn with Varying Depth? Case Studies on Sequence Learning Tasks Xingwu Chen Difan Zou ViT 24 12 0 02 Apr 2024
Three Pathways to Neurosymbolic Reinforcement Learning with Interpretable Model and Policy Networks Peter Graf Patrick Emami 24 2 0 07 Feb 2024
Vamos: Versatile Action Models for Video Understanding Shijie Wang Qi Zhao Minh Quan Do Nakul Agarwal Kwonjoon Lee Chen Sun 27 19 0 22 Nov 2023
Do Transformers Parse while Predicting the Masked Word? Haoyu Zhao A. Panigrahi Rong Ge Sanjeev Arora 76 31 0 14 Mar 2023
Emergent Symbols through Binding in External Memory Taylor W. Webb I. Sinha J. Cohen 67 64 0 29 Dec 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 228 4,460 0 23 Jan 2020