Extensions and Limitations of the Neural GPU

2 November 2016

Papers citing "Extensions and Limitations of the Neural GPU"

7 / 7 papers shown

Title
Transformers discover an elementary calculation system exploiting local attention and grid-like problem representation Samuel Cognolato Alberto Testolin 44 7 0 06 Jul 2022
Neural Networks and the Chomsky Hierarchy Grégoire Delétang Anian Ruoss Jordi Grau-Moya Tim Genewein L. Wenliang ... Chris Cundy Marcus Hutter Shane Legg Joel Veness Pedro A. Ortega UQCV 109 133 0 05 Jul 2022
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 24 123 0 25 Feb 2021
Progress Extrapolating Algorithmic Learning to Arbitrary Sequence Lengths Andreas Robinson 42 0 0 18 Mar 2020
On the Turing Completeness of Modern Neural Network Architectures Jorge A. Pérez Javier Marinkovic Pablo Barceló BDL 23 140 0 10 Jan 2019
Improving the Neural GPU Architecture for Algorithm Learning Kārlis Freivalds Renars Liepins 25 43 0 28 Feb 2017
Learning Efficient Algorithms with Hierarchical Attentive Memory Marcin Andrychowicz Karol Kurach 41 51 0 09 Feb 2016