Beyond Transformers for Function Learning

19 April 2023

Papers citing "Beyond Transformers for Function Learning"

10 / 10 papers shown

Title
Transformers learn in-context by gradient descent J. Oswald Eyvind Niklasson E. Randazzo João Sacramento A. Mordvintsev A. Zhmoginov Max Vladymyrov MLT 116 494 0 15 Dec 2022
What Can Transformers Learn In-Context? A Case Study of Simple Function Classes Shivam Garg Dimitris Tsipras Percy Liang Gregory Valiant 141 514 0 01 Aug 2022
On Neural Architecture Inductive Biases for Relational Tasks Giancarlo Kerg Sarthak Mittal David Rolnick Yoshua Bengio Blake A. Richards Guillaume Lajoie OOD 88 25 0 09 Jun 2022
Relating transformers to models and neural representations of the hippocampal formation James C. R. Whittington Joseph Warren Timothy Edward John Behrens 105 83 0 07 Dec 2021
Modelling the development of counting with memory-augmented neural networks Zachary Dulberg Taylor Webb Jonathan Cohen 80 3 0 21 May 2021
Relational inductive biases, deep learning, and graph networks Peter W. Battaglia Jessica B. Hamrick V. Bapst Alvaro Sanchez-Gonzalez V. Zambaldi ... Pushmeet Kohli M. Botvinick Oriol Vinyals Yujia Li Razvan Pascanu AI4CE NAI 769 3,131 0 04 Jun 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 481 20,233 0 30 Oct 2017
Neural Episodic Control Alexander Pritzel Benigno Uria Sriram Srinivasan A. Badia Oriol Vinyals Demis Hassabis Daan Wierstra Charles Blundell OffRL BDL 109 346 0 06 Mar 2017
Geometric deep learning: going beyond Euclidean data M. Bronstein Joan Bruna Yann LeCun Arthur Szlam P. Vandergheynst GNN 813 3,298 0 24 Nov 2016
Neural Turing Machines Alex Graves Greg Wayne Ivo Danihelka 111 2,333 0 20 Oct 2014