Enhancing the Transformer with Explicit Relational Encoding for Math
Problem Solving

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving

15 October 2019

Roland Fernandez

Jürgen Schmidhuber

Papers citing "Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving"

17 / 17 papers shown

Title
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks Jacob Russin Sam Whitman McGrath Danielle J. Williams Lotem Elber-Dorozko AI4CE 81 3 0 24 May 2024
Vector Symbolic Finite State Machines in Attractor Neural Networks Madison Cotteret Hugh Greatorex Martin Ziegler Elisabetta Chicca 44 6 0 02 Dec 2022
A Short Survey of Systematic Generalization Yuanpeng Li AI4CE 43 1 0 22 Nov 2022
Semantic Representations of Mathematical Expressions in a Continuous Vector Space Neeraj Gangwar N. Kani 27 1 0 08 Oct 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages Paul Soulos Sudha Rao Caitlin Smith Eric Rosen Asli Celikyilmaz ... Coleman Haley Roland Fernandez Hamid Palangi Jianfeng Gao P. Smolensky 32 6 0 11 Aug 2022
Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library Yang Hu Yang Yu AIMat AI4CE 19 4 0 28 Mar 2022
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN R. Thomas McCoy P. Smolensky Tal Linzen Jianfeng Gao Asli Celikyilmaz SyDa 25 119 0 18 Nov 2021
Generating Symbolic Reasoning Problems with Transformer GANs Jens U. Kreber Christopher Hahn AI4CE 30 6 0 19 Oct 2021
The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers Róbert Csordás Kazuki Irie Jürgen Schmidhuber ViT 30 129 0 26 Aug 2021
Going Beyond Linear Transformers with Recurrent Fast Weight Programmers Kazuki Irie Imanol Schlag Róbert Csordás Jürgen Schmidhuber 33 57 0 11 Jun 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems Jacob Russin Roland Fernandez Hamid Palangi Eric Rosen Nebojsa Jojic P. Smolensky Jianfeng Gao 14 14 0 19 May 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 24 123 0 25 Feb 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning Yuhuai Wu M. Rabe Wenda Li Jimmy Ba Roger C. Grosse Christian Szegedy AIMat LRM 75 52 0 15 Jan 2021
Scaling Laws for Autoregressive Generative Modeling T. Henighan Jared Kaplan Mor Katz Mark Chen Christopher Hesse ... Nick Ryder Daniel M. Ziegler John Schulman Dario Amodei Sam McCandlish 53 408 0 28 Oct 2020
Hopfield Networks is All You Need Hubert Ramsauer Bernhard Schafl Johannes Lehner Philipp Seidl Michael Widrich ... David P. Kreil Michael K Kopp Günter Klambauer Johannes Brandstetter Sepp Hochreiter 24 415 0 16 Jul 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 64 2,626 0 05 Jun 2020
The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence G. Marcus VLM 32 355 0 14 Feb 2020