Linear algebra with transformers

3 December 2021

Papers citing "Linear algebra with transformers"

41 / 41 papers shown

Title
Int2Int: a framework for mathematics with transformers François Charton ViT 147 0 0 22 Feb 2025
Towards a Foundation Model for Partial Differential Equations: Multi-Operator Learning and Extrapolation Jingmin Sun Yuxuan Liu Zecheng Zhang Hayden Schaeffer AI4CE 90 20 0 18 Apr 2024
Solving Quantitative Reasoning Problems with Language Models Aitor Lewkowycz Anders Andreassen David Dohan Ethan Dyer Henryk Michalewski ... Theo Gutman-Solo Yuhuai Wu Behnam Neyshabur Guy Gur-Ari Vedant Misra ReLM ELM LRM 175 837 0 29 Jun 2022
Simplifying Polylogarithms with Machine Learning Aurélien Dersy M. Schwartz Xiao-Yan Zhang AI4CE 167 16 0 08 Jun 2022
NaturalProver: Grounded Mathematical Proof Generation with Language Models Sean Welleck Jiacheng Liu Ximing Lu Hannaneh Hajishirzi Yejin Choi AIMat LRM 70 72 0 25 May 2022
Deep Symbolic Regression for Recurrent Sequences Stéphane dÁscoli Pierre-Alexandre Kamienny Guillaume Lample Franccois Charton 127 55 0 12 Jan 2022
Training Verifiers to Solve Math Word Problems K. Cobbe V. Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun ... Jerry Tworek Jacob Hilton Reiichiro Nakano Christopher Hesse John Schulman ReLM OffRL LRM 283 4,408 0 27 Oct 2021
The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization Róbert Csordás Kazuki Irie Jürgen Schmidhuber AI4CE 79 57 0 14 Oct 2021
Symbolic Brittleness in Sequence Models: on Systematic Generalization in Symbolic Mathematics Sean Welleck Peter West Jize Cao Yejin Choi 95 30 0 28 Sep 2021
Transformer-based Machine Learning for Fast SAT Solvers and Logic Synthesis Feng Shi Chonghan Lee M. K. Bashar N. Shukla Song-Chun Zhu N. Vijaykrishnan NAI LRM 88 13 0 15 Jul 2021
Multiplying Matrices Without Multiplying Davis W. Blalock John Guttag 103 51 0 21 Jun 2021
Neural Symbolic Regression that Scales Luca Biggio Tommaso Bendinelli Alexander Neitz Aurelien Lucchi Giambattista Parascandolo 82 179 0 11 Jun 2021
Solving Arithmetic Word Problems with Transformers and Preprocessing of Problem Text Kaden Griffith Jugal Kalita 40 12 0 02 Jun 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 75 125 0 25 Feb 2021
Combinatorial optimization and reasoning with graph neural networks Quentin Cappart Didier Chételat Elias Boutros Khalil Andrea Lodi Christopher Morris Petar Velickovic AI4CE 57 358 0 18 Feb 2021
Proof Artifact Co-training for Theorem Proving with Language Models Jesse Michael Han Jason M. Rute Yuhuai Wu Edward W. Ayers Stanislas Polu AIMat 96 125 0 11 Feb 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 543 2,086 0 28 Jul 2020
Fast Transformers with Clustered Attention Apoorv Vyas Angelos Katharopoulos Franccois Fleuret 57 153 0 09 Jul 2020
Learning continuous-time PDEs from sparse data with graph neural networks V. Iakovlev Markus Heinonen Harri Lähdesmäki AI4CE 79 70 0 16 Jun 2020
Linformer: Self-Attention with Linear Complexity Sinong Wang Belinda Z. Li Madian Khabsa Han Fang Hao Ma 210 1,706 0 08 Jun 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 399 13,035 0 26 May 2020
Teaching Temporal Logics to Neural Networks Christopher Hahn Frederik Schmitt Jens U. Kreber M. Rabe Bernd Finkbeiner NAI 86 67 0 06 Mar 2020
The Use of Deep Learning for Symbolic Integration: A Review of (Lample and Charton, 2019) E. Davis 50 23 0 12 Dec 2019
Deep Learning for Symbolic Mathematics Guillaume Lample François Charton 3DGS 102 411 0 02 Dec 2019
Transformer-based Acoustic Modeling for Hybrid Speech Recognition Yongqiang Wang Abdel-rahman Mohamed Duc Le Chunxi Liu Alex Xiao ... Xiaohui Zhang Frank Zhang Christian Fuegen Geoffrey Zweig M. Seltzer 50 249 0 22 Oct 2019
Solving Math Word Problems with Double-Decoder Transformer Yuanliang Meng Anna Rumshisky AIMat 23 10 0 28 Aug 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 122 1,899 0 23 Apr 2019
Learning Numeracy: Binary Arithmetic with Neural Turing Machines Jacopo Castellini 19 2 0 04 Apr 2019
Analysing Mathematical Reasoning Abilities of Neural Models D. Saxton Edward Grefenstette Felix Hill Pushmeet Kohli LRM 185 428 0 02 Apr 2019
Neural Arithmetic Logic Units Andrew Trask Felix Hill Scott E. Reed Jack W. Rae Chris Dyer Phil Blunsom NAI 70 205 0 01 Aug 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Failures of Gradient-Based Deep Learning Shai Shalev-Shwartz Ohad Shamir Shaked Shammah ODL UQCV 88 201 0 23 Mar 2017
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 330 8,130 0 13 Aug 2016
Adaptive Computation Time for Recurrent Neural Networks Alex Graves 112 547 0 29 Mar 2016
Moment-Based Spectral Analysis of Random Graphs with Given Expected Degrees V. Preciado M. Amin Rahimian 36 9 0 11 Dec 2015
Neural GPUs Learn Algorithms Lukasz Kaiser Ilya Sutskever 79 369 0 25 Nov 2015
Learning Simple Algorithms from Examples Wojciech Zaremba Tomas Mikolov Armand Joulin Rob Fergus MLAU 67 100 0 23 Nov 2015
Grid Long Short-Term Memory Nal Kalchbrenner Ivo Danihelka Alex Graves AI4TS 76 363 0 06 Jul 2015
Pointer Networks Oriol Vinyals Meire Fortunato Navdeep Jaitly 118 3,055 0 09 Jun 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.8K 150,115 0 22 Dec 2014
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 1.0K 23,354 0 03 Jun 2014