Sequential Neural Networks as Automata

4 June 2019

Papers citing "Sequential Neural Networks as Automata"

15 / 15 papers shown

Title
Training Neural Networks as Recognizers of Formal Languages Alexandra Butoi Ghazal Khalighinejad Anej Svete Josef Valvoda Ryan Cotterell Brian DuSell NAI 44 2 0 11 Nov 2024
LLMs as Probabilistic Minimally Adequate Teachers for DFA Learning Lekai Chen Ashutosh Trivedi Alvaro Velasquez 29 1 0 06 Aug 2024
On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning Franz Nowak Anej Svete Alexandra Butoi Ryan Cotterell ReLM LRM 54 12 0 20 Jun 2024
A Tensor Decomposition Perspective on Second-order RNNs M. Lizaire Michael Rizvi-Martel Marawan Gamal Abdel Hameed Guillaume Rabusseau 52 0 0 07 Jun 2024
What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages Nadav Borenstein Anej Svete R. Chan Josef Valvoda Franz Nowak Isabelle Augenstein Eleanor Chodroff Ryan Cotterell 42 11 0 06 Jun 2024
The Illusion of State in State-Space Models William Merrill Jackson Petty Ashish Sabharwal 54 43 0 12 Apr 2024
Recurrent Neural Language Models as Probabilistic Finite-state Automata Anej Svete Ryan Cotterell 32 2 0 08 Oct 2023
Theoretical Conditions and Empirical Failure of Bracket Counting on Long Sequences with Linear Recurrent Networks Nadine El-Naggar Pranava Madhyastha Tillman Weyde 14 1 0 07 Apr 2023
Extracting Finite Automata from RNNs Using State Merging William Merrill Nikolaos Tsilivis 19 14 0 28 Jan 2022
Thinking Like Transformers Gail Weiss Yoav Goldberg Eran Yahav AI4CE 35 127 0 13 Jun 2021
The Limitations of Limited Context for Constituency Parsing Yuchen Li Andrej Risteski 26 4 0 03 Jun 2021
Formal Language Theory Meets Modern NLP William Merrill AI4CE NAI 16 12 0 19 Feb 2021
Distillation of Weighted Automata from Recurrent Neural Networks using a Spectral Approach Rémi Eyraud Stéphane Ayache 19 16 0 28 Sep 2020
Memory-Augmented Recurrent Neural Networks Can Learn Generalized Dyck Languages Mirac Suzgun Sebastian Gehrmann Yonatan Belinkov Stuart M. Shieber 13 50 0 08 Nov 2019
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,926 0 17 Aug 2015