Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2203.00633
Cited By
Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale
1 March 2022
Laurent Sartran
Samuel Barrett
A. Kuncoro
Milovs Stanojević
Phil Blunsom
Chris Dyer
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale"
16 / 16 papers shown
Title
Sneaking Syntax into Transformer Language Models with Tree Regularization
Ananjan Nandi
Christopher D. Manning
Shikhar Murty
74
0
0
28 Nov 2024
Can LLMs Really Learn to Translate a Low-Resource Language from One Grammar Book?
Seth Aycock
David Stap
Di Wu
Christof Monz
Khalil Simaán
29
2
0
27 Sep 2024
Banyan: Improved Representation Learning with Explicit Structure
Mattia Opper
N. Siddharth
31
1
0
25 Jul 2024
Punctuation Restoration Improves Structure Understanding Without Supervision
Junghyun Min
Minho Lee
Woochul Lee
Yeonsoo Lee
46
1
0
13 Feb 2024
Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings
Yichen Jiang
Xiang Zhou
Mohit Bansal
27
1
0
09 Feb 2024
Augmenting Transformers with Recursively Composed Multi-grained Representations
Xiang Hu
Qingyang Zhu
Kewei Tu
Wei Wu
21
3
0
28 Sep 2023
SynJax: Structured Probability Distributions for JAX
Miloš Stanojević
Laurent Sartran
SyDa
13
4
0
07 Aug 2023
Polar Ducks and Where to Find Them: Enhancing Entity Linking with Duck Typing and Polar Box Embeddings
Mattia Atzeni
Mikhail Plekhanov
F. Dreyer
Nora Kassner
Simone Merello
Louis Martin
Nicola Cancedda
29
0
0
19 May 2023
Composition, Attention, or Both?
Ryosuke Yoshida
Yohei Oseki
CoGe
21
0
0
24 Oct 2022
Forming Trees with Treeformers
Nilay Patel
Jeffrey Flanigan
AI4CE
11
3
0
14 Jul 2022
Unbiased and Efficient Sampling of Dependency Trees
Milovs Stanojević
23
3
0
25 May 2022
Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling
Jakob Prange
Nathan Schneider
Lingpeng Kong
19
9
0
15 Dec 2021
Transition-based Parsing with Stack-Transformers
Ramón Fernández Astudillo
Miguel Ballesteros
Tahira Naseem
Austin Blodgett
Radu Florian
46
71
0
20 Oct 2020
Big Bird: Transformers for Longer Sequences
Manzil Zaheer
Guru Guruganesh
Kumar Avinava Dubey
Joshua Ainslie
Chris Alberti
...
Philip Pham
Anirudh Ravula
Qifan Wang
Li Yang
Amr Ahmed
VLM
259
2,013
0
28 Jul 2020
Scaling Laws for Neural Language Models
Jared Kaplan
Sam McCandlish
T. Henighan
Tom B. Brown
B. Chess
R. Child
Scott Gray
Alec Radford
Jeff Wu
Dario Amodei
228
4,460
0
23 Jan 2020
What you can cram into a single vector: Probing sentence embeddings for linguistic properties
Alexis Conneau
Germán Kruszewski
Guillaume Lample
Loïc Barrault
Marco Baroni
199
882
0
03 May 2018
1