ResearchTrend.AI
Towards smaller, faster decoder-only transformers: Architectural variants and their implications
v1v2 (latest)

Towards smaller, faster decoder-only transformers: Architectural variants and their implications

Sathya Krishnan Suresh
P. Shunmugapriya
ArXiv (abs)PDFHTML

Papers citing "Towards smaller, faster decoder-only transformers: Architectural variants and their implications"

2 / 2 papers shown
Title
The Unreasonable Ineffectiveness of the Deeper Layers
The Unreasonable Ineffectiveness of the Deeper Layers
Andrey Gromov
Kushal Tirumala
Hassan Shapourian
Paolo Glorioso
Daniel A. Roberts
141
106
0
26 Mar 2024
Fast Transformer Decoding: One Write-Head is All You Need
Fast Transformer Decoding: One Write-Head is All You Need
Noam M. Shazeer
163
478
0
06 Nov 2019