Multi-scale Transformer Language Models

1 May 2020

Papers citing "Multi-scale Transformer Language Models"

4 / 4 papers shown

Title
Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecasting Amin Shabani A. Abdi Li Meng Tristan Sylvain AI4TS 27 61 0 08 Jun 2022
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing Zihang Dai Guokun Lai Yiming Yang Quoc V. Le 48 230 0 05 Jun 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 264 4,505 0 23 Jan 2020
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,929 0 17 Aug 2015