Transformers are Expressive, But Are They Expressive Enough for Regression?

23 February 2024

Papers citing "Transformers are Expressive, But Are They Expressive Enough for Regression?"

6 / 6 papers shown

Title
Solving Empirical Bayes via Transformers Anzo Teh Mark Jabbour Yury Polyanskiy 88 0 0 17 Feb 2025
Towards Understanding the Universality of Transformers for Next-Token Prediction Michael E. Sander Gabriel Peyré CML 39 0 0 03 Oct 2024
Transformers are Universal In-context Learners Takashi Furuya Maarten V. de Hoop Gabriel Peyré 37 6 0 02 Aug 2024
Your Transformer May Not be as Powerful as You Expect Shengjie Luo Shanda Li Shuxin Zheng Tie-Yan Liu Liwei Wang Di He 55 50 0 26 May 2022
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 274 2,013 0 28 Jul 2020
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,923 0 17 Aug 2015