Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations

14 March 2019

Papers citing "Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations"

26 / 26 papers shown

Title
Position: Curvature Matrices Should Be Democratized via Linear Operators Felix Dangel Runa Eschenhagen Weronika Ormaniec Andres Fernandez Lukas Tatzel Agustinus Kristiadi 61 3 0 31 Jan 2025
Geometry is All You Need: A Unified Taxonomy of Matrix and Tensor Factorization for Compression of Generative Language Models Mingxue Xu Sadia Sharmin Danilo Mandic 35 2 0 03 Oct 2024
Two Sparse Matrices are Better than One: Sparsifying Neural Networks with Double Sparse Factorization Vladimír Boža Vladimír Macko 30 1 0 27 Sep 2024
Symmetry-Based Structured Matrices for Efficient Approximately Equivariant Networks Ashwin Samudre Mircea Petrache Brian D. Nord Shubhendu Trivedi 50 2 0 18 Sep 2024
MoRe Fine-Tuning with 10x Fewer Parameters Wenxuan Tan Nicholas Roberts Tzu-Heng Huang Jitian Zhao John Cooper Samuel Guo Chengyu Duan Frederic Sala 34 0 0 30 Aug 2024
SWAT: Scalable and Efficient Window Attention-based Transformers Acceleration on FPGAs Zhenyu Bai Pranav Dangi Huize Li Tulika Mitra 29 5 0 27 May 2024
Reducing Memory Requirements for the IPU using Butterfly Factorizations S. Shekofteh Christian Alles Holger Fröning 30 0 0 16 Sep 2023
Training Energy-Based Normalizing Flow with Score-Matching Objectives Chen-Hao Chao Wei-Fang Sun Yen-Chang Hsu Z. Kira Chun-Yi Lee 33 2 0 24 May 2023
Simple Hardware-Efficient Long Convolutions for Sequence Modeling Daniel Y. Fu Elliot L. Epstein Eric N. D. Nguyen A. Thomas Michael Zhang Tri Dao Atri Rudra Christopher Ré 16 52 0 13 Feb 2023
ButterflyNet2D: Bridging Classical Methods and Neural Network Methods in Image Processing Gengzhi Yang Yingzhou Li 35 0 0 29 Nov 2022
Efficient NTK using Dimensionality Reduction Nir Ailon Supratim Shit 38 0 0 10 Oct 2022
Adaptable Butterfly Accelerator for Attention-based NNs via Hardware and Algorithm Co-design Hongxiang Fan Thomas C. P. Chau Stylianos I. Venieris Royson Lee Alexandros Kouris Wayne Luk Nicholas D. Lane Mohamed S. Abdelfattah 40 58 0 20 Sep 2022
Arithmetic Circuits, Structured Matrices and (not so) Deep Learning Atri Rudra 18 1 0 24 Jun 2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré VLM 101 2,045 0 27 May 2022
Monarch: Expressive Structured Matrices for Efficient and Accurate Training Tri Dao Beidi Chen N. Sohoni Arjun D Desai Michael Poli Jessica Grogan Alexander Liu Aniruddh Rao Atri Rudra Christopher Ré 29 87 0 01 Apr 2022
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models Tri Dao Beidi Chen Kaizhao Liang Jiaming Yang Zhao Song Atri Rudra Christopher Ré 33 75 0 30 Nov 2021
Efficient Identification of Butterfly Sparse Matrix Factorizations Léon Zheng E. Riccietti Rémi Gribonval 44 6 0 04 Oct 2021
Rethinking Neural Operations for Diverse Tasks Nicholas Roberts M. Khodak Tri Dao Liam Li Christopher Ré Ameet Talwalkar AI4CE 38 22 0 29 Mar 2021
Learning quantum data with the quantum Earth Mover's distance B. Kiani Giacomo De Palma M. Marvian Zi-Wen Liu S. Lloyd 21 45 0 08 Jan 2021
Wide-band butterfly network: stable and efficient inversion via multi-frequency neural networks Matthew T.C. Li L. Demanet Leonardo Zepeda-Núnez 35 8 0 24 Nov 2020
Optimal Robustness-Consistency Trade-offs for Learning-Augmented Online Algorithms Alexander Wei Fred Zhang 24 93 0 22 Oct 2020
HiPPO: Recurrent Memory with Optimal Polynomial Projections Albert Gu Tri Dao Stefano Ermon Atri Rudra Christopher Ré 54 489 0 17 Aug 2020
Sparse Linear Networks with a Fixed Butterfly Structure: Theory and Practice Nir Ailon Omer Leibovitch Vineet Nair 15 14 0 17 Jul 2020
Graph Structure of Neural Networks Jiaxuan You J. Leskovec Kaiming He Saining Xie GNN 27 137 0 13 Jul 2020
Fast Sparse ConvNets Erich Elsen Marat Dukhan Trevor Gale Karen Simonyan 21 151 0 21 Nov 2019
Butterfly Transform: An Efficient FFT Based Neural Architecture Design Keivan Alizadeh-Vahid Anish K. Prabhu Ali Farhadi Mohammad Rastegari 32 50 0 05 Jun 2019