Fast Heavy Inner Product Identification Between Weights and Inputs in
Neural Network Training

Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training

19 November 2023

Papers citing "Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training"

10 / 10 papers shown

Title
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time Yeqi Gao Zhao Song Weixin Wang Junze Yin 52 28 0 14 Sep 2023
Solving Tensor Low Cycle Rank Approximation Yichuan Deng Yeqi Gao Zhao Song 47 6 0 13 Apr 2023
Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time Zhao Song Licheng Zhang Ruizhe Zhang 67 65 0 14 Dec 2021
Breaking the Linear Iteration Cost Barrier for Some Well-known Conditional Gradient Methods Using MaxIP Data-structures Anshumali Shrivastava Zhao Song Zhaozhuo Xu 64 28 0 30 Nov 2021
Does Preprocessing Help Training Over-parameterized Neural Networks? Zhao Song Shuo Yang Ruizhe Zhang 63 50 0 09 Oct 2021
Sublinear Least-Squares Value Iteration via Locality Sensitive Hashing Anshumali Shrivastava Zhao Song Zhaozhuo Xu 36 22 0 18 May 2021
FetchSGD: Communication-Efficient Federated Learning with Sketching D. Rothchild Ashwinee Panda Enayat Ullah Nikita Ivkin Ion Stoica Vladimir Braverman Joseph E. Gonzalez Raman Arora FedML 60 367 0 15 Jul 2020
An Improved Cutting Plane Method for Convex Optimization, Convex-Concave Games and its Applications Haotian Jiang Y. Lee Zhao Song Sam Chiu-wai Wong 50 106 0 08 Apr 2020
Solving Empirical Risk Minimization in the Current Matrix Multiplication Time Y. Lee Zhao Song Qiuyi Zhang 69 117 0 11 May 2019
Subspace Embedding and Linear Regression with Orlicz Norm Alexandr Andoni Chengyu Lin Ying Sheng Peilin Zhong Ruiqi Zhong 39 36 0 17 Jun 2018