Optimal Sketching for Kronecker Product Regression and Low Rank Approximation

29 September 2019

Papers citing "Optimal Sketching for Kronecker Product Regression and Low Rank Approximation"

30 / 30 papers shown

Title
SLICK: Selective Localization and Instance Calibration for Knowledge-Enhanced Car Damage Segmentation in Automotive Insurance Teerapong Panboonyuen 220 0 0 12 Jun 2025
Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapse Josh Alman Zhao Song 155 4 0 22 May 2025
Quantum Speedup for Spectral Approximation of Kronecker Products Yeqi Gao Zhao Song Ruizhe Zhang 79 3 0 10 Feb 2024
The Fine-Grained Complexity of Gradient Computation for Training Large Language Models Josh Alman Zhao Song 89 17 0 07 Feb 2024
Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training Lianke Qin Saayan Mitra Zhao Song Yuanyuan Yang Dinesh Manocha 94 0 0 19 Nov 2023
How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation Josh Alman Zhao Song 157 40 0 06 Oct 2023
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time Yeqi Gao Zhao Song Weixin Wang Junze Yin 150 30 0 14 Sep 2023
Online Adaptive Mahalanobis Distance Estimation Lianke Qin Aravind Reddy Zhao Song 103 1 0 02 Sep 2023
Solving Attention Kernel Regression Problem via Pre-conditioner Zhao Song Junze Yin Licheng Zhang 112 17 0 28 Aug 2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models Yeqi Gao Zhao Song Junze Yin 97 19 0 21 Aug 2023
Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification Lianke Qin Zhao Song Yuanyuan Yang 78 9 0 13 Jul 2023
Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation Zhao Song Mingquan Ye Junze Yin Licheng Zhang 87 7 0 07 Jun 2023
Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis Xiangyi Chen Zhao Song Baochen Sun Junze Yin Danyang Zhuo 110 4 0 06 Jun 2023
Efficient Asynchronize Stochastic Gradient Algorithm with Structured Data Zhao Song Mingquan Ye 95 4 0 13 May 2023
Solving Tensor Low Cycle Rank Approximation Yichuan Deng Yeqi Gao Zhao Song 96 6 0 13 Apr 2023
Low Rank Matrix Completion via Robust Alternating Minimization in Nearly Linear Time Yuzhou Gu Zhao Song Junze Yin Licheng Zhang 134 28 0 21 Feb 2023
$A Nearly-Optimal Bound for Fast Regression with $\ell_\infty$ Guarantee$ A Nearly-Optimal Bound for Fast Regression with $\ell_\infty$ Guarantee Zhao Song Mingquan Ye Junze Yin Licheng Zhang 127 15 0 01 Feb 2023
Dynamic Tensor Product Regression Aravind Reddy Zhao Song Licheng Zhang 115 22 0 08 Oct 2022
Subquadratic Kronecker Regression with Applications to Tensor Decomposition Matthew Fahrbach Thomas Fu Mehrdad Ghadiri 118 17 0 11 Sep 2022
Near-Linear Time and Fixed-Parameter Tractable Algorithms for Tensor Decompositions Arvind V. Mahankali David P. Woodruff Ziyun Zhang 77 5 0 15 Jul 2022
Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time Zhao Song Licheng Zhang Ruizhe Zhang 152 66 0 14 Dec 2021
Fast Graph Neural Tangent Kernel via Kronecker Sketching Shunhua Jiang Yunze Man Zhao Song Zheng Yu Danyang Zhuo 123 8 0 04 Dec 2021
More Efficient Sampling for Tensor Decomposition With Worst-Case Guarantees Osman Asif Malik 101 16 0 14 Oct 2021
Fast Sketching of Polynomial Kernels of Polynomial Degree Zhao Song David P. Woodruff Zheng Yu Lichen Zhang 114 43 0 21 Aug 2021
Fast Low-Rank Tensor Decomposition by Ridge Leverage Score Sampling Matthew Fahrbach Mehrdad Ghadiri Thomas Fu 37 5 0 22 Jul 2021
Efficient Tensor Contraction via Fast Count Sketch Xingyu Cao Jiani Liu 70 0 0 24 Jun 2021
Training (Overparametrized) Neural Networks in Near-Linear Time Jan van den Brand Binghui Peng Zhao Song Omri Weinstein ODL 123 83 0 20 Jun 2020
Sketching Transformed Matrices with Applications to Natural Language Processing Yingyu Liang Zhao Song Mengdi Wang Lin F. Yang Xin Yang 144 4 0 23 Feb 2020
Sublinear Time Numerical Linear Algebra for Structured Matrices Xiaofei Shi David P. Woodruff 73 17 0 12 Dec 2019
Total Least Squares Regression in Input Sparsity Time H. Diao Zhao Song David P. Woodruff Xin Yang 45 8 0 27 Sep 2019