Optimal Sketching for Kronecker Product Regression and Low Rank Approximation

29 September 2019

Papers citing "Optimal Sketching for Kronecker Product Regression and Low Rank Approximation"

30 / 30 papers shown

Title
SLICK: Selective Localization and Instance Calibration for Knowledge-Enhanced Car Damage Segmentation in Automotive Insurance Teerapong Panboonyuen 153 0 0 12 Jun 2025
Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapse Josh Alman Zhao Song 102 2 0 22 May 2025
Quantum Speedup for Spectral Approximation of Kronecker Products Yeqi Gao Zhao Song Ruizhe Zhang 63 3 0 10 Feb 2024
The Fine-Grained Complexity of Gradient Computation for Training Large Language Models Josh Alman Zhao Song 70 15 0 07 Feb 2024
Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training Lianke Qin Saayan Mitra Zhao Song Yuanyuan Yang Dinesh Manocha 78 0 0 19 Nov 2023
How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation Josh Alman Zhao Song 127 37 0 06 Oct 2023
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time Yeqi Gao Zhao Song Weixin Wang Junze Yin 114 29 0 14 Sep 2023
Online Adaptive Mahalanobis Distance Estimation Lianke Qin Aravind Reddy Zhao Song 72 1 0 02 Sep 2023
Solving Attention Kernel Regression Problem via Pre-conditioner Zhao Song Junze Yin Licheng Zhang 86 15 0 28 Aug 2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models Yeqi Gao Zhao Song Junze Yin 89 18 0 21 Aug 2023
Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification Lianke Qin Zhao Song Yuanyuan Yang 59 9 0 13 Jul 2023
Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation Zhao Song Mingquan Ye Junze Yin Licheng Zhang 59 7 0 07 Jun 2023
Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis Xiangyi Chen Zhao Song Baochen Sun Junze Yin Danyang Zhuo 88 3 0 06 Jun 2023
Efficient Asynchronize Stochastic Gradient Algorithm with Structured Data Zhao Song Mingquan Ye 69 4 0 13 May 2023
Solving Tensor Low Cycle Rank Approximation Yichuan Deng Yeqi Gao Zhao Song 80 6 0 13 Apr 2023
Low Rank Matrix Completion via Robust Alternating Minimization in Nearly Linear Time Yuzhou Gu Zhao Song Junze Yin Licheng Zhang 83 28 0 21 Feb 2023
$A Nearly-Optimal Bound for Fast Regression with $\ell_\infty$ Guarantee$ A Nearly-Optimal Bound for Fast Regression with $\ell_\infty$ Guarantee Zhao Song Mingquan Ye Junze Yin Licheng Zhang 116 14 0 01 Feb 2023
Dynamic Tensor Product Regression Aravind Reddy Zhao Song Licheng Zhang 97 22 0 08 Oct 2022
Subquadratic Kronecker Regression with Applications to Tensor Decomposition Matthew Fahrbach Thomas Fu Mehrdad Ghadiri 98 15 0 11 Sep 2022
Near-Linear Time and Fixed-Parameter Tractable Algorithms for Tensor Decompositions Arvind V. Mahankali David P. Woodruff Ziyun Zhang 73 5 0 15 Jul 2022
Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time Zhao Song Licheng Zhang Ruizhe Zhang 116 66 0 14 Dec 2021
Fast Graph Neural Tangent Kernel via Kronecker Sketching Shunhua Jiang Yunze Man Zhao Song Zheng Yu Danyang Zhuo 93 6 0 04 Dec 2021
More Efficient Sampling for Tensor Decomposition With Worst-Case Guarantees Osman Asif Malik 70 15 0 14 Oct 2021
Fast Sketching of Polynomial Kernels of Polynomial Degree Zhao Song David P. Woodruff Zheng Yu Lichen Zhang 82 41 0 21 Aug 2021
Fast Low-Rank Tensor Decomposition by Ridge Leverage Score Sampling Matthew Fahrbach Mehrdad Ghadiri Thomas Fu 35 5 0 22 Jul 2021
Efficient Tensor Contraction via Fast Count Sketch Xingyu Cao Jiani Liu 52 0 0 24 Jun 2021
Training (Overparametrized) Neural Networks in Near-Linear Time Jan van den Brand Binghui Peng Zhao Song Omri Weinstein ODL 91 83 0 20 Jun 2020
Sketching Transformed Matrices with Applications to Natural Language Processing Yingyu Liang Zhao Song Mengdi Wang Lin F. Yang Xin Yang 134 4 0 23 Feb 2020
Sublinear Time Numerical Linear Algebra for Structured Matrices Xiaofei Shi David P. Woodruff 62 17 0 12 Dec 2019
Total Least Squares Regression in Input Sparsity Time H. Diao Zhao Song David P. Woodruff Xin Yang 35 8 0 27 Sep 2019