Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
All Papers
0 / 0 papers shown
Title
Home
Papers
1909.13384
Cited By
Optimal Sketching for Kronecker Product Regression and Low Rank Approximation
Neural Information Processing Systems (NeurIPS), 2019
29 September 2019
H. Diao
Rajesh Jayaram
Zhao Song
Wen Sun
David P. Woodruff
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Optimal Sketching for Kronecker Product Regression and Low Rank Approximation"
31 / 31 papers shown
Title
Towards Sampling Data Structures for Tensor Products in Turnstile Streams
Zhao Song
Shenghao Xie
Samson Zhou
104
0
0
04 Oct 2025
SLICK: Selective Localization and Instance Calibration for Knowledge-Enhanced Car Damage Segmentation in Automotive Insurance
Teerapong Panboonyuen
272
34
0
12 Jun 2025
Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapse
Josh Alman
Zhao Song
299
9
0
22 May 2025
Quantum Speedup for Spectral Approximation of Kronecker Products
Yeqi Gao
Zhao Song
Ruizhe Zhang
156
3
0
10 Feb 2024
The Fine-Grained Complexity of Gradient Computation for Training Large Language Models
Josh Alman
Zhao Song
157
22
0
07 Feb 2024
Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training
Lianke Qin
Saayan Mitra
Zhao Song
Yuanyuan Yang
Wanrong Zhu
198
0
0
19 Nov 2023
How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation
International Conference on Learning Representations (ICLR), 2023
Josh Alman
Zhao Song
307
44
0
06 Oct 2023
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time
Yeqi Gao
Zhao Song
Weixin Wang
Junze Yin
238
30
0
14 Sep 2023
Online Adaptive Mahalanobis Distance Estimation
BigData Congress [Services Society] (BSS), 2023
Lianke Qin
Aravind Reddy
Zhao Song
250
1
0
02 Sep 2023
Solving Attention Kernel Regression Problem via Pre-conditioner
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Zhao Song
Junze Yin
Licheng Zhang
212
18
0
28 Aug 2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models
Yeqi Gao
Zhao Song
Junze Yin
149
22
0
21 Aug 2023
Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification
BigData Congress [Services Society] (BSS), 2023
Lianke Qin
Zhao Song
Yuanyuan Yang
174
9
0
13 Jul 2023
Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation
International Conference on Learning Representations (ICLR), 2023
Zhao Song
Mingquan Ye
Junze Yin
Licheng Zhang
212
9
0
07 Jun 2023
Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis
Xiangyi Chen
Zhao Song
Baochen Sun
Junze Yin
Danyang Zhuo
182
4
0
06 Jun 2023
Efficient Asynchronize Stochastic Gradient Algorithm with Structured Data
Zhao Song
Mingquan Ye
175
4
0
13 May 2023
Solving Tensor Low Cycle Rank Approximation
BigData Congress [Services Society] (BSS), 2023
Yichuan Deng
Yeqi Gao
Zhao Song
159
7
0
13 Apr 2023
Low Rank Matrix Completion via Robust Alternating Minimization in Nearly Linear Time
International Conference on Learning Representations (ICLR), 2023
Yuzhou Gu
Zhao Song
Junze Yin
Licheng Zhang
258
32
0
21 Feb 2023
A Nearly-Optimal Bound for Fast Regression with
ℓ
∞
\ell_\infty
ℓ
∞
Guarantee
International Conference on Machine Learning (ICML), 2023
Zhao Song
Mingquan Ye
Junze Yin
Licheng Zhang
235
15
0
01 Feb 2023
Dynamic Tensor Product Regression
Neural Information Processing Systems (NeurIPS), 2022
Aravind Reddy
Zhao Song
Licheng Zhang
212
23
0
08 Oct 2022
Subquadratic Kronecker Regression with Applications to Tensor Decomposition
Neural Information Processing Systems (NeurIPS), 2022
Matthew Fahrbach
Thomas Fu
Mehrdad Ghadiri
254
18
0
11 Sep 2022
Near-Linear Time and Fixed-Parameter Tractable Algorithms for Tensor Decompositions
Information Technology Convergence and Services (ITCS), 2022
Arvind V. Mahankali
David P. Woodruff
Ziyun Zhang
130
6
0
15 Jul 2022
Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time
Zhao Song
Licheng Zhang
Ruizhe Zhang
312
67
0
14 Dec 2021
Fast Graph Neural Tangent Kernel via Kronecker Sketching
AAAI Conference on Artificial Intelligence (AAAI), 2021
Shunhua Jiang
Yunze Man
Zhao Song
Zheng Yu
Danyang Zhuo
207
9
0
04 Dec 2021
More Efficient Sampling for Tensor Decomposition With Worst-Case Guarantees
Osman Asif Malik
201
17
0
14 Oct 2021
Fast Sketching of Polynomial Kernels of Polynomial Degree
Zhao Song
David P. Woodruff
Zheng Yu
Lichen Zhang
186
47
0
21 Aug 2021
Fast Low-Rank Tensor Decomposition by Ridge Leverage Score Sampling
Matthew Fahrbach
Mehrdad Ghadiri
Thomas Fu
117
6
0
22 Jul 2021
Efficient Tensor Contraction via Fast Count Sketch
Xingyu Cao
Jiani Liu
118
0
0
24 Jun 2021
Training (Overparametrized) Neural Networks in Near-Linear Time
Jan van den Brand
Binghui Peng
Zhao Song
Omri Weinstein
ODL
187
83
0
20 Jun 2020
Sketching Transformed Matrices with Applications to Natural Language Processing
International Conference on Artificial Intelligence and Statistics (AISTATS), 2020
Yingyu Liang
Zhao Song
Mengdi Wang
Lin F. Yang
Xin Yang
200
4
0
23 Feb 2020
Sublinear Time Numerical Linear Algebra for Structured Matrices
AAAI Conference on Artificial Intelligence (AAAI), 2019
Xiaofei Shi
David P. Woodruff
81
17
0
12 Dec 2019
Total Least Squares Regression in Input Sparsity Time
Neural Information Processing Systems (NeurIPS), 2019
H. Diao
Zhao Song
David P. Woodruff
Xin Yang
101
8
0
27 Sep 2019
1
