Fast Sketching of Polynomial Kernels of Polynomial Degree

21 August 2021

Papers citing "Fast Sketching of Polynomial Kernels of Polynomial Degree"

27 / 27 papers shown

Title
Quantum Speedup for Spectral Approximation of Kronecker Products Yeqi Gao Zhao-quan Song Ruizhe Zhang 29 3 0 10 Feb 2024
Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training Lianke Qin Saayan Mitra Zhao-quan Song Yuanyuan Yang Dinesh Manocha 27 0 0 19 Nov 2023
How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation Josh Alman Zhao-quan Song 32 31 0 06 Oct 2023
PolySketchFormer: Fast Transformers via Sketching Polynomial Kernels Praneeth Kacham Vahab Mirrokni Peilin Zhong 36 7 0 02 Oct 2023
A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time Yeqi Gao Zhao-quan Song Weixin Wang Junze Yin 20 25 0 14 Sep 2023
Online Adaptive Mahalanobis Distance Estimation Lianke Qin Aravind Reddy Zhao-quan Song 41 1 0 02 Sep 2023
Solving Attention Kernel Regression Problem via Pre-conditioner Zhao-quan Song Junze Yin Licheng Zhang 28 9 0 28 Aug 2023
GradientCoin: A Peer-to-Peer Decentralized Large Language Models Yeqi Gao Zhao-quan Song Junze Yin 26 18 0 21 Aug 2023
Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification Lianke Qin Zhao-quan Song Yuanyuan Yang 25 9 0 13 Jul 2023
Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation Zhao-quan Song Mingquan Ye Junze Yin Licheng Zhang 24 7 0 07 Jun 2023
Efficient Asynchronize Stochastic Gradient Algorithm with Structured Data Zhao-quan Song Mingquan Ye 22 4 0 13 May 2023
Solving Tensor Low Cycle Rank Approximation Yichuan Deng Yeqi Gao Zhao-quan Song 34 6 0 13 Apr 2023
A Theoretical Analysis Of Nearest Neighbor Search On Approximate Near Neighbor Graph Anshumali Shrivastava Zhao-quan Song Zhaozhuo Xu GNN 22 8 0 10 Mar 2023
Streaming Kernel PCA Algorithm With Small Space Yichuan Deng Zhao-quan Song Zifan Wang Hangke Zhang 18 2 0 08 Mar 2023
Low Rank Matrix Completion via Robust Alternating Minimization in Nearly Linear Time Yuzhou Gu Zhao-quan Song Junze Yin Licheng Zhang 16 26 0 21 Feb 2023
$A Nearly-Optimal Bound for Fast Regression with $\ell_\infty$ Guarantee$ A Nearly-Optimal Bound for Fast Regression with $\ell_\infty$ Guarantee Zhao-quan Song Mingquan Ye Junze Yin Licheng Zhang 14 10 0 01 Feb 2023
Dynamic Tensor Product Regression Aravind Reddy Zhao-quan Song Licheng Zhang 42 20 0 08 Oct 2022
On The Relative Error of Random Fourier Features for Preserving Kernel Distance Kuan Cheng S. Jiang Luojian Wei Zhide Wei 36 1 0 01 Oct 2022
Sublinear Time Algorithm for Online Weighted Bipartite Matching Han Hu Zhao-quan Song Runzhou Tao Zhaozhuo Xu Junze Yin Danyang Zhuo 26 7 0 05 Aug 2022
Differentially Private Learning with Margin Guarantees Raef Bassily M. Mohri A. Suresh 20 9 0 21 Apr 2022
Leverage Score Sampling for Tensor Product Matrices in Input Sparsity Time David P. Woodruff A. Zandieh 11 9 0 09 Feb 2022
Random Gegenbauer Features for Scalable Kernel Methods Insu Han A. Zandieh H. Avron 19 4 0 07 Feb 2022
Complex-to-Real Sketches for Tensor Products with Applications to the Polynomial Kernel Jonas Wacker Ruben Ohana Maurizio Filippone 13 2 0 04 Feb 2022
Improved Random Features for Dot Product Kernels Jonas Wacker Motonobu Kanagawa Maurizio Filippone 14 8 0 21 Jan 2022
Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time Zhao-quan Song Licheng Zhang Ruizhe Zhang 23 63 0 14 Dec 2021
Fast Graph Neural Tangent Kernel via Kronecker Sketching Shunhua Jiang Yunze Man Zhao-quan Song Zheng Yu Danyang Zhuo 29 6 0 04 Dec 2021
Sharp analysis of low-rank kernel matrix approximations Francis R. Bach 86 277 0 09 Aug 2012