Matching the Statistical Query Lower Bound for k-sparse Parity Problems
with Stochastic Gradient Descent

Matching the Statistical Query Lower Bound for k-sparse Parity Problems with Stochastic Gradient Descent

18 April 2024

Quanquan Gu

ArXiv (abs)PDF HTML

Papers citing "Matching the Statistical Query Lower Bound for k-sparse Parity Problems with Stochastic Gradient Descent"

12 / 12 papers shown

Title
Low-dimensional Functions are Efficiently Learnable under Randomly Biased Distributions Elisabetta Cornacchia Dan Mikulincer Elchanan Mossel 126 1 0 10 Feb 2025
From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency Kaiyue Wen Huaqing Zhang Hongzhou Lin Jingzhao Zhang MoE LRM 157 7 0 07 Oct 2024
Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions Luca Arnaboldi Yatin Dandi Florent Krzakala Luca Pesce Ludovic Stephan 111 18 0 24 May 2024
Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data Zhiwei Xu Yutong Wang Spencer Frei Gal Vardi Wei Hu MLT 80 28 0 04 Oct 2023
Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs Emmanuel Abbe Elisabetta Cornacchia Aryo Lotfi 77 11 0 29 Jun 2023
On the non-universality of deep learning: quantifying the cost of symmetry Emmanuel Abbe Enric Boix-Adserà FedML MLT 68 19 0 05 Aug 2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit Boaz Barak Benjamin L. Edelman Surbhi Goel Sham Kakade Eran Malach Cyril Zhang 108 133 0 18 Jul 2022
Random Feature Amplification: Feature Learning and Generalization in Neural Networks Spencer Frei Niladri S. Chatterji Peter L. Bartlett MLT 92 30 0 15 Feb 2022
Learning Parities with Neural Networks Amit Daniely Eran Malach 80 78 0 18 Feb 2020
Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss Lénaïc Chizat Francis R. Bach MLT 151 341 0 11 Feb 2020
Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel Colin Wei Jason D. Lee Qiang Liu Tengyu Ma 248 245 0 12 Oct 2018
A Mean Field View of the Landscape of Two-Layers Neural Networks Song Mei Andrea Montanari Phan-Minh Nguyen MLT 105 862 0 18 Apr 2018