Variation Spaces for Multi-Output Neural Networks: Insights on
Multi-Task Learning and Network Compression

Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression

25 May 2023

Joseph Shenouda

Robert D. Nowak

Papers citing "Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression"

15 / 15 papers shown

Title
The Effects of Multi-Task Learning on ReLU Neural Network Functions Julia B. Nakhleh Joseph Shenouda Robert D. Nowak 39 1 0 29 Oct 2024
ReLUs Are Sufficient for Learning Implicit Neural Representations Joseph Shenouda Yamin Zhou Robert D. Nowak 30 5 0 04 Jun 2024
Random ReLU Neural Networks as Non-Gaussian Processes Rahul Parhi Pakshal Bohra Ayoub El Biari Mehrsa Pourya Michael Unser 63 1 0 16 May 2024
Neural reproducing kernel Banach spaces and representer theorems for deep networks Francesca Bartolucci E. De Vito Lorenzo Rosasco Stefano Vigogna 49 4 0 13 Mar 2024
Hypothesis Spaces for Deep Learning Rui Wang Yuesheng Xu Mingsong Yan 30 1 0 05 Mar 2024
Depth Separation in Norm-Bounded Infinite-Width Neural Networks Suzanna Parkinson Greg Ongie Rebecca Willett Ohad Shamir Nathan Srebro MDE 50 2 0 13 Feb 2024
How do Minimum-Norm Shallow Denoisers Look in Function Space? Chen Zeno Greg Ongie Yaniv Blumenfeld Nir Weinberger Daniel Soudry 28 8 0 12 Nov 2023
Function-Space Optimality of Neural Architectures with Multivariate Nonlinearities Rahul Parhi Michael Unser 44 5 0 05 Oct 2023
Deep Learning Meets Sparse Regularization: A Signal Processing Perspective Rahul Parhi Robert D. Nowak 40 25 0 23 Jan 2023
PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks Liu Yang Jifan Zhang Joseph Shenouda Dimitris Papailiopoulos Kangwook Lee Robert D. Nowak 50 1 0 06 Oct 2022
Neural Networks Efficiently Learn Low-Dimensional Representations with SGD Alireza Mousavi-Hosseini Sejun Park M. Girotti Ioannis Mitliagkas Murat A. Erdogdu MLT 324 48 0 29 Sep 2022
Fast Convex Optimization for Two-Layer ReLU Networks: Equivalent Model Classes and Cone Decompositions Aaron Mishkin Arda Sahiner Mert Pilanci OffRL 77 30 0 02 Feb 2022
Understanding neural networks with reproducing kernel Banach spaces Francesca Bartolucci E. De Vito Lorenzo Rosasco Stefano Vigogna 47 50 0 20 Sep 2021
Near-Minimax Optimal Estimation With Shallow ReLU Neural Networks Rahul Parhi Robert D. Nowak 56 38 0 18 Sep 2021
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics D. Kunin Javier Sagastuy-Breña Surya Ganguli Daniel L. K. Yamins Hidenori Tanaka 107 77 0 08 Dec 2020