On the Expressive Power of Deep Learning: A Tensor Analysis

16 September 2015

Papers citing "On the Expressive Power of Deep Learning: A Tensor Analysis"

50 / 246 papers shown

Title
Divergence of Empirical Neural Tangent Kernel in Classification Problems Zixiong Yu Songtao Tian Guhan Chen 28 0 0 15 Apr 2025
ReLU Networks as Random Functions: Their Distribution in Probability Space Shreyas Chaudhari J. M. F. Moura 36 0 0 28 Mar 2025
Reduced Order Models and Conditional Expectation -- Analysing Parametric Low-Order Approximations Hermann G. Matthies 42 0 0 17 Feb 2025
The impact of allocation strategies in subset learning on the expressive power of neural networks Ofir Schlisselberg Ran Darshan 93 0 0 10 Feb 2025
How Analysis Can Teach Us the Optimal Way to Design Neural Operators Vu-Anh Le Mehmet Dik 42 0 0 04 Nov 2024
TEAFormers: TEnsor-Augmented Transformers for Multi-Dimensional Time Series Forecasting Linghang Kong Elynn Chen Yuzhou Chen Yuefeng Han AI4TS 59 0 0 27 Oct 2024
Conditional Uncertainty Quantification for Tensorized Topological Neural Networks Yujia Wu Bo Yang Yang Zhao Elynn Chen Yuzhou Chen Zheshi Zheng 41 2 0 20 Oct 2024
Tensor-Fused Multi-View Graph Contrastive Learning Yujia Wu Junyi Mo Elynn Chen Yuzhou Chen 29 1 0 20 Oct 2024
On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory Guhan Chen Yicheng Li Qian Lin AAML 38 1 0 08 Oct 2024
What is the Relationship between Tensor Factorizations and Circuits (and How Can We Exploit it)? Lorenzo Loconte Antonio Mari G. Gala Robert Peharz Cassio de Campos Erik Quaeghebeur G. Vessio Antonio Vergari 53 8 0 12 Sep 2024
Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning Nadav Cohen Noam Razin 47 0 0 25 Aug 2024
A Tensor Decomposition Perspective on Second-order RNNs M. Lizaire Michael Rizvi-Martel Marawan Gamal Abdel Hameed Guillaume Rabusseau 52 0 0 07 Jun 2024
Unified Universality Theorem for Deep and Shallow Joint-Group-Equivariant Machines Sho Sonoda Yuka Hashimoto Isao Ishikawa Masahiro Ikeda 39 0 0 22 May 2024
Language Modeling Using Tensor Trains Zhan Su Yuqin Zhou Fengran Mo J. Simonsen 51 2 0 07 May 2024
Tensor Network-Constrained Kernel Machines as Gaussian Processes Frederiek Wesel Kim Batselier 22 0 0 28 Mar 2024
Simulating Weighted Automata over Sequences and Trees with Transformers Michael Rizvi M. Lizaire Clara Lacroce Guillaume Rabusseau AI4CE 53 0 0 12 Mar 2024
Tensor-view Topological Graph Neural Network Tao Wen Elynn Chen Yuzhou Chen 39 9 0 22 Jan 2024
Generative Learning of Continuous Data by Tensor Networks Alex Meiburg Jing Chen Jacob Miller Raphaëlle Tihon Guillaume Rabusseau A. Perdomo-Ortiz 26 5 0 31 Oct 2023
Exponential Quantum Communication Advantage in Distributed Inference and Learning H. Michaeli D. Gilboa Daniel Soudry Jarrod R. McClean FedML 19 0 0 11 Oct 2023
Deep Ridgelet Transform: Voice with Koopman Operator Proves Universality of Formal Deep Networks Sho Sonoda Yuka Hashimoto Isao Ishikawa Masahiro Ikeda 27 3 0 05 Oct 2023
Multi-Dimensional Hyena for Spatial Inductive Bias Itamar Zimerman Lior Wolf ViT 30 4 0 24 Sep 2023
Multi-Scale and Multi-Layer Contrastive Learning for Domain Generalization Aristotelis Ballas Christos Diou OOD 26 6 0 28 Aug 2023
Polynomial Width is Sufficient for Set Representation with High-dimensional Features Peihao Wang Shenghao Yang Shu Li Zhangyang Wang Pan Li 27 3 0 08 Jul 2023
2-D SSM: A General Spatial Layer for Visual Transformers Ethan Baron Itamar Zimerman Lior Wolf 32 14 0 11 Jun 2023
Hidden Classification Layers: Enhancing linear separability between classes in neural networks layers Andrea Apicella Francesco Isgrò R. Prevete 26 0 0 09 Jun 2023
Tensorized Hypergraph Neural Networks Maolin Wang Yao Zhen Y. Pan Yao Zhao Chenyi Zhuang Zenglin Xu Ruocheng Guo Xiangyu Zhao 25 2 0 05 Jun 2023
Machine learning with tree tensor networks, CP rank constraints, and tensor dropout Hao Chen T. Barthel 48 7 0 30 May 2023
Deep ReLU Networks Have Surprisingly Simple Polytopes Fenglei Fan Wei Huang Xiang-yu Zhong Lecheng Ruan T. Zeng Huan Xiong Fei Wang 67 5 0 16 May 2023
Graph Tensor Networks: An Intuitive Framework for Designing Large-Scale Neural Learning Systems on Multiple Domains Y. Xu Kriton Konstantinidis Danilo Mandic GNN 8 9 0 23 Mar 2023
What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum Entanglement Yotam Alexander Nimrod De La Vega Noam Razin Nadav Cohen 26 4 0 20 Mar 2023
Expressivity of Shallow and Deep Neural Networks for Polynomial Approximation Itai Shapira 9 0 0 06 Mar 2023
Towards NeuroAI: Introducing Neuronal Diversity into Artificial Neural Networks Fenglei Fan Yingxin Li Hanchuan Peng T. Zeng Fei Wang 25 5 0 23 Jan 2023
Tensor Networks Meet Neural Networks: A Survey and Future Perspectives Maolin Wang Y. Pan Zenglin Xu Xiangli Yang Guangxi Li A. Cichocki Andrzej Cichocki 55 19 0 22 Jan 2023
On the Ability of Graph Neural Networks to Model Interactions Between Vertices Noam Razin Tom Verbin Nadav Cohen 23 10 0 29 Nov 2022
Minimal Width for Universal Property of Deep RNN Changhoon Song Geonho Hwang Jun ho Lee Myung-joo Kang 25 9 0 25 Nov 2022
Grokking phase transitions in learning local rules with gradient descent Bojan Žunkovič E. Ilievski 63 16 0 26 Oct 2022
Deep tensor networks with matrix product operators Bojan Žunkovič 72 4 0 16 Sep 2022
A variational neural network approach for glacier modelling with nonlinear rheology Tiangang Cui Zhongjian Wang Zhiwen Zhang 32 4 0 05 Sep 2022
Nimble GNN Embedding with Tensor-Train Decomposition Chunxing Yin Da Zheng Israt Nisa Christos Faloutsos George Karypis R. Vuduc GNN 12 15 0 21 Jun 2022
Permutation Search of Tensor Network Structures via Local Sampling Chong Li Junhua Zeng Zerui Tao Qianchuan Zhao 24 19 0 14 Jun 2022
High-Order Pooling for Graph Neural Networks with Tensor Decomposition Chenqing Hua Guillaume Rabusseau Jian Tang 78 25 0 24 May 2022
CNNs Avoid Curse of Dimensionality by Learning on Patches Vamshi C. Madala S. Chandrasekaran Jason Bunk UQCV 33 5 0 22 May 2022
ExSpliNet: An interpretable and expressive spline-based neural network Daniele Fakhoury Emanuele Fakhoury H. Speleers 11 34 0 03 May 2022
Physical Deep Learning with Biologically Plausible Training Method M. Nakajima Katsuma Inoue Kenji Tanaka Yasuo Kuniyoshi Toshikazu Hashimoto Kohei Nakajima AI4CE 34 3 0 01 Apr 2022
On the Spectral Bias of Convolutional Neural Tangent and Gaussian Process Kernels Amnon Geifman Meirav Galun David Jacobs Ronen Basri 30 13 0 17 Mar 2022
TTML: tensor trains for general supervised machine learning Bart Vandereycken Rik Voorhaar 14 2 0 08 Mar 2022
Are All Linear Regions Created Equal? Matteo Gamba Adrian Chmielewski-Anders Josephine Sullivan Hossein Azizpour Marten Bjorkman MLT 4 15 0 23 Feb 2022
Random Feature Amplification: Feature Learning and Generalization in Neural Networks Spencer Frei Niladri S. Chatterji Peter L. Bartlett MLT 30 29 0 15 Feb 2022
Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks Noam Razin Asaf Maman Nadav Cohen 46 29 0 27 Jan 2022
Learning Robust and Lightweight Model through Separable Structured Transformations Xian Wei Yanhui Huang Yang Xu Mingsong Chen Hai Lan Yuanxiang Li Zhongfeng Wang Xuan Tang OOD 24 0 0 27 Dec 2021