Stable Architectures for Deep Neural Networks

9 May 2017

Papers citing "Stable Architectures for Deep Neural Networks"

50 / 143 papers shown

Title
IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method Mihyeon Kim Juhyoung Park Youngbin Kim 34 0 0 11 May 2025
OT-Transformer: A Continuous-time Transformer Architecture with Optimal Transport Regularization Kelvin Kan Xingjian Li Stanley Osher 99 2 0 30 Jan 2025
When are dynamical systems learned from time series data statistically accurate? Jeongjin Park Nicole Yang Nisha Chandramoorthy AI4TS 38 4 0 09 Nov 2024
Tight Stability, Convergence, and Robustness Bounds for Predictive Coding Networks A. Mali Tommaso Salvatori Alexander Ororbia 37 0 0 07 Oct 2024
Stabilized Neural Prediction of Potential Outcomes in Continuous Time Konstantin Hess Stefan Feuerriegel 56 0 0 04 Oct 2024
Demystifying the Token Dynamics of Deep Selective State Space Models Thieu N. Vo Tung D. Pham Xin T. Tong Tan Minh Nguyen Mamba 49 0 0 04 Oct 2024
Unconditional stability of a recurrent neural circuit implementing divisive normalization Shivang Rawat David J. Heeger Stefano Martiniani 29 0 0 27 Sep 2024
Score-based Neural Ordinary Differential Equations for Computing Mean Field Control Problems Mo Zhou Stanley Osher Wuchen Li 87 3 0 24 Sep 2024
Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation Madison Cooley Shandian Zhe Robert M. Kirby Varun Shankar 67 1 0 04 Jun 2024
Liquid-Graph Time-Constant Network for Multi-Agent Systems Control Antonio Marino C. Pacchierotti P. Giordano 40 1 0 22 Apr 2024
Convergence analysis of controlled particle systems arising in deep learning: from finite to infinite sample size Huafu Liao Alpár R. Mészáros Chenchen Mou Chao Zhou 26 2 0 08 Apr 2024
Double-well Net for Image Segmentation Haotian Liu Jun Liu Raymond H. F. Chan Xue-Cheng Tai 55 7 0 31 Dec 2023
Graph Neural Ordinary Differential Equations-based method for Collaborative Filtering Ke Xu Yuanjie Zhu Weizhi Zhang Philip S. Yu BDL GNN 29 4 0 21 Nov 2023
On existence, uniqueness and scalability of adversarial robustness measures for AI classifiers I. Horenko AAML 16 2 0 19 Oct 2023
Adversarial Robustness in Graph Neural Networks: A Hamiltonian Approach Kai Zhao Qiyu Kang Yang Song Rui She Sijie Wang Wee Peng Tay AAML 40 23 0 10 Oct 2023
PottsMGNet: A Mathematical Explanation of Encoder-Decoder Based Neural Networks X. Tai Hao Liu Raymond H. F. Chan 41 10 0 18 Jul 2023
Learning Latent Dynamics via Invariant Decomposition and (Spatio-)Temporal Transformers Kai Lagemann C. Lagemann Swarnava Mukherjee 44 2 0 21 Jun 2023
Intelligent gradient amplification for deep neural networks S. Basodi K. Pusuluri Xueli Xiao Yi Pan ODL 21 1 0 29 May 2023
Stability of implicit neural networks for long-term forecasting in dynamical systems Léon Migus J. Salomon Patrick Gallinari AI4TS AI4CE 28 1 0 26 May 2023
PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusion Yige Yuan Bingbing Xu Bo Lin Liang Hou Fei Sun Huawei Shen Xueqi Cheng DiffM 26 4 0 25 May 2023
A Fractional Graph Laplacian Approach to Oversmoothing Sohir Maskey Raffaele Paolino Aras Bacho Gitta Kutyniok 39 30 0 22 May 2023
How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defenses Joana Cabral Costa Tiago Roxo Hugo Manuel Proença Pedro R. M. Inácio AAML 52 50 0 18 May 2023
Learning on Manifolds: Universal Approximations Properties using Geometric Controllability Conditions for Neural ODEs Karthik Elamvazhuthi Xuechen Zhang Samet Oymak Fabio Pasqualetti AI4CE 32 6 0 15 May 2023
The emergence of clusters in self-attention dynamics Borjan Geshkovski Cyril Letrouit Yury Polyanskiy Philippe Rigollet 30 46 0 09 May 2023
Neural Delay Differential Equations: System Reconstruction and Image Classification Qunxi Zhu Yao Guo Wei Lin 25 32 0 11 Apr 2023
Lecture Notes: Neural Network Architectures Evelyn Herberg 3DH 42 2 0 11 Apr 2023
Unconstrained Parametrization of Dissipative and Contracting Neural Ordinary Differential Equations D. Martinelli C. Galimberti I. Manchester Luca Furieri Giancarlo Ferrari-Trecate 25 11 0 06 Apr 2023
Universal Approximation Property of Hamiltonian Deep Neural Networks M. Zakwan M. d’Angelo Giancarlo Ferrari-Trecate 36 5 0 21 Mar 2023
Learning Hamiltonian Systems with Mono-Implicit Runge-Kutta Methods Haakon Noren 27 3 0 07 Mar 2023
Node Embedding from Hamiltonian Information Propagation in Graph Neural Networks Qiyu Kang Kai Zhao Yang Song Sijie Wang Rui She Wee Peng Tay 38 0 0 02 Mar 2023
CQnet: convex-geometric interpretation and constraining neural-network trajectories Bas Peters 35 0 0 09 Feb 2023
Learning PDE Solution Operator for Continuous Modeling of Time-Series Yesom Park Jaemoo Choi Changyeon Yoon Changhoon Song Myung-joo Kang AI4TS AI4CE 27 3 0 02 Feb 2023
Exploring the Approximation Capabilities of Multiplicative Neural Networks for Smooth Functions Ido Ben-Shaul Tomer Galanti S. Dekel 31 3 0 11 Jan 2023
Differentiable modeling to unify machine learning and physical models and advance Geosciences Chaopeng Shen A. Appling Pierre Gentine Toshiyuki Bandai H. Gupta ... Chris Rackauckas Tirthankar Roy Chonggang Xu Binayak Mohanty K. Lawson AI4CE 42 14 0 10 Jan 2023
Continuous Depth Recurrent Neural Differential Equations Srinivas Anumasa Geetakrishnasai Gunapati P. K. Srijith AI4TS 26 0 0 28 Dec 2022
The Underlying Correlated Dynamics in Neural Training Rotem Turjeman Tom Berkov I. Cohen Guy Gilboa 27 3 0 18 Dec 2022
Convergence Analysis for Training Stochastic Neural Networks via Stochastic Gradient Descent Richard Archibald F. Bao Yanzhao Cao Hui‐Jie Sun 52 2 0 17 Dec 2022
Asymptotic Analysis of Deep Residual Networks R. Cont Alain Rossier Renyuan Xu 27 4 0 15 Dec 2022
Numerical Stability of DeepGOPlus Inference Inés Gonzalez Pepe Yohan Chatelain Gregory Kiar Tristan Glatard BDL 24 2 0 13 Dec 2022
A Neural ODE Interpretation of Transformer Layers Yaofeng Desmond Zhong Tongtao Zhang Amit Chakraborty Biswadip Dey 41 9 0 12 Dec 2022
Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problems Derick Nganyu Tanyu Jianfeng Ning Tom Freudenberg Nick Heilenkötter A. Rademacher U. Iben Peter Maass AI4CE 23 34 0 06 Dec 2022
Nonlinear controllability and function representation by neural stochastic differential equations Tanya Veeravalli Maxim Raginsky DiffM 27 2 0 01 Dec 2022
Neural DAEs: Constrained neural networks Tue Boesen E. Haber Uri M. Ascher 39 3 0 25 Nov 2022
Experimental study of Neural ODE training with adaptive solver for dynamical systems modeling A. Allauzen Thiago Petrilli Maffei Dardis Hannah Plath AI4CE 24 0 0 13 Nov 2022
Differentiable Analog Quantum Computing for Optimization and Control Jiaqi Leng Yuxiang Peng Yi-Ling Qiao Ming-Chyuan Lin Xiaodi Wu 22 15 0 28 Oct 2022
Neural ODEs as Feedback Policies for Nonlinear Optimal Control I. O. Sandoval Panagiotis Petsagkourakis Ehecatl Antonio del Rio Chanona 25 9 0 20 Oct 2022
On the Forward Invariance of Neural ODEs Wei Xiao Tsun-Hsuan Wang Ramin Hasani Mathias Lechner Yutong Ban Chuang Gan Daniela Rus 42 11 0 10 Oct 2022
Parameter-varying neural ordinary differential equations with partition-of-unity networks Kookjin Lee N. Trask 27 2 0 01 Oct 2022
Estimating a potential without the agony of the partition function E. Haber Moshe Eliasof L. Tenorio 33 2 0 19 Aug 2022
Deep Neural Network Approximation of Invariant Functions through Dynamical Systems Qianxiao Li T. Lin Zuowei Shen 24 6 0 18 Aug 2022