Unitary Evolution Recurrent Neural Networks

20 November 2015

Papers citing "Unitary Evolution Recurrent Neural Networks"

50 / 141 papers shown

Title
HadamRNN: Binary and Sparse Ternary Orthogonal RNNs Armand Foucault Franck Mamalet François Malgouyres MQ 85 0 0 28 Jan 2025
Oscillatory State-Space Models T. Konstantin Rusch Daniela Rus AI4TS 186 6 0 04 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 49 3 0 02 Oct 2024
Cauchy activation function and XNet Xin Li Zhihong Xia Hongkun Zhang 50 4 0 28 Sep 2024
Unconditional stability of a recurrent neural circuit implementing divisive normalization Shivang Rawat David J. Heeger Stefano Martiniani 29 0 0 27 Sep 2024
Flash STU: Fast Spectral Transform Units Y. Isabel Liu Windsor Nguyen Yagiz Devre Evan Dogariu Anirudha Majumdar Elad Hazan AI4TS 72 1 0 16 Sep 2024
Oja's plasticity rule overcomes several challenges of training neural networks under biological constraints Navid Shervani-Tabar Marzieh Alireza Mirhoseini Robert Rosenbaum AAML AI4CE 47 0 0 15 Aug 2024
Recurrent Complex-Weighted Autoencoders for Unsupervised Object Discovery Anand Gopalakrishnan Aleksandar Stanić Jürgen Schmidhuber M. C. Mozer 53 5 0 27 May 2024
Neural Controlled Differential Equations with Quantum Hidden Evolutions Lingyi Yang Zhen Shao 31 0 0 30 Apr 2024
Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges Badri N. Patro Vijay Srinivas Agneeswaran Mamba 48 38 0 24 Apr 2024
Graph Unitary Message Passing Haiquan Qiu Yatao Bian Quanming Yao 42 2 0 17 Mar 2024
Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabulary Takashi Morita 24 3 0 31 Jan 2024
CoNO: Complex Neural Operator for Continuous Dynamical Systems Karn Tiwari N. M. A. Krishnan P. PrathoshA 30 1 0 03 Oct 2023
Get the Best of Both Worlds: Improving Accuracy and Transferability by Grassmann Class Representation Haoqi Wang Zhizhong Li Wayne Zhang 30 3 0 03 Aug 2023
Fading memory as inductive bias in residual recurrent networks I. Dubinin Felix Effenberger 43 4 0 27 Jul 2023
Long Short-term Memory with Two-Compartment Spiking Neuron Shimin Zhang Qu Yang Chenxiang Ma Jibin Wu Haizhou Li Kay Chen Tan 35 7 0 14 Jul 2023
Non-contact Sensing for Anomaly Detection in Wind Turbine Blades: A focus-SVDD with Complex-Valued Auto-Encoder Approach Gaëtan Frusque D. Mitchell J. Blanche David Flynn Olga Fink 26 8 0 19 Jun 2023
Robust low-rank training via approximate orthonormal constraints Dayana Savostianova Emanuele Zangrando Gianluca Ceruti Francesco Tudisco 32 9 0 02 Jun 2023
Adaptive-saturated RNN: Remember more with less instability Khoi Minh Nguyen-Duy Quang Pham B. T. Nguyen ODL 25 1 0 24 Apr 2023
Orthogonal Directions Constrained Gradient Method: from non-linear equality constraints to Stiefel manifold S. Schechtman D. Tiapkin Michael Muehlebach Eric Moulines 29 7 0 16 Mar 2023
Anamnesic Neural Differential Equations with Orthogonal Polynomial Projections E. Brouwer Rahul G. Krishnan AI4TS 22 0 0 03 Mar 2023
Complex Clipping for Improved Generalization in Machine Learning L. Atlas Nicholas Rasmussen Felix Schwock Mert Pilanci 25 0 0 27 Feb 2023
Adapting Pre-trained Language Models for Quantum Natural Language Processing Qiuchi Li Benyou Wang Yudong Zhu Christina Lioma Qun Liu AI4CE 37 4 0 24 Feb 2023
Stabilising and accelerating light gated recurrent units for automatic speech recognition Adel Moumen Titouan Parcollet 28 3 0 16 Feb 2023
A Survey of Geometric Optimization for Deep Learning: From Euclidean Space to Riemannian Manifold Yanhong Fei Xian Wei Yingjie Liu Zhengyu Li Mingsong Chen 30 6 0 16 Feb 2023
Convolutional unitary or orthogonal recurrent neural networks M. Magnasco 22 2 0 14 Feb 2023
Deep Axial Hypercomplex Networks Nazmul Shahadat Anthony Maida 20 1 0 11 Jan 2023
State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictions Cheng Wang Carolin (Haas) Lawrence Mathias Niepert 21 3 0 10 Dec 2022
Gated Recurrent Neural Networks with Weighted Time-Delay Feedback N. Benjamin Erichson S. H. Lim Michael W. Mahoney 34 6 0 01 Dec 2022
Towards Energy-Efficient, Low-Latency and Accurate Spiking LSTMs Gourav Datta Haoqing Deng R. Aviles P. Beerel 93 10 0 23 Oct 2022
Flipped Classroom: Effective Teaching for Time Series Forecasting P. Teutsch Patrick Mäder AI4TS 29 8 0 17 Oct 2022
Homotopy-based training of NeuralODEs for accurate dynamics discovery Joon-Hyuk Ko Hankyul Koh Nojun Park W. Jhe 51 9 0 04 Oct 2022
Random orthogonal additive filters: a solution to the vanishing/exploding gradient of deep neural networks Andrea Ceni ODL 31 3 0 03 Oct 2022
Efficient LSTM Training with Eligibility Traces Mitchell L. Hoyer Shahram Eivazi S. Otte 9 1 0 30 Sep 2022
In Search of Projectively Equivariant Networks Georg Bökman Axel Flinth Fredrik Kahl 54 0 0 29 Sep 2022
How important are activation functions in regression and classification? A survey, performance comparison, and future directions Ameya Dilip Jagtap George Karniadakis AI4CE 37 71 0 06 Sep 2022
Assessing the Unitary RNN as an End-to-End Compositional Model of Syntax Jean-Philippe Bernardy Shalom Lappin 62 1 0 11 Aug 2022
Rapid training of quantum recurrent neural networks M. Siemaszko A. Buraczewski Bertrand Le Saux Magdalena Stobiñska 27 9 0 01 Jul 2022
Entangled Residual Mappings Mathias Lechner Ramin Hasani Z. Babaiee Radu Grosu Daniela Rus T. Henzinger Sepp Hochreiter 14 5 0 02 Jun 2022
Machine Learning for Microcontroller-Class Hardware: A Review Swapnil Sayan Saha S. Sandha Mani B. Srivastava 34 118 0 29 May 2022
Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs Fanchen Bu D. Chang 30 6 0 12 May 2022
Path Development Network with Finite-dimensional Lie Group Representation Han Lou Siran Li Hao Ni 20 7 0 02 Apr 2022
Classification of NEQR Processed Classical Images using Quantum Neural Networks (QNN) Santanu Ganguly 29 1 0 29 Mar 2022
The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy Tianlong Chen Zhenyu Zhang Yu Cheng Ahmed Hassan Awadallah Zhangyang Wang ViT 41 37 0 12 Mar 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 54 32 0 10 Mar 2022
A photonic chip-based machine learning approach for the prediction of molecular properties Hui Zhang Jonathan Wei Zhong Lau Lingxiao Wan Liang Shi H. Cai Xianshu Luo Guo-qiang Lo Chee-Kong Lee L. Kwek Ajian Liu 35 10 0 03 Mar 2022
Optimal quantum dataset for learning a unitary transformation Zhan Yu Xuanqiang Zhao Benchi Zhao Xin Wang 26 8 0 01 Mar 2022
Activation Functions: Dive into an optimal activation function V. Bansal FAtt 29 2 0 24 Feb 2022
O-ViT: Orthogonal Vision Transformer Yanhong Fei Yingjie Liu Xian Wei Mingsong Chen ViT 13 8 0 28 Jan 2022
Recency Dropout for Recurrent Recommender Systems Bo-Yu Chang Can Xu Matt Le Jingchen Feng Ya Le Sriraj Badam Ed H. Chi Minmin Chen 25 3 0 26 Jan 2022