Attention as an RNN

Attention as an RNN

22 May 2024

Hossein Hajimirsadeghi

Mohamed Osama Ahmed

Papers citing "Attention as an RNN"

5 / 5 papers shown

Title
Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao-quan Song Yufa Zhou 54 15 0 12 Oct 2024
PRF: Parallel Resonate and Fire Neuron for Long Sequence Learning in Spiking Neural Networks Yulong Huang Zunchang Liu Changchun Feng Xiaopeng Lin Hongwei Ren Haotian Fu Yue Zhou Hong Xing Bojun Cheng 36 1 0 04 Oct 2024
Local Attention Mechanism: Boosting the Transformer Architecture for Long-Sequence Time Series Forecasting Ignacio Aguilera-Martos Andrés Herrera-Poyatos Julián Luengo Francisco Herrera AI4TS 28 0 0 04 Oct 2024
Were RNNs All We Needed? Leo Feng Frederick Tung Mohamed Osama Ahmed Yoshua Bengio Hossein Hajimirsadegh AI4TS 29 14 1 02 Oct 2024
Empowering Time Series Analysis with Large Language Models: A Survey Yushan Jiang Zijie Pan Xikun Zhang Sahil Garg Anderson Schneider Yuriy Nevmyvaka Dongjin Song AI4TS AIFin 97 47 0 05 Feb 2024