v1v2v3 (latest)

Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting

29 June 2019

Papers citing "Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting"

50 / 503 papers shown

Title
CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling Jinchao Zhang Shuyang Jiang Jiangtao Feng Lin Zheng Dianbo Sui 3DV 197 9 0 14 Oct 2022
ST-former for short-term passenger flow prediction during COVID-19 in urban rail transit system Shuxin Zhang Jinlei Zhang Lixing Yang Chengcheng Wang Ziyou Gao AI4TS 48 0 0 14 Oct 2022
Breaking BERT: Evaluating and Optimizing Sparsified Attention Siddhartha Brahma Polina Zablotskaia David M. Mimno 37 1 0 07 Oct 2022
TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysis Haixu Wu Teng Hu Yong Liu Hang Zhou Jianmin Wang Mingsheng Long AI4TS AIFin 158 847 0 05 Oct 2022
MTSMAE: Masked Autoencoders for Multivariate Time-Series Forecasting Peiwang Tang Xianchao Zhang AI4TS 80 14 0 04 Oct 2022
Grouped self-attention mechanism for a memory-efficient Transformer Bumjun Jung Yusuke Mukuta Tatsuya Harada AI4TS 26 3 0 02 Oct 2022
STGIN: A Spatial Temporal Graph-Informer Network for Long Sequence Traffic Speed Forecasting Ruikang Luo Yaofeng Song Liping Huang Yicheng Zhang Rong Su GNN AI4TS 38 15 0 01 Oct 2022
Masked Multi-Step Multivariate Time Series Forecasting with Future Information Yiwei Fu Honggang Wang Nurali Virani AI4TS 54 2 0 28 Sep 2022
Retrieval Based Time Series Forecasting Baoyu Jing Si Zhang Yada Zhu B. Peng K. Guan A. Margenot Hanghang Tong AI4TS 120 13 0 27 Sep 2022
DeepVol: Volatility Forecasting from High-Frequency Data with Dilated Causal Convolutions Fernando Moreno-Pino S. Zohren 64 13 0 23 Sep 2022
PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecasting Hao Xue Flora D.Salim AI4TS 144 165 0 20 Sep 2022
Out-of-Distribution Representation Learning for Time Series Classification Wang Lu Jindong Wang Xinwei Sun Yiqiang Chen Xingxu Xie OODD OOD 98 38 0 15 Sep 2022
Leveraging Language Foundation Models for Human Mobility Forecasting Hao Xue Bhanu Prakash Voutharoja Flora D. Salim AI4TS 179 75 0 11 Sep 2022
Learning Differential Operators for Interpretable Time Series Modeling Yingtao Luo Chang Xu Yang Liu Weiqing Liu Shun Zheng Jiang Bian AI4TS 98 8 0 03 Sep 2022
Diffusion Models: A Comprehensive Survey of Methods and Applications Ling Yang Zhilong Zhang Yingxia Shao Shenda Hong Runsheng Xu Yue Zhao Wentao Zhang Tengjiao Wang Ming-Hsuan Yang DiffM MedIm 488 1,425 0 02 Sep 2022
Persistence Initialization: A novel adaptation of the Transformer architecture for Time Series Forecasting Espen Haugsdal Erlend Aune M. Ruocco AI4TS AI4CE 32 17 0 30 Aug 2022
Spatio-Temporal Wind Speed Forecasting using Graph Networks and Novel Transformer Architectures Lars Odegaard Bentsen N. Warakagoda R. Stenbro P. Engelstad AI4TS 42 108 0 29 Aug 2022
Adaptive Perception Transformer for Temporal Action Localization Yizheng Ouyang Tianjin Zhang Weibo Gu Hongfa Wang 81 3 0 25 Aug 2022
AA-Forecast: Anomaly-Aware Forecast for Extreme Events Ashkan Farhangi Jiang Bian Arthur Huang Haoyi Xiong Jun Wang Zhi-guo Guo AI4TS 72 4 0 21 Aug 2022
Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models Juan Miguel Lopez Alcaraz Nils Strodthoff DiffM 115 177 0 19 Aug 2022
Simulation-Informed Revenue Extrapolation with Confidence Estimate for Scaleup Companies Using Scarce Time-Series Data Le-le Cao Sonja Horn Vilhelm von Ehrenheim Richard Anselmo Stahl H. Landgren 45 8 0 19 Aug 2022
ODformer: Spatial-Temporal Transformers for Long Sequence Origin-Destination Matrix Forecasting Against Cross Application Scenario Jin Huang Bosong Huang Weihao Yu Jing Xiao Ruzhong Xie Ke Ruan AI4TS 54 26 0 17 Aug 2022
QuickSkill: Novice Skill Estimation in Online Multiplayer Games Chaoyun Zhang Kai Wang Hao Chen Ge Fan Yingjie Li Lifang Wu Bingchao Zheng 67 8 0 15 Aug 2022
Grasping Core Rules of Time Series through Pure Models Gedi Liu Yifeng Jiang Yicun Ouyang Keyang Zhong Yang Wang AI4TS 93 0 0 15 Aug 2022
fMRI-S4: learning short- and long-range dynamic fMRI dependencies using 1D Convolutions and State Space Models A. E. Gazzar R. Thomas G. Wingen 65 3 0 08 Aug 2022
Mining Reaction and Diffusion Dynamics in Social Activities Taichi Murayama Yasuko Matsubara Yasushi Sakurai 50 1 0 07 Aug 2022
Time Series Forecasting Models Copy the Past: How to Mitigate Chrysoula Kosma Giannis Nikolentzos Nancy R. Xu Michalis Vazirgiannis AI4TS 26 5 0 27 Jul 2022
Remote Medication Status Prediction for Individuals with Parkinson's Disease using Time-series Data from Smartphones Weijian Li Wei-wei Zhu R. Dorsey Jiebo Luo 66 0 0 26 Jul 2022
Respecting Time Series Properties Makes Deep Time Series Forecasting Perfect Li Shen Yuning Wei Yangzhu Wang AI4TS 101 8 0 22 Jul 2022
Spatiotemporal Propagation Learning for Network-Wide Flight Delay Prediction Yuankai Wu Hongyu Yang Yi Lin Hong Liu AI4TS 51 17 0 14 Jul 2022
Rethinking Attention Mechanism in Time Series Classification Bowen Zhao Huanlai Xing Xinhan Wang Fuhong Song Zhiwen Xiao AI4TS 56 35 0 14 Jul 2022
DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generation Songhua Liu Jingwen Ye Sucheng Ren Xinchao Wang 93 45 0 13 Jul 2022
Learning Deep Time-index Models for Time Series Forecasting Gerald Woo Chenghao Liu Doyen Sahoo Akshat Kumar Guosheng Lin AI4TS AI4CE 122 29 0 13 Jul 2022
Dateformer: Time-modeling Transformer for Longer-term Series Forecasting Julong Young Junhui Chen Feihu Huang Jian Peng AI4TS 29 1 0 12 Jul 2022
Multi-task Envisioning Transformer-based Autoencoder for Corporate Credit Rating Migration Early Prediction Han Yue Steve Q. Xia Hongfu Liu 35 1 0 10 Jul 2022
Deep Transformer Model with Pre-Layer Normalization for COVID-19 Growth Prediction Rizki Ramadhan Fitra N. Yudistira W. Mahmudy 39 1 0 10 Jul 2022
Don't Pay Attention to the Noise: Learning Self-supervised Representations of Light Curves with a Denoising Time Series Transformer M. Morvan N. Nikolaou K. H. Yip Ingo P. Waldmann AI4TS 128 11 0 06 Jul 2022
Cascaded Deep Hybrid Models for Multistep Household Energy Consumption Forecasting L. Saad Saoud Hasan Almarzouqi Ramy Hussein 21 4 0 06 Jul 2022
Efficient Representation Learning via Adaptive Context Pooling Chen Huang Walter A. Talbott Navdeep Jaitly J. Susskind 54 6 0 05 Jul 2022
Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structures Tianze Zhang Yizhuo Zhang Wei Cao Jiang Bian Xiaohan Yi Shun Zheng Jian Li BDL AI4TS 165 173 0 04 Jul 2022
Multi-task Driver Steering Behaviour Modeling Using Time-Series Transformer Yang Xing Wenbo Li Xiaoyu Mo Chen Lv 66 2 0 01 Jul 2022
Protoformer: Embedding Prototypes for Transformers Ashkan Farhangi Ning Sui Nan Hua Haiyan Bai Arthur Huang Zhishan Guo ViT 80 5 0 25 Jun 2022
TreeDRNet:A Robust Deep Model for Long Term Time Series Forecasting Tian Zhou Jianqing Zhu Xue Wang Ziqing Ma Qingsong Wen Liang Sun Rong Jin AI4TS 72 4 0 24 Jun 2022
Predicting Hate Intensity of Twitter Conversation Threads Qing Meng Tharun Suresh Roy Ka-wei Lee Tanmoy Chakraborty 124 20 0 16 Jun 2022
Event-related data conditioning for acoustic event classification Yuanbo Hou Dick Botteldooren 59 3 0 16 Jun 2022
DRAformer: Differentially Reconstructed Attention Transformer for Time-Series Forecasting Benhan Li Shengdong Du Tianrui Li Jie Hu Zhenglong Jia AI4TS 77 2 0 11 Jun 2022
Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecasting Amin Shabani A. Abdi Li Meng Tristan Sylvain AI4TS 125 64 0 08 Jun 2022
Exploring Transformers for Behavioural Biometrics: A Case Study in Gait Recognition Paula Delgado-Santos Ruben Tolosana R. Guest F. Deravi R. Vera-Rodríguez 70 34 0 03 Jun 2022
BayesFormer: Transformer with Uncertainty Estimation Karthik Abinav Sankararaman Sinong Wang Han Fang UQCV BDL 60 11 0 02 Jun 2022
A Meta Reinforcement Learning Approach for Predictive Autoscaling in the Cloud Siqiao Xue Chao Qu Xiaoming Shi Cong Liao Shiyi Zhu ... Yun Hu Lei Lei Yang Zheng Jianguo Li James Y. Zhang 119 41 0 31 May 2022