Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting

29 June 2019

Papers citing "Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting"

50 / 164 papers shown

Title
MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series Yiwei Fu Feng Xue AI4TS 29 15 0 04 May 2022
Triformer: Triangular, Variable-Specific Attentions for Long Sequence Multivariate Time Series Forecasting--Full Version Razvan-Gabriel Cirstea Chenjuan Guo B. Yang Tung Kieu Xuanyi Dong Shirui Pan AI4TS 37 107 0 28 Apr 2022
A Call for Clarity in Beam Search: How It Works and When It Stops Jungo Kasai Keisuke Sakaguchi Ronan Le Bras Dragomir R. Radev Yejin Choi Noah A. Smith 26 6 0 11 Apr 2022
Transformer-Based Self-Supervised Learning for Emotion Recognition Juan Vazquez-Rodriguez G. Lefebvre Julien Cumin James L. Crowley 23 25 0 08 Apr 2022
CT-SAT: Contextual Transformer for Sequential Audio Tagging Yuanbo Hou Zhaoyi Liu Bo Kang Yun Wang Dick Botteldooren ViT 32 5 0 22 Mar 2022
A comparative study of non-deep learning, deep learning, and ensemble learning methods for sunspot number prediction Yuchen Dang Ziqi Chen Heng Li Hai Shu ELM BDL 27 26 0 11 Mar 2022
TiSAT: Time Series Anomaly Transformer Keval Doshi Shatha Abudalou Yasin Yılmaz AI4TS 32 16 0 10 Mar 2022
Robust Probabilistic Time Series Forecasting Taeho Yoon Youngsuk Park Ernest K. Ryu Yuyang Wang AAML AI4TS 20 18 0 24 Feb 2022
Preformer: Predictive Transformer with Multi-Scale Segment-wise Correlations for Long-Term Time Series Forecasting Dazhao Du Bing-Huang Su Zhewei Wei AI4TS 21 43 0 23 Feb 2022
Multivariate Quantile Function Forecaster Kelvin K. Kan Franccois-Xavier Aubet Tim Januschowski Youngsuk Park Konstantinos Benidis Lars Ruthotto Jan Gasthaus AI4TS 39 22 0 23 Feb 2022
Transformer Quality in Linear Time Weizhe Hua Zihang Dai Hanxiao Liu Quoc V. Le 81 222 0 21 Feb 2022
ActionFormer: Localizing Moments of Actions with Transformers Chen-Da Liu-Zhang Jianxin Wu Yin Li ViT 31 330 0 16 Feb 2022
KENN: Enhancing Deep Neural Networks by Leveraging Knowledge for Time Series Forecasting M. A. Chattha L. V. Elst M. I. Malik Andreas Dengel Sheraz Ahmed AI4TS 16 0 0 08 Feb 2022
ETSformer: Exponential Smoothing Transformers for Time-series Forecasting Gerald Woo Chenghao Liu Doyen Sahoo Akshat Kumar Guosheng Lin AI4TS 31 162 0 03 Feb 2022
FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting Tian Zhou Ziqing Ma Qingsong Wen Xue Wang Liang Sun Rong Jin AI4TS 30 1,315 0 30 Jan 2022
Time Series Generation with Masked Autoencoder Meng-yue Zha SiuTim Wong Mengqi Liu Tong Zhang Kani Chen SyDa AI4TS 27 17 0 14 Jan 2022
Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting Ling-Hao Chen Donghui Chen Zongjiang Shang Binqing Wu Cen Zheng Bo Wen Wei Zhang AI4TS AI4CE 24 61 0 13 Jan 2022
Classification of Long Sequential Data using Circular Dilated Convolutional Neural Networks Lei Cheng Ruslan Khalitov Tong Yu Zhirong Yang 25 32 0 06 Jan 2022
ChunkFormer: Learning Long Time Series with Multi-stage Chunked Transformer Yue Ju Alka Isac Yimin Nie AI4TS 14 3 0 30 Dec 2021
A Lightweight and Accurate Spatial-Temporal Transformer for Traffic Forecasting Guanyao Li Shuhan Zhong Shueng-Han Gary Chan Ruiyuan Li Chih-Chieh Hung Wen-Chih Peng AI4TS 35 26 0 30 Dec 2021
SSDNet: State Space Decomposition Neural Network for Time Series Forecasting Yang Lin I. Koprinska Mashud Rana BDL AI4TS 26 31 0 19 Dec 2021
Trading with the Momentum Transformer: An Intelligent and Interpretable Architecture Kieran Wood Sven Giegerich Stephen J. Roberts S. Zohren AI4TS AIFin 21 21 0 16 Dec 2021
Scale-Aware Neural Architecture Search for Multivariate Time Series Forecasting Donghui Chen Ling-Hao Chen Zongjiang Shang Youdong Zhang Bo Wen Chenghu Yang AI4TS 38 7 0 14 Dec 2021
Event-Aware Multimodal Mobility Nowcasting Zhaonan Wang Renhe Jiang Hao Xue Flora D. Salim Xuan Song Ryosuke Shibasaki 38 35 0 14 Dec 2021
Towards Autonomous Satellite Communications: An AI-based Framework to Address System-level Challenges J. Luis Skylar Eiskowitz Nils Pachler de la Osa E. Crawley B. Cameron 20 5 0 11 Dec 2021
ProSTformer: Pre-trained Progressive Space-Time Self-attention Model for Traffic Flow Forecasting Xiao Yan X. Gan Jingjing Tang Rui Wang ViT AI4TS 24 0 0 03 Nov 2021
MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data Zhibo Zhu Ziqi Liu Ge Jin Qing Cui Lei Chen Jun Zhou Jianyong Zhou AI4TS 29 15 0 27 Oct 2021
Development of Deep Transformer-Based Models for Long-Term Prediction of Transient Production of Oil Wells I. Abdrakhmanov E. Kanin S. Boronin Evgeny Burnaev A. Osiptsov 37 14 0 12 Oct 2021
Emergency Vehicles Audio Detection and Localization in Autonomous Driving Hongyi Sun Xinyi Liu Kecheng Xu Jinghao Miao Qi Luo 24 19 0 30 Sep 2021
Interpretability in Safety-Critical FinancialTrading Systems Gabriel Deza Adelin Travers C. Rowat Nicolas Papernot AAML AIFin 21 1 0 24 Sep 2021
Digital Signal Processing Using Deep Neural Networks Brian Shevitski Y. Watkins Nicole Man Michael Girard AI4CE 31 4 0 21 Sep 2021
Neural forecasting at scale Philippe Chatigny Shengrui Wang Jean-Marc Patenaude and Boris N. Oreshkin AI4TS 35 1 0 20 Sep 2021
From Known to Unknown: Knowledge-guided Transformer for Time-Series Sales Forecasting in Alibaba Xinyuan Qi Kai Hou Tong Liu Zhongzhong Yu Sihao Hu Wenwu Ou AI4TS 45 19 0 17 Sep 2021
TCCT: Tightly-Coupled Convolutional Transformer on Time Series Forecasting Li Shen Yangzhu Wang AI4TS 35 92 0 29 Aug 2021
Auto-Parsing Network for Image Captioning and Visual Question Answering Xu Yang Chongyang Gao Hanwang Zhang Jianfei Cai 24 35 0 24 Aug 2021
DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Prediction Renhe Jiang Du Yin Zhaonan Wang Yizhuo Wang Jiewen Deng Hangcheng Liu Zekun Cai Jinliang Deng Xuan Song Ryosuke Shibasaki AI4TS 57 158 0 20 Aug 2021
Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing Ghodai M. Abdelrahman Qing Wang KELM AI4Ed 30 44 0 18 Aug 2021
Topological Attention for Time Series Forecasting Sebastian Zeng Florian Graf Christoph Hofer Roland Kwitt AI4TS 13 24 0 19 Jul 2021
Combiner: Full Attention Transformer with Sparse Computation Cost Hongyu Ren H. Dai Zihang Dai Mengjiao Yang J. Leskovec Dale Schuurmans Bo Dai 87 77 0 12 Jul 2021
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting Haixu Wu Jiehui Xu Jianmin Wang Mingsheng Long AI4TS 59 2,107 0 24 Jun 2021
Transformers à Grande Vitesse Farid Arthaud G. Lecoeur Alban Pierre AI4TS 11 2 0 18 May 2021
Monash Time Series Forecasting Archive Rakshitha Godahewa Christoph Bergmeir Geoffrey I. Webb Rob J. Hyndman Pablo Montero-Manso AI4TS 24 145 0 14 May 2021
Deep Time Series Forecasting with Shape and Temporal Criteria Vincent Le Guen Nicolas Thome AI4TS 35 27 0 09 Apr 2021
Causal Hidden Markov Model for Time Series Disease Forecasting Jing Li Botong Wu Xinwei Sun Yizhou Wang CML OOD 18 25 0 30 Mar 2021
Historical Inertia: A Neglected but Powerful Baseline for Long Sequence Time-series Forecasting Yue Cui Jiandong Xie Kai Zheng AI4TS 19 53 0 30 Mar 2021
Gated Transformer Networks for Multivariate Time Series Classification Minghao Liu Shengqi Ren Siyuan Ma Jiahui Jiao Yizhou Chen Zhiguang Wang Wei Song AI4TS 41 130 0 26 Mar 2021
Missing Value Imputation on Multidimensional Time Series Parikshit Bansal Prathamesh Deshpande Sunita Sarawagi AI4TS 14 63 0 02 Mar 2021
SparseBERT: Rethinking the Importance Analysis in Self-attention Han Shi Jiahui Gao Xiaozhe Ren Hang Xu Xiaodan Liang Zhenguo Li James T. Kwok 23 54 0 25 Feb 2021
Adjusting for Autocorrelated Errors in Neural Networks for Time Series Fan-Keng Sun C. Lang Duane S. Boning OOD AI4TS 35 28 0 28 Jan 2021
Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series Forecasting Nam H. Nguyen Brian Quanz BDL AI4TS 140 66 0 25 Jan 2021