ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.00235
  4. Cited By
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer
  on Time Series Forecasting
v1v2v3 (latest)

Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting

29 June 2019
Shiyang Li
Xiaoyong Jin
Yao Xuan
Xiyou Zhou
Wenhu Chen
Yu Wang
Xifeng Yan
    AI4TS
ArXiv (abs)PDFHTML

Papers citing "Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting"

50 / 503 papers shown
Title
Towards Autonomous Satellite Communications: An AI-based Framework to
  Address System-level Challenges
Towards Autonomous Satellite Communications: An AI-based Framework to Address System-level Challenges
J. Luis
Skylar Eiskowitz
Nils Pachler de la Osa
E. Crawley
B. Cameron
53
6
0
11 Dec 2021
Self-Supervised Transformers for fMRI representation
Self-Supervised Transformers for fMRI representation
Itzik Malkiel
Gony Rosenman
Lior Wolf
Talma Hendler
ViTMedIm
95
19
0
10 Dec 2021
Human Guided Exploitation of Interpretable Attention Patterns in
  Summarization and Topic Segmentation
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation
Raymond Li
Wen Xiao
Linzi Xing
Lanjun Wang
Gabriel Murray
Giuseppe Carenini
ViT
67
8
0
10 Dec 2021
Artificial Intelligence and Design of Experiments for Assessing Security
  of Electricity Supply: A Review and Strategic Outlook
Artificial Intelligence and Design of Experiments for Assessing Security of Electricity Supply: A Review and Strategic Outlook
J. Priesmann
J. Münch
Elias Ridha
T. Spiegel
M. Reich
M. Adam
Lars Nolting
Aaron Praktiknjo
13
1
0
07 Dec 2021
Parameter Efficient Deep Probabilistic Forecasting
Parameter Efficient Deep Probabilistic Forecasting
O. Sprangers
Sebastian Schelter
Maarten de Rijke
BDLAI4TS
118
24
0
06 Dec 2021
Sparse is Enough in Scaling Transformers
Sparse is Enough in Scaling Transformers
Sebastian Jaszczur
Aakanksha Chowdhery
Afroz Mohiuddin
Lukasz Kaiser
Wojciech Gajewski
Henryk Michalewski
Jonni Kanerva
MoE
71
102
0
24 Nov 2021
A transformer-based model for default prediction in mid-cap corporate
  markets
A transformer-based model for default prediction in mid-cap corporate markets
Kamesh Korangi
Christophe Mues
Cristián Bravo
AI4TS
37
31
0
18 Nov 2021
Online Advertising Revenue Forecasting: An Interpretable Deep Learning
  Approach
Online Advertising Revenue Forecasting: An Interpretable Deep Learning Approach
Maximilian Würfel
Qiwei Han
Maximilian Kaiser
AI4TS
45
8
0
16 Nov 2021
Learning from Multiple Time Series: A Deep Disentangled Approach to
  Diversified Time Series Forecasting
Learning from Multiple Time Series: A Deep Disentangled Approach to Diversified Time Series Forecasting
Ling-Hao Chen
Weiqiu Chen
Binqing Wu
Youdong Zhang
Bo Wen
Chenghu Yang
AI4TS
33
4
0
09 Nov 2021
Meta-Forecasting by combining Global Deep Representations with Local
  Adaptation
Meta-Forecasting by combining Global Deep Representations with Local Adaptation
Riccardo Grazzi
Valentin Flunkert
David Salinas
Tim Januschowski
Matthias Seeger
Cédric Archambeau
AI4TSAI4CE
69
7
0
05 Nov 2021
Coherent Probabilistic Aggregate Queries on Long-horizon Forecasts
Coherent Probabilistic Aggregate Queries on Long-horizon Forecasts
Prathamesh Deshpande
Sunita Sarawagi
AI4TS
52
0
0
05 Nov 2021
Flight Demand Forecasting with Transformers
Flight Demand Forecasting with Transformers
Liya Wang
Amy L. Mykityshyn
Craig Johnson
Jillian Cheng
AI4TS
35
6
0
04 Nov 2021
ProSTformer: Pre-trained Progressive Space-Time Self-attention Model for
  Traffic Flow Forecasting
ProSTformer: Pre-trained Progressive Space-Time Self-attention Model for Traffic Flow Forecasting
Xiao Yan
X. Gan
Jingjing Tang
Rui Wang
ViTAI4TS
33
0
0
03 Nov 2021
Kernel Deformed Exponential Families for Sparse Continuous Attention
Kernel Deformed Exponential Families for Sparse Continuous Attention
Alexander Moreno
Supriya Nagesh
Zhenke Wu
Walter Dempsey
James M. Rehg
42
1
0
01 Nov 2021
MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic
  Time Series Data
MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data
Zhibo Zhu
Ziqi Liu
Ge Jin
Qing Cui
Lei Chen
Jun Zhou
Jianyong Zhou
AI4TS
70
15
0
27 Oct 2021
Yformer: U-Net Inspired Transformer Architecture for Far Horizon Time
  Series Forecasting
Yformer: U-Net Inspired Transformer Architecture for Far Horizon Time Series Forecasting
Kiran Madhusudhanan
Johannes Burchert
Nghia Duong-Trung
Stefan Born
Lars Schmidt-Thieme
AI4TSAI4CE
108
21
0
13 Oct 2021
Development of Deep Transformer-Based Models for Long-Term Prediction of
  Transient Production of Oil Wells
Development of Deep Transformer-Based Models for Long-Term Prediction of Transient Production of Oil Wells
I. Abdrakhmanov
E. Kanin
S. Boronin
Evgeny Burnaev
A. Osiptsov
63
15
0
12 Oct 2021
Anomaly Transformer: Time Series Anomaly Detection with Association
  Discrepancy
Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy
Jiehui Xu
Haixu Wu
Jianmin Wang
Mingsheng Long
AI4TS
145
508
0
06 Oct 2021
Empirical Quantitative Analysis of COVID-19 Forecasting Models
Empirical Quantitative Analysis of COVID-19 Forecasting Models
Yun Zhao
Yuqing Wang
Junfeng Liu
H. Xia
Zhenni Xu
Qinghang Hong
Zhiyang Zhou
Linda R. Petzold
61
11
0
01 Oct 2021
Emergency Vehicles Audio Detection and Localization in Autonomous
  Driving
Emergency Vehicles Audio Detection and Localization in Autonomous Driving
Hongyi Sun
Xinyi Liu
Kecheng Xu
Jinghao Miao
Qi Luo
59
20
0
30 Sep 2021
Long-Range Transformers for Dynamic Spatiotemporal Forecasting
Long-Range Transformers for Dynamic Spatiotemporal Forecasting
J. E. Grigsby
Zhe Wang
Nam Nguyen
Yanjun Qi
AI4TS
121
95
0
24 Sep 2021
Interpretability in Safety-Critical FinancialTrading Systems
Interpretability in Safety-Critical FinancialTrading Systems
Gabriel Deza
Adelin Travers
C. Rowat
Nicolas Papernot
AAMLAIFin
104
1
0
24 Sep 2021
Digital Signal Processing Using Deep Neural Networks
Digital Signal Processing Using Deep Neural Networks
Brian Shevitski
Y. Watkins
Nicole Man
Michael Girard
AI4CE
80
4
0
21 Sep 2021
Neural forecasting at scale
Neural forecasting at scale
Philippe Chatigny
Shengrui Wang
Jean-Marc Patenaude and
Boris N. Oreshkin
AI4TS
69
1
0
20 Sep 2021
From Known to Unknown: Knowledge-guided Transformer for Time-Series
  Sales Forecasting in Alibaba
From Known to Unknown: Knowledge-guided Transformer for Time-Series Sales Forecasting in Alibaba
Xinyuan Qi
Kai Hou
Tong Liu
Zhongzhong Yu
Sihao Hu
Wenwu Ou
AI4TS
92
20
0
17 Sep 2021
Sparse Factorization of Large Square Matrices
Sparse Factorization of Large Square Matrices
Ruslan Khalitov
Tong Yu
Lei Cheng
Zhirong Yang
30
2
0
16 Sep 2021
Deciphering Environmental Air Pollution with Large Scale City Data
Deciphering Environmental Air Pollution with Large Scale City Data
Mayukh Bhattacharyya
Sayan Nag
Udita Ghosh
AI4CE
47
5
0
09 Sep 2021
A Multi-view Multi-task Learning Framework for Multi-variate Time Series
  Forecasting
A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecasting
Jinliang Deng
Xiusi Chen
Renhe Jiang
Xuan Song
Ivor W. Tsang
AI4TS
83
38
0
02 Sep 2021
TCCT: Tightly-Coupled Convolutional Transformer on Time Series
  Forecasting
TCCT: Tightly-Coupled Convolutional Transformer on Time Series Forecasting
Li Shen
Yangzhu Wang
AI4TS
88
98
0
29 Aug 2021
Auto-Parsing Network for Image Captioning and Visual Question Answering
Auto-Parsing Network for Image Captioning and Visual Question Answering
Xu Yang
Chongyang Gao
Hanwang Zhang
Jianfei Cai
117
37
0
24 Aug 2021
DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic
  Prediction
DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Prediction
Renhe Jiang
Du Yin
Zhaonan Wang
Yizhuo Wang
Jiewen Deng
Hangcheng Liu
Zekun Cai
Jinliang Deng
Xuan Song
Ryosuke Shibasaki
AI4TS
98
165
0
20 Aug 2021
Transformers predicting the future. Applying attention in next-frame and
  time series forecasting
Transformers predicting the future. Applying attention in next-frame and time series forecasting
Radostin Cholakov
T. Kolev
AI4TS
53
17
0
18 Aug 2021
Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing
Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing
Ghodai M. Abdelrahman
Qing Wang
KELMAI4Ed
106
52
0
18 Aug 2021
Reconstructing a dynamical system and forecasting time series by
  self-consistent deep learning
Reconstructing a dynamical system and forecasting time series by self-consistent deep learning
Zhe Wang
C. Guet
AI4TS
26
4
0
04 Aug 2021
PSA-GAN: Progressive Self Attention GANs for Synthetic Time Series
PSA-GAN: Progressive Self Attention GANs for Synthetic Time Series
Paul Jeha
Michael Bohlke-Schneider
Pedro Mercado
Shubham Kapoor
Rajbir-Singh Nirwan
Valentin Flunkert
Jan Gasthaus
Tim Januschowski
AI4TS
110
51
0
02 Aug 2021
Tsformer: Time series Transformer for tourism demand forecasting
Tsformer: Time series Transformer for tourism demand forecasting
Siyuan Yi
Xing Chen
Chuanming Tang
AI4TS
21
2
0
22 Jul 2021
Topological Attention for Time Series Forecasting
Topological Attention for Time Series Forecasting
Sebastian Zeng
Florian Graf
Christoph Hofer
Roland Kwitt
AI4TS
54
26
0
19 Jul 2021
Long-term series forecasting with Query Selector -- efficient model of
  sparse attention
Long-term series forecasting with Query Selector -- efficient model of sparse attention
J. Klimek
Jakub Klímek
W. Kraskiewicz
Mateusz Topolewski
AI4TS
122
6
0
19 Jul 2021
Deep Autoregressive Models with Spectral Attention
Deep Autoregressive Models with Spectral Attention
Fernando Moreno-Pino
Pablo Martínez Olmos
Antonio Artés-Rodríguez
AI4TS
64
18
0
13 Jul 2021
Combiner: Full Attention Transformer with Sparse Computation Cost
Combiner: Full Attention Transformer with Sparse Computation Cost
Hongyu Ren
H. Dai
Zihang Dai
Mengjiao Yang
J. Leskovec
Dale Schuurmans
Bo Dai
166
80
0
12 Jul 2021
Single Model for Influenza Forecasting of Multiple Countries by
  Multi-task Learning
Single Model for Influenza Forecasting of Multiple Countries by Multi-task Learning
Taichi Murayama
Shoko Wakamiya
Eiji Aramaki
AI4TS
40
0
0
05 Jul 2021
Autoformer: Decomposition Transformers with Auto-Correlation for
  Long-Term Series Forecasting
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
Haixu Wu
Jiehui Xu
Jianmin Wang
Mingsheng Long
AI4TS
124
2,371
0
24 Jun 2021
ConvDySAT: Deep Neural Representation Learning on Dynamic Graphs via
  Self-Attention and Convolutional Neural Networks
ConvDySAT: Deep Neural Representation Learning on Dynamic Graphs via Self-Attention and Convolutional Neural Networks
A. Hafez
Atulya Praphul
Yousef Jaradt
Ezani Godwin
GNN
46
2
0
21 Jun 2021
TS2Vec: Towards Universal Representation of Time Series
TS2Vec: Towards Universal Representation of Time Series
Zhihan Yue
Yujing Wang
Juanyong Duan
Tianmeng Yang
Congrui Huang
Yu Tong
Bixiong Xu
AI4TS
143
590
0
19 Jun 2021
Dynamical Deep Generative Latent Modeling of 3D Skeletal Motion
Dynamical Deep Generative Latent Modeling of 3D Skeletal Motion
Amirreza Farnoosh
Sarah Ostadabbas
46
3
0
18 Jun 2021
SCINet: Time Series Modeling and Forecasting with Sample Convolution and
  Interaction
SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interaction
Minhao Liu
Ailing Zeng
Mu-Hwa Chen
Zhijian Xu
Qiuxia Lai
Lingna Ma
Qiang Xu
AI4TS
108
389
0
17 Jun 2021
Deep Particulate Matter Forecasting Model Using Correntropy-Induced Loss
Deep Particulate Matter Forecasting Model Using Correntropy-Induced Loss
Jongsu Kim
Changhoon Lee
19
3
0
06 Jun 2021
Deep Switching State Space Model (DS$^3$M) for Nonlinear Time Series Forecasting with Regime Switching
Deep Switching State Space Model (DS3^33M) for Nonlinear Time Series Forecasting with Regime Switching
Xiuqin Xu
Hanqiu Peng
Ying Chen
AI4TSBDL
21
2
0
04 Jun 2021
Probabilistic Gradient Boosting Machines for Large-Scale Probabilistic
  Regression
Probabilistic Gradient Boosting Machines for Large-Scale Probabilistic Regression
O. Sprangers
Sebastian Schelter
Maarten de Rijke
AI4CE
61
40
0
03 Jun 2021
Transformers à Grande Vitesse
Transformers à Grande Vitesse
Farid Arthaud
G. Lecoeur
Alban Pierre
AI4TS
26
2
0
18 May 2021
Previous
123...101189
Next