v1v2v3 (latest)

Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting

29 June 2019

Papers citing "Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting"

50 / 503 papers shown

Title
Towards Autonomous Satellite Communications: An AI-based Framework to Address System-level Challenges J. Luis Skylar Eiskowitz Nils Pachler de la Osa E. Crawley B. Cameron 53 6 0 11 Dec 2021
Self-Supervised Transformers for fMRI representation Itzik Malkiel Gony Rosenman Lior Wolf Talma Hendler ViT MedIm 95 19 0 10 Dec 2021
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation Raymond Li Wen Xiao Linzi Xing Lanjun Wang Gabriel Murray Giuseppe Carenini ViT 67 8 0 10 Dec 2021
Artificial Intelligence and Design of Experiments for Assessing Security of Electricity Supply: A Review and Strategic Outlook J. Priesmann J. Münch Elias Ridha T. Spiegel M. Reich M. Adam Lars Nolting Aaron Praktiknjo 13 1 0 07 Dec 2021
Parameter Efficient Deep Probabilistic Forecasting O. Sprangers Sebastian Schelter Maarten de Rijke BDL AI4TS 118 23 0 06 Dec 2021
Sparse is Enough in Scaling Transformers Sebastian Jaszczur Aakanksha Chowdhery Afroz Mohiuddin Lukasz Kaiser Wojciech Gajewski Henryk Michalewski Jonni Kanerva MoE 71 102 0 24 Nov 2021
A transformer-based model for default prediction in mid-cap corporate markets Kamesh Korangi Christophe Mues Cristián Bravo AI4TS 37 31 0 18 Nov 2021
Online Advertising Revenue Forecasting: An Interpretable Deep Learning Approach Maximilian Würfel Qiwei Han Maximilian Kaiser AI4TS 45 8 0 16 Nov 2021
Learning from Multiple Time Series: A Deep Disentangled Approach to Diversified Time Series Forecasting Ling-Hao Chen Weiqiu Chen Binqing Wu Youdong Zhang Bo Wen Chenghu Yang AI4TS 33 4 0 09 Nov 2021
Meta-Forecasting by combining Global Deep Representations with Local Adaptation Riccardo Grazzi Valentin Flunkert David Salinas Tim Januschowski Matthias Seeger Cédric Archambeau AI4TS AI4CE 69 7 0 05 Nov 2021
Coherent Probabilistic Aggregate Queries on Long-horizon Forecasts Prathamesh Deshpande Sunita Sarawagi AI4TS 52 0 0 05 Nov 2021
Flight Demand Forecasting with Transformers Liya Wang Amy L. Mykityshyn Craig Johnson Jillian Cheng AI4TS 35 6 0 04 Nov 2021
ProSTformer: Pre-trained Progressive Space-Time Self-attention Model for Traffic Flow Forecasting Xiao Yan X. Gan Jingjing Tang Rui Wang ViT AI4TS 33 0 0 03 Nov 2021
Kernel Deformed Exponential Families for Sparse Continuous Attention Alexander Moreno Supriya Nagesh Zhenke Wu Walter Dempsey James M. Rehg 42 1 0 01 Nov 2021
MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data Zhibo Zhu Ziqi Liu Ge Jin Qing Cui Lei Chen Jun Zhou Jianyong Zhou AI4TS 70 15 0 27 Oct 2021
Yformer: U-Net Inspired Transformer Architecture for Far Horizon Time Series Forecasting Kiran Madhusudhanan Johannes Burchert Nghia Duong-Trung Stefan Born Lars Schmidt-Thieme AI4TS AI4CE 108 21 0 13 Oct 2021
Development of Deep Transformer-Based Models for Long-Term Prediction of Transient Production of Oil Wells I. Abdrakhmanov E. Kanin S. Boronin Evgeny Burnaev A. Osiptsov 63 15 0 12 Oct 2021
Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy Jiehui Xu Haixu Wu Jianmin Wang Mingsheng Long AI4TS 145 508 0 06 Oct 2021
Empirical Quantitative Analysis of COVID-19 Forecasting Models Yun Zhao Yuqing Wang Junfeng Liu H. Xia Zhenni Xu Qinghang Hong Zhiyang Zhou Linda R. Petzold 61 11 0 01 Oct 2021
Emergency Vehicles Audio Detection and Localization in Autonomous Driving Hongyi Sun Xinyi Liu Kecheng Xu Jinghao Miao Qi Luo 59 20 0 30 Sep 2021
Long-Range Transformers for Dynamic Spatiotemporal Forecasting J. E. Grigsby Zhe Wang Nam Nguyen Yanjun Qi AI4TS 121 95 0 24 Sep 2021
Interpretability in Safety-Critical FinancialTrading Systems Gabriel Deza Adelin Travers C. Rowat Nicolas Papernot AAML AIFin 104 1 0 24 Sep 2021
Digital Signal Processing Using Deep Neural Networks Brian Shevitski Y. Watkins Nicole Man Michael Girard AI4CE 80 4 0 21 Sep 2021
Neural forecasting at scale Philippe Chatigny Shengrui Wang Jean-Marc Patenaude and Boris N. Oreshkin AI4TS 65 1 0 20 Sep 2021
From Known to Unknown: Knowledge-guided Transformer for Time-Series Sales Forecasting in Alibaba Xinyuan Qi Kai Hou Tong Liu Zhongzhong Yu Sihao Hu Wenwu Ou AI4TS 92 20 0 17 Sep 2021
Sparse Factorization of Large Square Matrices Ruslan Khalitov Tong Yu Lei Cheng Zhirong Yang 30 2 0 16 Sep 2021
Deciphering Environmental Air Pollution with Large Scale City Data Mayukh Bhattacharyya Sayan Nag Udita Ghosh AI4CE 47 5 0 09 Sep 2021
A Multi-view Multi-task Learning Framework for Multi-variate Time Series Forecasting Jinliang Deng Xiusi Chen Renhe Jiang Xuan Song Ivor W. Tsang AI4TS 83 38 0 02 Sep 2021
TCCT: Tightly-Coupled Convolutional Transformer on Time Series Forecasting Li Shen Yangzhu Wang AI4TS 88 98 0 29 Aug 2021
Auto-Parsing Network for Image Captioning and Visual Question Answering Xu Yang Chongyang Gao Hanwang Zhang Jianfei Cai 117 37 0 24 Aug 2021
DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Prediction Renhe Jiang Du Yin Zhaonan Wang Yizhuo Wang Jiewen Deng Hangcheng Liu Zekun Cai Jinliang Deng Xuan Song Ryosuke Shibasaki AI4TS 98 165 0 20 Aug 2021
Transformers predicting the future. Applying attention in next-frame and time series forecasting Radostin Cholakov T. Kolev AI4TS 53 17 0 18 Aug 2021
Deep Graph Memory Networks for Forgetting-Robust Knowledge Tracing Ghodai M. Abdelrahman Qing Wang KELM AI4Ed 106 52 0 18 Aug 2021
Reconstructing a dynamical system and forecasting time series by self-consistent deep learning Zhe Wang C. Guet AI4TS 26 4 0 04 Aug 2021
PSA-GAN: Progressive Self Attention GANs for Synthetic Time Series Paul Jeha Michael Bohlke-Schneider Pedro Mercado Shubham Kapoor Rajbir-Singh Nirwan Valentin Flunkert Jan Gasthaus Tim Januschowski AI4TS 110 51 0 02 Aug 2021
Tsformer: Time series Transformer for tourism demand forecasting Siyuan Yi Xing Chen Chuanming Tang AI4TS 21 2 0 22 Jul 2021
Topological Attention for Time Series Forecasting Sebastian Zeng Florian Graf Christoph Hofer Roland Kwitt AI4TS 54 26 0 19 Jul 2021
Long-term series forecasting with Query Selector -- efficient model of sparse attention J. Klimek Jakub Klímek W. Kraskiewicz Mateusz Topolewski AI4TS 122 6 0 19 Jul 2021
Deep Autoregressive Models with Spectral Attention Fernando Moreno-Pino Pablo Martínez Olmos Antonio Artés-Rodríguez AI4TS 64 18 0 13 Jul 2021
Combiner: Full Attention Transformer with Sparse Computation Cost Hongyu Ren H. Dai Zihang Dai Mengjiao Yang J. Leskovec Dale Schuurmans Bo Dai 166 80 0 12 Jul 2021
Single Model for Influenza Forecasting of Multiple Countries by Multi-task Learning Taichi Murayama Shoko Wakamiya Eiji Aramaki AI4TS 40 0 0 05 Jul 2021
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting Haixu Wu Jiehui Xu Jianmin Wang Mingsheng Long AI4TS 124 2,371 0 24 Jun 2021
ConvDySAT: Deep Neural Representation Learning on Dynamic Graphs via Self-Attention and Convolutional Neural Networks A. Hafez Atulya Praphul Yousef Jaradt Ezani Godwin GNN 46 2 0 21 Jun 2021
TS2Vec: Towards Universal Representation of Time Series Zhihan Yue Yujing Wang Juanyong Duan Tianmeng Yang Congrui Huang Yu Tong Bixiong Xu AI4TS 143 590 0 19 Jun 2021
Dynamical Deep Generative Latent Modeling of 3D Skeletal Motion Amirreza Farnoosh Sarah Ostadabbas 46 3 0 18 Jun 2021
SCINet: Time Series Modeling and Forecasting with Sample Convolution and Interaction Minhao Liu Ailing Zeng Mu-Hwa Chen Zhijian Xu Qiuxia Lai Lingna Ma Qiang Xu AI4TS 108 389 0 17 Jun 2021
Deep Particulate Matter Forecasting Model Using Correntropy-Induced Loss Jongsu Kim Changhoon Lee 19 3 0 06 Jun 2021
Deep Switching State Space Model (DS $^3$ M) for Nonlinear Time Series Forecasting with Regime Switching Xiuqin Xu Hanqiu Peng Ying Chen AI4TS BDL 21 2 0 04 Jun 2021
Probabilistic Gradient Boosting Machines for Large-Scale Probabilistic Regression O. Sprangers Sebastian Schelter Maarten de Rijke AI4CE 61 39 0 03 Jun 2021
Transformers à Grande Vitesse Farid Arthaud G. Lecoeur Alban Pierre AI4TS 26 2 0 18 May 2021