v1v2v3v4 (latest)

Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecasting

8 June 2022

ArXiv (abs)PDF HTML Github (133★)

Papers citing "Scaleformer: Iterative Multi-scale Refining Transformers for Time Series Forecasting"

27 / 27 papers shown

Title
Multiple-Resolution Tokenization for Time Series Forecasting with an Application to Pricing Egon Persak Miguel F. Anjos Sebastian Lautz Aleksandar Kolev AI4TS 77 0 0 03 Jul 2024
FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting Tian Zhou Ziqing Ma Xue Wang Qingsong Wen Liang Sun Tao Yao Wotao Yin Rong Jin AI4TS 174 187 0 18 May 2022
Preformer: Predictive Transformer with Multi-Scale Segment-wise Correlations for Long-Term Time Series Forecasting Dazhao Du Fuchun Sun Zhewei Wei AI4TS 79 48 0 23 Feb 2022
N-HiTS: Neural Hierarchical Interpolation for Time Series Forecasting Cristian Challu Kin G. Olivares Boris N. Oreshkin Federico Garza Max Mergenthaler-Canseco A. Dubrawski AI4TS 98 274 0 30 Jan 2022
FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting Tian Zhou Ziqing Ma Qingsong Wen Xue Wang Liang Sun Rong Jin AI4TS 248 1,435 0 30 Jan 2022
Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting Ling-Hao Chen Donghui Chen Zongjiang Shang Binqing Wu Cen Zheng Bo Wen Wei Zhang AI4TS AI4CE 45 77 0 13 Jan 2022
Hierarchical Transformers Are More Efficient Language Models Piotr Nawrot Szymon Tworkowski Michał Tyrolski Lukasz Kaiser Yuhuai Wu Christian Szegedy Henryk Michalewski 71 69 0 26 Oct 2021
Yformer: U-Net Inspired Transformer Architecture for Far Horizon Time Series Forecasting Kiran Madhusudhanan Johannes Burchert Nghia Duong-Trung Stefan Born Lars Schmidt-Thieme AI4TS AI4CE 101 21 0 13 Oct 2021
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting Haixu Wu Jiehui Xu Jianmin Wang Mingsheng Long AI4TS 111 2,293 0 24 Jun 2021
Multiscale Vision Transformers Haoqi Fan Bo Xiong K. Mangalam Yanghao Li Zhicheng Yan Jitendra Malik Christoph Feichtenhofer ViT 135 1,265 0 22 Apr 2021
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding Pengchuan Zhang Xiyang Dai Jianwei Yang Bin Xiao Lu Yuan Lei Zhang Jianfeng Gao ViT 90 336 0 29 Mar 2021
A Transformer-based Framework for Multivariate Time Series Representation Learning George Zerveas Srideepika Jayaraman Dhaval Patel A. Bhamidipaty Carsten Eickhoff AI4TS 87 927 0 06 Oct 2020
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 186 1,600 0 30 Sep 2020
Multi-scale Transformer Language Models Sandeep Subramanian R. Collobert MarcÁurelio Ranzato Y-Lan Boureau 44 13 0 01 May 2020
Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case Neo Wu Bradley Green X. Ben S. O’Banion AI4TS 73 455 0 23 Jan 2020
Reformer: The Efficient Transformer Nikita Kitaev Lukasz Kaiser Anselm Levskaya VLM 199 2,332 0 13 Jan 2020
Risk-Averse Trust Region Optimization for Reward-Volatility Reduction Qianggang Ding Sifan Wu Hao Sun Jiadong Guo Jian Guo 41 127 0 06 Dec 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 532 42,559 0 03 Dec 2019
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting Shiyang Li Xiaoyong Jin Yao Xuan Xiyou Zhou Wenhu Chen Yu Wang Xifeng Yan AI4TS 107 1,426 0 29 Jun 2019
Multi-level Wavelet-CNN for Image Restoration Pengju Liu Hongzhi Zhang Peng Sun Liang Lin W. Zuo SupR 65 651 0 18 May 2018
An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling Shaojie Bai J. Zico Kolter V. Koltun DRL 97 4,845 0 04 Mar 2018
DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks David Salinas Valentin Flunkert Jan Gasthaus AI4TS UQCV BDL 83 2,123 0 13 Apr 2017
Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks Guokun Lai Wei-Cheng Chang Yiming Yang Hanxiao Liu BDL AI4TS 108 2,024 0 21 Mar 2017
A General and Adaptive Robust Loss Function Jonathan T. Barron OOD DRL 193 540 0 11 Jan 2017
Hierarchical Multiscale Recurrent Neural Networks Junyoung Chung Sungjin Ahn Yoshua Bengio BDL 104 537 0 06 Sep 2016
Multi-Scale Convolutional Neural Networks for Time Series Classification Zhicheng Cui Wenlin Chen Yixin Chen 47 566 0 22 Mar 2016
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 465 43,341 0 11 Feb 2015