v1v2v3 (latest)

Pushing the Limits of Pre-training for Time Series Forecasting in the CloudOps Domain

8 October 2023

ArXiv (abs)PDF HTML Github (23★)

Papers citing "Pushing the Limits of Pre-training for Time Series Forecasting in the CloudOps Domain"

22 / 22 papers shown

Title
Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts Xiaoming Shi Shiyu Wang Yuqi Nie Dianqi Li Zhou Ye Qingsong Wen Ming Jin AI4TS 112 54 0 24 Sep 2024
GPT-NeoX-20B: An Open-Source Autoregressive Language Model Sid Black Stella Biderman Eric Hallahan Quentin G. Anthony Leo Gao ... Shivanshu Purohit Laria Reynolds J. Tow Benqi Wang Samuel Weinbach 180 835 0 14 Apr 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 529 6,293 0 05 Apr 2022
Forecast Evaluation for Data Scientists: Common Pitfalls and Best Practices Hansika Hewamalage Klaus Ackermann Christoph Bergmeir AI4TS 128 94 0 21 Mar 2022
TACTiS: Transformer-Attentional Copulas for Time Series Alexandre Drouin Étienne Marcotte Nicolas Chapados AI4TS 255 39 0 07 Feb 2022
ETSformer: Exponential Smoothing Transformers for Time-series Forecasting Gerald Woo Chenghao Liu Doyen Sahoo Akshat Kumar Guosheng Lin AI4TS 88 167 0 03 Feb 2022
FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting Tian Zhou Ziqing Ma Qingsong Wen Xue Wang Liang Sun Rong Jin AI4TS 248 1,435 0 30 Jan 2022
Learning Quantile Functions without Quantile Crossing for Distribution-free Time Series Forecasting Youngsuk Park Danielle C. Maddix Franccois-Xavier Aubet Kelvin K. Kan Jan Gasthaus Yuyang Wang UQCV AI4TS 125 40 0 12 Nov 2021
CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation Y. Tashiro Jiaming Song Yang Song Stefano Ermon BDL DiffM 57 544 0 07 Jul 2021
TS2Vec: Towards Universal Representation of Time Series Zhihan Yue Yujing Wang Juanyong Duan Tianmeng Yang Congrui Huang Yu Tong Bixiong Xu AI4TS 97 581 0 19 Jun 2021
Monash Time Series Forecasting Archive Rakshitha Godahewa Christoph Bergmeir Geoffrey I. Webb Rob J. Hyndman Pablo Montero-Manso AI4TS 70 162 0 14 May 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 291 2,521 0 20 Apr 2021
Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecasting Kashif Rasul Calvin Seward Ingmar Schuster Roland Vollgraf DiffM 105 320 0 28 Jan 2021
Multivariate Probabilistic Time Series Forecasting via Conditioned Normalizing Flows Kashif Rasul Abdul-Saboor Sheikh Ingmar Schuster Urs M. Bergmann Roland Vollgraf BDL AI4TS AI4CE 106 187 0 14 Feb 2020
On Layer Normalization in the Transformer Architecture Ruibin Xiong Yunchang Yang Di He Kai Zheng Shuxin Zheng Chen Xing Huishuai Zhang Yanyan Lan Liwei Wang Tie-Yan Liu AI4CE 142 996 0 12 Feb 2020
Meta-learning framework with applications to zero-shot time-series forecasting Boris N. Oreshkin Dmitri Carpov Nicolas Chapados Yoshua Bengio UQCV AI4TS AI4CE 211 112 0 07 Feb 2020
Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting Bryan Lim Sercan O. Arik Nicolas Loeff Tomas Pfister AI4TS 122 1,470 0 19 Dec 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 485 20,317 0 23 Oct 2019
High-Dimensional Multivariate Forecasting with Low-Rank Gaussian Copula Processes David Salinas Michael Bohlke-Schneider Laurent Callot Roberto Medico Jan Gasthaus AI4TS 71 229 0 07 Oct 2019
Optuna: A Next-generation Hyperparameter Optimization Framework Takuya Akiba Shotaro Sano Toshihiko Yanase Takeru Ohta Masanori Koyama 668 5,839 0 25 Jul 2019
Unified Language Model Pre-training for Natural Language Understanding and Generation Li Dong Nan Yang Wenhui Wang Furu Wei Xiaodong Liu Yu Wang Jianfeng Gao M. Zhou H. Hon ELM AI4CE 227 1,560 0 08 May 2019
DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks David Salinas Valentin Flunkert Jan Gasthaus AI4TS UQCV BDL 87 2,127 0 13 Apr 2017