v1v2 (latest)

A Survey of Time Series Foundation Models: Generalizing Time Series Representation with Large Language Model

3 May 2024

ArXiv (abs)PDF HTML Github (145★)

Papers citing "A Survey of Time Series Foundation Models: Generalizing Time Series Representation with Large Language Model"

50 / 56 papers shown

Title
Performance of Zero-Shot Time Series Foundation Models on Cloud Data William Toner Thomas L. Lee Artjom Joosen Rajkarn Singh Martin Asenov AI4TS 129 2 0 18 Feb 2025
Repurposing Foundation Model for Generalizable Medical Time Series Classification Nan Huang Haishuai Wang Zihuai He Marinka Zitnik Xiang Zhang AI4TS OOD 89 3 0 03 Oct 2024
CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following Kaiyan Zhang Jianyu Wang Ermo Hua Biqing Qi Ning Ding Bowen Zhou SyDa 91 22 0 05 Mar 2024
Only the Curve Shape Matters: Training Foundation Models for Zero-Shot Multivariate Time Series Forecasting through Next Curve Shape Prediction Cheng Feng Long Huang Denis Krompass AI4TS 90 5 0 12 Feb 2024
Utilizing Language Models for Energy Load Forecasting Hao Xue Flora D. Salim 52 12 0 26 Oct 2023
Large Language Models Are Zero-Shot Time Series Forecasters Nate Gruver Marc Finzi Shikai Qiu Andrew Gordon Wilson AI4TS 95 370 0 11 Oct 2023
Where Would I Go Next? Large Language Models as Human Mobility Predictors Xinglei Wang Meng Fang Zichao Zeng Tao Cheng 54 59 0 29 Aug 2023
TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Series Chenxi Sun Hongyan Li Yaliang Li linda Qiao AI4TS 89 129 0 16 Aug 2023
Foundational Models Defining a New Era in Vision: A Survey and Outlook Muhammad Awais Muzammal Naseer Salman Khan Rao Muhammad Anwer Hisham Cholakkal M. Shah Ming-Hsuan Yang Fahad Shahbaz Khan VLM 128 125 0 25 Jul 2023
Temporal Data Meets LLM -- Explainable Financial Time Series Forecasting Xinli Yu Zheng Chen Yuan Ling Shujing Dong Zongying Liu Yanbin Lu AIFin AI4TS 172 78 0 19 Jun 2023
Warpformer: A Multi-scale Modeling Approach for Irregular Clinical Time Series Jiawen Zhang Shun Zheng Wei Cao Jiang Bian Jia Li AI4TS 60 30 0 14 Jun 2023
Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictors Yong Liu Chenyu Li Jianmin Wang Mingsheng Long AI4TS 86 119 0 30 May 2023
Interpretation of Time-Series Deep Models: A Survey Ziqi Zhao Yucheng Shi Shushan Wu Fan Yang Wenzhan Song Ninghao Liu AI4TS 88 7 0 23 May 2023
Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning Vladislav Lialin Vijeta Deshpande Anna Rumshisky 100 177 0 28 Mar 2023
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 408 2,393 0 09 Nov 2022
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? Thomas Wang Adam Roberts Daniel Hesslow Teven Le Scao Hyung Won Chung Iz Beltagy Julien Launay Colin Raffel 118 176 0 12 Apr 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 529 6,293 0 05 Apr 2022
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? Sewon Min Xinxi Lyu Ari Holtzman Mikel Artetxe M. Lewis Hannaneh Hajishirzi Luke Zettlemoyer LLMAG LRM 187 1,498 0 25 Feb 2022
FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting Tian Zhou Ziqing Ma Qingsong Wen Xue Wang Liang Sun Rong Jin AI4TS 254 1,438 0 30 Jan 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 477 7,827 0 11 Nov 2021
Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training Yongbin Li Hongxin Liu Zhengda Bian Boxiang Wang Haichen Huang Fan Cui Chuan-Qing Wang Yang You GNN 92 148 0 28 Oct 2021
Towards a Unified View of Parameter-Efficient Transfer Learning Junxian He Chunting Zhou Xuezhe Ma Taylor Berg-Kirkpatrick Graham Neubig AAML 137 953 0 08 Oct 2021
Darts: User-Friendly Modern Machine Learning for Time Series J. Herzen Francesco Lässig Samuele Giuliano Piazzetta T. Neuer Léo Tafti ... Mounir Benheddi Camila Williamson Michal Kosinskihttps://www.semanticscholar.org/me/account M. Petrik Gaël Grosch AI4TS 198 221 0 07 Oct 2021
Named Entity Recognition and Classification on Historical Documents: A Survey Maud Ehrmann Ahmed Hamdi Elvys Linhares Pontes Matteo Romanello A. Doucet 104 112 0 23 Sep 2021
Merlion: A Machine Learning Library for Time Series Aadyot Bhatnagar Paul Kassianik Chenghao Liu Tian-Shing Lan Wenzhuo Yang ... Yingbo Zhou Caiming Xiong Silvio Savarese Guosheng Lin Huan Wang AI4TS 64 34 0 20 Sep 2021
Finetuned Language Models Are Zero-Shot Learners Jason W. Wei Maarten Bosma Vincent Zhao Kelvin Guu Adams Wei Yu Brian Lester Nan Du Andrew M. Dai Quoc V. Le ALM UQCV 246 3,789 0 03 Sep 2021
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 360 636 0 14 Jul 2021
A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers Shen-Yun Miao Chao-Chun Liang Keh-Yih Su 76 342 0 30 Jun 2021
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting Haixu Wu Jiehui Xu Jianmin Wang Mingsheng Long AI4TS 113 2,296 0 24 Jun 2021
LoRA: Low-Rank Adaptation of Large Language Models J. E. Hu Yelong Shen Phillip Wallis Zeyuan Allen-Zhu Yuanzhi Li Shean Wang Lu Wang Weizhu Chen OffRL AI4TS AI4CE ALM AIMat 502 10,526 0 17 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 149 858 0 14 Jun 2021
Monash Time Series Forecasting Archive Rakshitha Godahewa Christoph Bergmeir Geoffrey I. Webb Rob J. Hyndman Pablo Montero-Manso AI4TS 72 162 0 14 May 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 589 4,093 0 18 Apr 2021
Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Survey Thomas Rojat Raphael Puget David Filliat Javier Del Ser R. Gelin Natalia Díaz Rodríguez XAI AI4TS 97 135 0 02 Apr 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 420 5,000 0 24 Feb 2021
Prefix-Tuning: Optimizing Continuous Prompts for Generation Xiang Lisa Li Percy Liang 252 4,305 0 01 Jan 2021
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning Armen Aghajanyan Luke Zettlemoyer Sonal Gupta 110 571 1 22 Dec 2020
Graph Contrastive Learning with Adaptive Augmentation Yanqiao Zhu Yichen Xu Feng Yu Qiang Liu Shu Wu Liang Wang 89 1,114 0 27 Oct 2020
How to Build a Graph-Based Deep Learning Architecture in Traffic Domain: A Survey Jiexia Ye Juanjuan Zhao Kejiang Ye Chengzhong Xu GNN AI4TS AI4CE 71 197 0 24 May 2020
Time Series Data Augmentation for Deep Learning: A Survey Qingsong Wen Liang Sun Fan Yang Xiaomin Song Jing Gao Xue Wang Huan Xu AI4TS 93 645 0 27 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 638 4,921 0 23 Jan 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 488 20,342 0 23 Oct 2019
Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI Alejandro Barredo Arrieta Natalia Díaz Rodríguez Javier Del Ser Adrien Bennetot Siham Tabik ... S. Gil-Lopez Daniel Molina Richard Benjamins Raja Chatila Francisco Herrera XAI 130 6,321 0 22 Oct 2019
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism Mohammad Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 336 1,918 0 17 Sep 2019
GluonTS: Probabilistic Time Series Models in Python A. Alexandrov Konstantinos Benidis Michael Bohlke-Schneider Valentin Flunkert Jan Gasthaus ... David Salinas J. Schulz Lorenzo Stella Ali Caner Türkmen Bernie Wang BDL AI4TS 48 115 0 12 Jun 2019
Global Explanations of Neural Networks: Mapping the Landscape of Predictions Mark Ibrahim Melissa Louie C. Modarres John Paisley FAtt 77 118 0 06 Feb 2019
The UEA multivariate time series classification archive, 2018 A. Bagnall Hoang Anh Dau Jason Lines Michael Flynn J. Large A. Bostrom Paul Southam Eamonn Keogh AI4TS 184 429 0 31 Oct 2018
The UCR Time Series Archive Hoang Anh Dau A. Bagnall Kaveh Kamgar Chin-Chia Michael Yeh Yan Zhu Shaghayegh Gharghabi C. Ratanamahatana Eamonn Keogh 66 832 0 17 Oct 2018
Deep learning for time series classification: a review Hassan Ismail Fawaz Germain Forestier J. Weber L. Idoumghar Pierre-Alain Muller AI4TS AI4CE 350 2,703 0 12 Sep 2018
Techniques for Interpretable Machine Learning Mengnan Du Ninghao Liu Helen Zhou FaML 93 1,092 0 31 Jul 2018