A Transformer-based Framework for Multivariate Time Series Representation Learning

6 October 2020

Papers citing "A Transformer-based Framework for Multivariate Time Series Representation Learning"

48 / 48 papers shown

Title
A Novel Hybrid Approach Using an Attention-Based Transformer + GRU Model for Predicting Cryptocurrency Prices Esam Mahdi C. Martin-Barreiro X. Cabezas AI4TS 67 0 0 23 Apr 2025
STaRFormer: Semi-Supervised Task-Informed Representation Learning via Dynamic Attention-Based Regional Masking for Sequential Data Maxmilian Forstenhäusler Daniel Külzer Christos Anagnostopoulos Shameem Puthiya Parambath Natascha Weber AI4TS MedIm 76 0 0 14 Apr 2025
Evaluation of (Un-)Supervised Machine Learning Methods for GNSS Interference Classification with Real-World Data Discrepancies Lucas Heublein Nisha Lakshmana Raichur Tobias Feigl Tobias Brieger Fin Heuer Lennart Asbach A. Rügamer Felix Ott 91 7 0 31 Mar 2025
Deep Learning for Time Series Forecasting: A Survey X. Kong Zhenghao Chen Weiyao Liu Kaili Ning Lechao Zhang Syauqie Muhammad Marier Yichen Liu Yuhao Chen Feng Xia AI4TS AI4CE 68 4 0 13 Mar 2025
dFLMoE: Decentralized Federated Learning via Mixture of Experts for Medical Data Analysis Luyuan Xie Tianyu Luan Wenyuan Cai Guochen Yan Zhaoyu Chen Nan Xi Yuejian Fang Qingni Shen Zhonghai Wu Junsong Yuan FedML 105 0 0 13 Mar 2025
Simpler Fast Vision Transformers with a Jumbo CLS Token A. Fuller Yousef Yassin Daniel G. Kyrollos Evan Shelhamer James R. Green 108 0 0 20 Feb 2025
Swarm Characteristics Classification Using Neural Networks Donald W. Peltier Isaac Kaminer Abram H. Clark Marko Orescanin 45 1 0 20 Feb 2025
Structure-preserving contrastive learning for spatial time series Yiru Jiao Sander van Cranenburgh Simeon C. Calvert H. Lint AI4TS 113 0 0 10 Feb 2025
Unifying Prediction and Explanation in Time-Series Transformers via Shapley-based Pretraining Qisen Cheng Jinming Xing Chang Xue Xiaoran Yang AI4TS 52 3 0 28 Jan 2025
Algorithm Selection with Probing Trajectories: Benchmarking the Choice of Classifier Model Quentin Renau E. Hart 45 0 0 20 Jan 2025
Human Arm Pose Estimation with a Shoulder-worn Force-Myography Device for Human-Robot Interaction Rotem Atari Eran Bamani A. Sintov 80 0 0 12 Nov 2024
Repurposing Foundation Model for Generalizable Medical Time Series Classification Nan Huang Haishuai Wang Zihuai He Marinka Zitnik Xiang Zhang AI4TS OOD 36 2 0 03 Oct 2024
Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts Xiaoming Shi Shiyu Wang Yuqi Nie Dianqi Li Zhou Ye Qingsong Wen Ming Jin AI4TS 59 37 0 24 Sep 2024
Multiple-Resolution Tokenization for Time Series Forecasting with an Application to Pricing Egon Persak Miguel F. Anjos Sebastian Lautz Aleksandar Kolev AI4TS 50 0 0 03 Jul 2024
SoMeR: Multi-View User Representation Learning for Social Media Siyi Guo Keith Burghardt Valeria Pante Kristina Lerman AI4TS 54 0 0 02 May 2024
DACAD: Domain Adaptation Contrastive Learning for Anomaly Detection in Multivariate Time Series Zahra Zamanzadeh Darban Yiyuan Yang Geoffrey I. Webb Charu C. Aggarwal Qingsong Wen Xiaojun Jia Mahsa Salehi 69 0 0 17 Apr 2024
Unsupervised Multi-modal Feature Alignment for Time Series Representation Learning Cheng Liang Donghua Yang Zhiyu Liang Hongzhi Wang Zheng Liang Xiyang Zhang Jianfeng Huang AI4TS 309 1 0 09 Dec 2023
P-Transformer: A Prompt-based Multimodal Transformer Architecture For Medical Tabular Data Y. Ruan Xiang Lan Daniel J. Tan H. Abdullah Mengling Feng LMTD MedIm 73 1 0 30 Mar 2023
MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classification Angus Dempster Daniel F. Schmidt Geoffrey I. Webb AI4TS 55 359 0 16 Dec 2020
Monash University, UEA, UCR Time Series Extrinsic Regression Archive Chang Wei Tan Christoph Bergmeir F. Petitjean Geoffrey I. Webb AI4TS 48 24 0 19 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 313 41,106 0 28 May 2020
Longformer: The Long-Document Transformer Iz Beltagy Matthew E. Peters Arman Cohan RALM VLM 59 3,996 0 10 Apr 2020
Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case Neo Wu Bradley Green X. Ben S. O’Banion AI4TS 26 448 0 23 Jan 2020
Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecasting Bryan Lim Sercan O. Arik Nicolas Loeff Tomas Pfister AI4TS 76 1,427 0 19 Dec 2019
ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernels Angus Dempster Franccois Petitjean Geoffrey I. Webb AI4TS 60 763 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 175 19,824 0 23 Oct 2019
Mixture-of-Experts Variational Autoencoder for Clustering and Generating from Similarity-Based Representations on Single Cell Data Andreas Kopf Vincent Fortuin Vignesh Ram Somnath Manfred Claassen DRL 23 12 0 17 Oct 2019
InceptionTime: Finding AlexNet for Time Series Classification Hassan Ismail Fawaz Benjamin Lucas Germain Forestier Charlotte Pelletier Daniel F. Schmidt J. Weber Geoffrey I. Webb L. Idoumghar Pierre-Alain Muller Franccois Petitjean AI4TS 125 1,083 0 11 Sep 2019
On the Variance of the Adaptive Learning Rate and Beyond Liyuan Liu Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao Jiawei Han ODL 77 1,894 0 08 Aug 2019
Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting Shiyang Li Xiaoyong Jin Yao Xuan Xiyou Zhou Wenhu Chen Yu Wang Xifeng Yan AI4TS 40 1,398 0 29 Jun 2019
TS-CHIEF: A Scalable and Accurate Forest Algorithm for Time Series Classification Ahmed Shifaz Charlotte Pelletier F. Petitjean Geoffrey I. Webb AI4TS 40 183 0 25 Jun 2019
GRU-ODE-Bayes: Continuous modeling of sporadically-observed time series E. Brouwer Jaak Simm Adam Arany Yves Moreau SyDa CML AI4TS 57 292 0 29 May 2019
CDSA: Cross-Dimensional Self-Attention for Multivariate, Geo-tagged Time Series Imputation Jiawei Ma Zheng Shou Alireza Zareian Hassan Mansour A. Vetro Shih-Fu Chang AI4TS 33 62 0 23 May 2019
Unsupervised Scalable Representation Learning for Multivariate Time Series Jean-Yves Franceschi Aymeric Dieuleveut Martin Jaggi SSL AI4TS 32 449 0 30 Jan 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 75 3,707 0 09 Jan 2019
Improving Clinical Predictions through Unsupervised Time Series Representation Learning Xinrui Lyu Matthias Huser Stephanie L. Hyland George Zerveas Gunnar Rätsch SSL OOD AI4TS 25 43 0 02 Dec 2018
A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data Chuxu Zhang Dongjin Song Yuncong Chen Xinyang Feng C. Lumezanu Wei Cheng Jingchao Ni Bo Zong Haifeng Chen Nitesh Chawla AI4TS 89 694 0 20 Nov 2018
The UEA multivariate time series classification archive, 2018 A. Bagnall Hoang Anh Dau Jason Lines Michael Flynn J. Large A. Bostrom Paul Southam Eamonn Keogh AI4TS 29 415 0 31 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 575 93,936 0 11 Oct 2018
Deep learning for time series classification: a review Hassan Ismail Fawaz Germain Forestier J. Weber L. Idoumghar Pierre-Alain Muller AI4TS AI4CE 183 2,668 0 12 Sep 2018
Music Transformer Cheng-Zhi Anna Huang Ashish Vaswani Jakob Uszkoreit Noam M. Shazeer Ian Simon Curtis Hawthorne Andrew M. Dai Matthew D. Hoffman Monica Dinculescu Douglas Eck 117 478 0 12 Sep 2018
Proximity Forest: An effective and scalable distance-based classifier for time series Benjamin Lucas Ahmed Shifaz Charlotte Pelletier Lachlan O’Neill Nayyar Zaidi Bart Goethals F. Petitjean Geoffrey I. Webb AI4TS 83 164 0 31 Aug 2018
SOM-VAE: Interpretable Discrete Representation Learning on Time Series Vincent Fortuin Matthias Huser Francesco Locatello Heiko Strathmann Gunnar Rätsch BDL AI4TS 44 139 0 06 Jun 2018
Unsupervised Learning of Semantic Audio Representations A. Jansen Manoj Plakal R. Pandya D. Ellis Shawn Hershey Jiayang Liu R. C. Moore Rif A. Saurous SSL 59 131 0 06 Nov 2017
TimeNet: Pre-trained deep recurrent neural network for time series classification Pankaj Malhotra T. Vishnu Lovekesh Vig Puneet Agarwal Gautam M. Shroff AI4TS 34 170 0 23 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 221 129,831 0 12 Jun 2017
Similarity Preserving Representation Learning for Time Series Clustering Qi Lei Jinfeng Yi Roman Vaculin Lingfei Wu Inderjit S. Dhillon AI4TS 13 24 0 12 Feb 2017
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 82 5,318 0 21 Nov 2012