Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistency

17 June 2022

Xiang Zhang

Ziyuan Zhao

Theodoros Tsiligkaridis

Marinka Zitnik

AI4TS

ArXiv PDF HTML

Papers citing "Self-Supervised Contrastive Pre-Training For Time Series via Time-Frequency Consistency"

50 / 145 papers shown

Title
TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification Md. Atik Ahamed Qiang Cheng Mamba 66 1 0 06 Jun 2024
Dominant Shuffle: A Simple Yet Powerful Data Augmentation for Time-series Prediction Kai Zhao Zuojie He A. Hung Dan Zeng AI4TS 52 1 0 26 May 2024
Medformer: A Multi-Granularity Patching Transformer for Medical Time-Series Classification Yihe Wang Nan Huang Taida Li Yujun Yan Xiang Zhang MedIm AI4TS 35 21 0 24 May 2024
ROSE: Register Assisted General Time Series Forecasting with Decomposed Frequency Learning Yihang Wang Yuying Qiu Peng Chen Kai Zhao Yang Shu Zhongwen Rao Lujia Pan Bin Yang Chenjuan Guo AI4TS AI4CE 36 10 0 24 May 2024
Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting Qingxiang Liu Xu Liu Chenghao Liu Qingsong Wen Keli Zhang AI4TS AI4CE 48 6 0 23 May 2024
UniCL: A Universal Contrastive Learning Framework for Large Time Series Models Jiawei Li Jingshu Peng Haoyang Li Lei Chen AI4TS 48 3 0 17 May 2024
LaT-PFN: A Joint Embedding Predictive Architecture for In-context Time-series Forecasting Stijn Verdenius Andrea Zerio Roy L.M. Wang BDL AI4TS AI4CE 34 2 0 16 May 2024
Beyond Unimodal Learning: The Importance of Integrating Multiple Modalities for Lifelong Learning F. Sarfraz Bahram Zonooz Elahe Arani CLL 34 2 0 04 May 2024
EEG-MACS: Manifold Attention and Confidence Stratification for EEG-based Cross-Center Brain Disease Diagnosis under Unreliable Annotations Zhenxi Song Ruihan Qin Huixia Ren Zhen Liang Yi Guo Min Zhang Zhiguo Zhang 21 1 0 29 Apr 2024
HCL-MTSAD: Hierarchical Contrastive Consistency Learning for Accurate Detection of Industrial Multivariate Time Series Anomalies Haili Sun Yan-Ming Huang Lansheng Han Cai Fu Chunjie Zhou 36 0 0 12 Apr 2024
Multi-Modal Contrastive Learning for Online Clinical Time-Series Applications Fabian Baldenweg Manuel Burger Gunnar Rätsch Rita Kuznetsova AI4TS 41 0 0 27 Mar 2024
Foundation Models for Time Series Analysis: A Tutorial and Survey Keli Zhang Haomin Wen Yuqi Nie Yushan Jiang Ming Jin Dongjin Song Shirui Pan Qingsong Wen AI4TS AI4CE 91 116 0 21 Mar 2024
Automated Contrastive Learning Strategy Search for Time Series Baoyu Jing Yansen Wang Guoxin Sui Jing Hong Jingrui He Yuqing Yang Dongsheng Li Kan Ren AI4TS 32 6 0 19 Mar 2024
From Pixels to Predictions: Spectrogram and Vision Transformer for Better Time Series Forecasting Zhen Zeng Rachneet Kaur S. Siddagangappa T. Balch Manuela Veloso AI4TS 19 5 0 17 Mar 2024
Self-Supervised Learning for Time Series: Contrastive or Generative? Ziyu Liu Azadeh Alavi Minyi Li Xiang Zhang AI4TS 56 7 0 14 Mar 2024
Dataset Condensation for Time Series Classification via Dual Domain Matching Zhanyu Liu Ke Hao Guanjie Zheng Yanwei Yu DD 69 5 0 12 Mar 2024
$$\textbf{S}^2$IP-LLM: Semantic Space Informed Prompt Learning with LLM for Time Series Forecasting$ $\textbf{S}^2$ IP-LLM: Semantic Space Informed Prompt Learning with LLM for Time Series Forecasting Zijie Pan Yushan Jiang Sahil Garg Anderson Schneider Yuriy Nevmyvaka Dongjin Song AI4TS 47 6 0 09 Mar 2024
Spectral Invariant Learning for Dynamic Graphs under Distribution Shifts Zeyang Zhang Xin Wang Ziwei Zhang Zhou Qin Weigao Wen Hui Xue Haoyang Li Wenwu Zhu OOD 37 17 0 08 Mar 2024
Evaluating Large Language Models as Virtual Annotators for Time-series Physical Sensing Data Aritra Hota S. Chatterjee Sandip Chakraborty 32 11 0 02 Mar 2024
UNITS: A Unified Multi-Task Time Series Model Shanghua Gao Teddy Koker Owen Queen Thomas Hartvigsen Theodoros Tsiligkaridis Marinka Zitnik AI4TS 38 17 0 29 Feb 2024
United We Pretrain, Divided We Fail! Representation Learning for Time Series by Pretraining on 75 Datasets at Once Maurice Kraus Felix Divo David Steinmann Devendra Singh Dhami Kristian Kersting AI4TS 36 0 0 23 Feb 2024
E2USD: Efficient-yet-effective Unsupervised State Detection for Multivariate Time Series Zhichen Lai Huan Li Dalin Zhang Yan Zhao Weizhu Qian Christian S. Jensen AI4TS 32 9 0 21 Feb 2024
EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputs Navid Mohammadi Foumani G. Mackellar Soheila Ghane Saad Irtza Nam Nguyen Mahsa Salehi 20 14 0 17 Feb 2024
Parametric Augmentation for Time Series Contrastive Learning Xu Zheng Tianchun Wang Wei Cheng Aitian Ma Haifeng Chen Mo Sha Dongsheng Luo AI4TS 27 13 0 16 Feb 2024
Bidirectional Generative Pre-training for Improving Time Series Representation Learning Ziyang Song Qincheng Lu He Zhu Yue Li AI4TS 22 3 0 14 Feb 2024
Multi-Patch Prediction: Adapting LLMs for Time Series Representation Learning Hao Wang Xu Ju Jiangtong Li Zhijian Xu Dawei Cheng Qiang Xu AI4TS KELM 38 19 0 07 Feb 2024
TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling Jiaxiang Dong Haixu Wu Yuxuan Wang Yunzhong Qiu Li Zhang Jianmin Wang Mingsheng Long AI4TS 23 13 0 04 Feb 2024
Timer: Generative Pre-trained Transformers Are Large Time Series Models Yong Liu Haoran Zhang Chenyu Li Xiangdong Huang Jianmin Wang Mingsheng Long AIFin AI4TS AI4CE 39 50 0 04 Feb 2024
SudokuSens: Enhancing Deep Learning Robustness for IoT Sensing Applications using a Generative Approach Tianshi Wang Jinyang Li Ruijie Wang Denizhan Kara Shengzhong Liu Davis Wertheimer Antoni Viros i Martin R. Ganti M. Srivatsa Tarek F. Abdelzaher 22 6 0 03 Feb 2024
Rethinking the Starting Point: Collaborative Pre-Training for Federated Downstream Tasks Yun-Wei Chu Dong-Jun Han Seyyedali Hosseinalipour Christopher G. Brinton AI4CE FedML 35 1 0 03 Feb 2024
Rank Supervised Contrastive Learning for Time Series Classification Qianying Ren Dongsheng Luo Dongjin Song AI4TS 29 2 0 31 Jan 2024
Distillation Enhanced Time Series Forecasting Network with Momentum Contrastive Learning Haozhi Gao Qianqian Ren Jinbao Li AI4TS 29 2 0 31 Jan 2024
HiMTM: Hierarchical Multi-Scale Masked Time Series Modeling for Long-Term Forecasting Shubao Zhao Ming Jin Zhaoxiang Hou Che-Sheng Yang Zengxiang Li Qingsong Wen Yi Wang 30 2 0 10 Jan 2024
Self-supervised Learning for Electroencephalogram: A Systematic Survey Weining Weng Yang Gu Shuai Guo Yuan Ma Zhaohua Yang Yuchen Liu Yiqiang Chen 38 12 0 09 Jan 2024
Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series Vijay Ekambaram Arindam Jati Pankaj Dayama Sumanta Mukherjee Nam H. Nguyen Wesley M. Gifford Chandra Reddy Jayant Kalagnanam AI4TS VLM 38 21 0 08 Jan 2024
Universal Time-Series Representation Learning: A Survey Patara Trirat Yooju Shin Junhyeok Kang Youngeun Nam Jihye Na Minyoung Bae Joeun Kim Byunghyun Kim Jae-Gil Lee AI4TS 75 15 0 08 Jan 2024
Learning to Embed Time Series Patches Independently Seunghan Lee Taeyoung Park Kibok Lee SSL AI4TS 28 27 0 27 Dec 2023
Soft Contrastive Learning for Time Series Seunghan Lee Taeyoung Park Kibok Lee AI4TS 27 19 0 27 Dec 2023
TimeDRL: Disentangled Representation Learning for Multivariate Time-Series Ching Chang Chiao-Tung Chan Wei-Yao Wang Wenjie Peng Tien-Fu Chen AI4TS 26 2 0 07 Dec 2023
Series2Vec: Similarity-based Self-supervised Representation Learning for Time Series Classification Navid Mohammadi Foumani Chang Wei Tan Geoffrey I. Webb Hamid Rezatofighi Mahsa Salehi SSL AI4TS 33 5 0 07 Dec 2023
Multi-Scale and Multi-Modal Contrastive Learning Network for Biomedical Time Series Hongbo Guo Xinzi Xu Hao Wu Guoxing Wang AI4TS 21 1 0 06 Dec 2023
ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal Imputation Tong Nie Guoyang Qin Wei Ma Yuewen Mei Jiangming Sun AI4TS AI4CE 29 25 0 04 Dec 2023
Disentangling the Effects of Data Augmentation and Format Transform in Self-Supervised Learning of Image Representations Neha Kalibhat Warren Morningstar Alex Bijamov Luyang Liu Karan Singhal Philip Mansfield 33 2 0 02 Dec 2023
A Supervised Contrastive Learning Pretrain-Finetune Approach for Time Series Trang H. Tran Lam M. Nguyen Kyongmin Yeo Nam H. Nguyen Roman Vaculin AI4TS 24 0 0 21 Nov 2023
Large Pre-trained time series models for cross-domain Time series analysis tasks Harshavardhan Kamarthi B. A. Prakash VLM AI4TS 15 10 0 19 Nov 2023
PEMS: Pre-trained Epidemic Time-series Models Harshavardhan Kamarthi B. A. Prakash AI4TS 29 2 0 14 Nov 2023
Deep Double Descent for Time Series Forecasting: Avoiding Undertrained Models Valentino Assandri Sam Heshmati Burhaneddin Yaman Anton Iakovlev Ariel Emiliano Repetur 47 0 0 02 Nov 2023
COSTAR: Improved Temporal Counterfactual Estimation with Self-Supervised Learning Chuizheng Meng Yihe Dong Sercan Ö. Arik Yan Liu Tomas Pfister CML AI4TS 29 0 0 01 Nov 2023
REBAR: Retrieval-Based Reconstruction for Time-series Contrastive Learning Maxwell A. Xu Alexander Moreno Hui Wei Benjamin M. Marlin James M. Rehg AI4TS SSL 34 11 0 01 Nov 2023
FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Space Shengzhong Liu Tomoyoshi Kimura Dongxin Liu Ruijie Wang Jinyang Li Suhas Diggavi Mani B. Srivastava Tarek F. Abdelzaher AI4TS 51 24 0 30 Oct 2023