Self-Supervised Learning of Time Series Representation via Diffusion Process and Imputation-Interpolation-Forecasting Mask

9 May 2024

Vilhelm von Ehrenheim

DiffM

AI4TS

ArXiv PDF HTML

Papers citing "Self-Supervised Learning of Time Series Representation via Diffusion Process and Imputation-Interpolation-Forecasting Mask"

30 / 30 papers shown

Title
Transformer representation learning is necessary for dynamic multi-modal physiological data on small-cohort patients Bingxu Wang Kunzhi Cai Yuqi Zhang Yachong Guo Zeyi Zhou Wenjiao Li Yachong Guo Wei Wang Qing Zhou MedIm 83 0 0 05 Apr 2025
Human2Robot: Learning Robot Actions from Paired Human-Robot Videos Sicheng Xie Haidong Cao Zejia Weng Zhen Xing Shiwei Shen Jiaqi Leng Xipeng Qiu Yanwei Fu Zuxuan Wu Yu Jiang 103 0 0 23 Feb 2025
MHCCL: Masked Hierarchical Cluster-Wise Contrastive Learning for Multivariate Time Series Qianwen Meng Hangwei Qian Yong Liu Li-zhen Cui Yonghui Xu Zhiqi Shen AI4TS 45 35 0 02 Dec 2022
Less Is More: Fast Multivariate Time Series Forecasting with Light Sampling-oriented MLP Structures Tianze Zhang Yizhuo Zhang Wei Cao Jiang Bian Xiaohan Yi Shun Zheng Jian Li BDL AI4TS 122 164 0 04 Jul 2022
Self-Supervised Time Series Representation Learning via Cross Reconstruction Transformer Wen-Rang Zhang Ling Yang Shijia Geng Shenda Hong ViT AI4TS 43 43 0 20 May 2022
SAITS: Self-Attention-based Imputation for Time Series Wenjie Du David Cote Yang Liu AI4TS 56 248 0 17 Feb 2022
Unsupervised Time-Series Representation Learning with Iterative Bilinear Temporal-Spectral Fusion Ling Yang linda Qiao AI4TS 52 121 0 08 Feb 2022
An Empirical Study of Graph Contrastive Learning Yanqiao Zhu Yichen Xu Qiang Liu Shu Wu 55 172 0 02 Sep 2021
CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputation Y. Tashiro Jiaming Song Yang Song Stefano Ermon BDL DiffM 45 539 0 07 Jul 2021
Supporting Clustering with Contrastive Learning Dejiao Zhang Feng Nan Xiaokai Wei Shang-Wen Li Henghui Zhu Kathleen McKeown Ramesh Nallapati Andrew O. Arnold Bing Xiang SSL 66 200 0 24 Mar 2021
Maximum Likelihood Training of Score-Based Diffusion Models Yang Song Conor Durkan Iain Murray Stefano Ermon DiffM 122 657 0 22 Jan 2021
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 292 6,409 0 26 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 245 4,036 0 20 Nov 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 213 4,070 0 17 Jun 2020
Improved Techniques for Training Score-Based Generative Models Yang Song Stefano Ermon DiffM 195 1,145 0 16 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 121 1,612 0 15 Jun 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 132 971 0 11 May 2020
Uncertainty-Aware Variational-Recurrent Imputation Network for Clinical Time Series A. Mulyadi E. Jun Heung-Il Suk BDL 76 59 0 02 Mar 2020
Transformer Hawkes Process Simiao Zuo Haoming Jiang Zichong Li T. Zhao H. Zha AI4TS 63 292 0 21 Feb 2020
Multivariate Probabilistic Time Series Forecasting via Conditioned Normalizing Flows Kashif Rasul Abdul-Saboor Sheikh Ingmar Schuster Urs M. Bergmann Roland Vollgraf BDL AI4TS AI4CE 89 185 0 14 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 325 18,721 0 13 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 361 42,299 0 03 Dec 2019
ConCare: Personalized Clinical Feature Embedding via Capturing the Healthcare Context Liantao Ma Chaohe Zhang Yasha Wang Wenjie Ruan Jiantao Wang Wen Tang Xinyu Ma Xin Gao Junyi Gao 51 155 0 27 Nov 2019
Generative Modeling by Estimating Gradients of the Data Distribution Yang Song Stefano Ermon SyDa DiffM 213 3,870 0 12 Jul 2019
Self-supervised Visual Feature Learning with Deep Neural Networks: A Survey Longlong Jing Yingli Tian SSL 108 1,697 0 16 Feb 2019
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning Stefan Elfwing E. Uchibe Kenji Doya 114 1,717 0 10 Feb 2017
Recurrent Neural Networks for Multivariate Time Series with Missing Values Zhengping Che S. Purushotham Kyunghyun Cho David Sontag Yan Liu AI4TS 305 1,934 0 06 Jun 2016
Unsupervised Deep Embedding for Clustering Analysis Junyuan Xie Ross B. Girshick Ali Farhadi SSL 79 2,869 0 19 Nov 2015
Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Narain Sohl-Dickstein Eric A. Weiss Niru Maheswaranathan Surya Ganguli SyDa DiffM 252 6,887 0 12 Mar 2015
Network In Network Min Lin Qiang Chen Shuicheng Yan 273 6,274 0 16 Dec 2013