An Efficient Contrastive Unimodal Pretraining Method for EHR Time Series
Data

An Efficient Contrastive Unimodal Pretraining Method for EHR Time Series Data

11 October 2024

Bobak J. Mortazavi

Papers citing "An Efficient Contrastive Unimodal Pretraining Method for EHR Time Series Data"

13 / 13 papers shown

Title
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 111 347 0 18 Oct 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 149 931 0 11 May 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 806 29,167 0 26 Feb 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 524 40,739 0 22 Oct 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 319 18,686 0 13 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 349 42,299 0 03 Dec 2019
Time2Vec: Learning a Vector Representation of Time Seyed Mehran Kazemi Rishab Goel Sepehr Eghbali J. Ramanan Jaspreet Sahota Sanjay Thakur Stella Wu Cathal Smyth Pascal Poupart Marcus A. Brubaker AI4TS 64 342 0 11 Jul 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.4K 94,511 0 11 Oct 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 225 3,283 0 21 Mar 2018
Multitask learning and benchmarking with clinical time series data Hrayr Harutyunyan Hrant Khachatrian David C. Kale Greg Ver Steeg Aram Galstyan OOD AI4TS 149 872 0 22 Mar 2017
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 288 8,091 0 13 Aug 2016
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 62 5,287 0 25 Apr 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.4K 149,842 0 22 Dec 2014