Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data
Imputation

Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation

27 June 2024

Colin Samplawski

Benjamin M. Marlin

ArXiv (abs)PDF HTML

Papers citing "Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation"

12 / 12 papers shown

Title
SAITS: Self-Attention-based Imputation for Time Series Wenjie Du David Cote Yang Liu AI4TS 71 255 0 17 Feb 2022
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 463 21,564 0 25 Mar 2021
Deformable DETR: Deformable Transformers for End-to-End Object Detection Xizhou Zhu Weijie Su Lewei Lu Bin Li Xiaogang Wang Jifeng Dai ViT 240 5,098 0 08 Oct 2020
Efficient Transformers: A Survey Yi Tay Mostafa Dehghani Dara Bahri Donald Metzler VLM 159 1,125 0 14 Sep 2020
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 324 602 0 12 Mar 2020
Axial Attention in Multidimensional Transformers Jonathan Ho Nal Kalchbrenner Dirk Weissenborn Tim Salimans 110 533 0 20 Dec 2019
Generating Long Sequences with Sparse Transformers R. Child Scott Gray Alec Radford Ilya Sutskever 129 1,915 0 23 Apr 2019
BRITS: Bidirectional Recurrent Imputation for Time Series Wei Cao Dong Wang Jian Li Hao Zhou Lei Li Yitan Li AI4TS 53 623 0 27 May 2018
Towards Principled Methods for Training Generative Adversarial Networks Martín Arjovsky M. Nault GAN 83 2,112 0 17 Jan 2017
Instance Normalization: The Missing Ingredient for Fast Stylization Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky OOD 177 3,713 0 27 Jul 2016
Recurrent Neural Networks for Multivariate Time Series with Missing Values Zhengping Che S. Purushotham Kyunghyun Cho David Sontag Yan Liu AI4TS 310 1,945 0 06 Jun 2016
Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation Kyunghyun Cho B. V. Merrienboer Çağlar Gülçehre Dzmitry Bahdanau Fethi Bougares Holger Schwenk Yoshua Bengio AIMat 1.1K 23,388 0 03 Jun 2014