v1v2v3v4v5v6v7 (latest)

MS-RNN: A Flexible Multi-Scale Framework for Spatiotemporal Predictive Learning

7 June 2022

ArXiv (abs)PDF HTML Github (32★)

Papers citing "MS-RNN: A Flexible Multi-Scale Framework for Spatiotemporal Predictive Learning"

38 / 38 papers shown

Title
Shape Modeling of Longitudinal Medical Images: From Diffeomorphic Metric Mapping to Deep Learning Edwin Tay Nazli Tümer Amir A. Zadpoor MedIm 250 0 0 27 Mar 2025
Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation Tsu-Jui Fu Licheng Yu Ning Zhang Cheng-Yang Fu Jong-Chyi Su William Yang Wang Sean Bell VGen 128 38 0 23 Nov 2022
Earthformer: Exploring Space-Time Transformers for Earth System Forecasting Zhihan Gao Xingjian Shi Hao Wang Yi Zhu Yuyang Wang Mu Li Dit-Yan Yeung AI4TS 92 158 0 12 Jul 2022
MaskViT: Masked Visual Pre-Training for Video Prediction Agrim Gupta Stephen Tian Yunzhi Zhang Jiajun Wu Roberto Martín-Martín Li Fei-Fei 171 120 0 23 Jun 2022
Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformer Songwei Ge Thomas Hayes Harry Yang Xiaoyue Yin Guan Pang David Jacobs Jia-Bin Huang Devi Parikh ViT 133 223 0 07 Apr 2022
MoDeRNN: Towards Fine-grained Motion Details for Spatiotemporal Predictive Learning Zenghao Chai Zhengzhuo Xu Chun Yuan AI4TS 42 5 0 25 Oct 2021
SLAMP: Stochastic Latent Appearance and Motion Prediction Adil Kaan Akan Erkut Erdem Aykut Erdem Fatma Guney 51 40 0 05 Aug 2021
FitVid: Overfitting in Pixel-Level Video Prediction Mohammad Babaeizadeh M. Saffar Suraj Nair Sergey Levine Chelsea Finn D. Erhan VLM 107 84 0 24 Jun 2021
Multiscale Vision Transformers Haoqi Fan Bo Xiong K. Mangalam Yanghao Li Zhicheng Yan Jitendra Malik Christoph Feichtenhofer ViT 135 1,265 0 22 Apr 2021
VideoGPT: Video Generation using VQ-VAE and Transformers Wilson Yan Yunzhi Zhang Pieter Abbeel A. Srinivas ViT VGen 310 512 0 20 Apr 2021
Skillful Precipitation Nowcasting using Deep Generative Models of Radar Suman V. Ravuri Karel Lenc Matthew Willson D. Kangin Rémi R. Lam ... R. Hadsell Nial H. Robinson Ellen Clancy A. Arribas S. Mohamed AI4Cl 183 741 0 02 Apr 2021
Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning Sangmin Lee Hak Gu Kim Dae Hwi Choi Hyungil Kim Yong Man Ro 81 102 0 02 Apr 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 70 102 0 06 Mar 2021
MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motions Haixu Wu Zhiyu Yao J. Wan Mingsheng Long 70 129 0 03 Mar 2021
Broad-UNet: Multi-scale feature learning for nowcasting tasks Jesús García Fernández S. Mehrkanoon 62 68 0 12 Feb 2021
Interpreting Super-Resolution Networks with Local Attribution Maps Jinjin Gu Chao Dong FAtt SupR 64 220 0 22 Nov 2020
UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation Huimin Huang Lanfen Lin Ruofeng Tong Hongjie Hu Qiaowei Zhang Yutaro Iwamoto Xianhua Han Yenwei Chen Jian Wu SSeg 67 1,807 0 19 Apr 2020
MetNet: A Neural Weather Model for Precipitation Forecasting C. Sønderby L. Espeholt Jonathan Heek Mostafa Dehghani Avital Oliver Tim Salimans Shreya Agrawal Jason Hickey Nal Kalchbrenner AI4Cl 297 277 0 24 Mar 2020
Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Prediction Vincent Le Guen Nicolas Thome AI4CE PINN 157 291 0 03 Mar 2020
STConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for Weather Forecasting Rafaela C. Nascimento Y. M. Souto Eduardo S. Ogasawara Fábio Porto Eduardo Bezerra AI4TS 53 86 0 30 Nov 2019
High Fidelity Video Prediction with Large Stochastic Recurrent Neural Networks Ruben Villegas Arkanath Pathak Harini Kannan D. Erhan Quoc V. Le Honglak Lee VGen 66 139 0 05 Nov 2019
Low-Memory Neural Network Training: A Technical Report N. Sohoni Christopher R. Aberger Megan Leszczynski Jian Zhang Christopher Ré 63 102 0 24 Apr 2019
Res2Net: A New Multi-scale Backbone Architecture Shanghua Gao Ming-Ming Cheng Kai Zhao Xinyu Zhang Ming-Hsuan Yang Philip Torr 126 2,398 0 02 Apr 2019
Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamics Yunbo Wang Jianjin Zhang Hongyu Zhu Mingsheng Long Jianmin Wang Philip S Yu AI4TS 79 321 0 19 Nov 2018
End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion Mingmin Zhen Jinglu Wang Lei Zhou Jinbo Bi Tian Fang Long Quan GNN 68 597 0 11 Nov 2018
PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning Yunbo Wang Zhifeng Gao Mingsheng Long Jianmin Wang Philip S. Yu 135 476 0 17 Apr 2018
Relational Neural Expectation Maximization: Unsupervised Discovery of Objects and their Interactions Sjoerd van Steenkiste Michael Chang Klaus Greff Jürgen Schmidhuber BDL OCL DRL 209 292 0 28 Feb 2018
Stochastic Video Generation with a Learned Prior Emily L. Denton Rob Fergus VGen 100 526 0 21 Feb 2018
MoCoGAN: Decomposing Motion and Content for Video Generation Sergey Tulyakov Ming-Yuan Liu Xiaodong Yang Jan Kautz GAN 144 1,150 0 17 Jul 2017
Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model Xingjian Shi Zhihan Gao Leonard Lausen Hao Wang Dit-Yan Yeung W. Wong W. Woo 80 798 0 12 Jun 2017
Understanding the Effective Receptive Field in Deep Convolutional Neural Networks Wenjie Luo Yujia Li R. Urtasun R. Zemel HAI 102 1,803 0 15 Jan 2017
Feature Pyramid Networks for Object Detection Nayeon Lee Piotr Dollár Ross B. Girshick Kaiming He Bharath Hariharan Serge J. Belongie ObjD 488 22,158 0 09 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 522 10,351 0 16 Nov 2016
Deep Visual Foresight for Planning Robot Motion Chelsea Finn Sergey Levine 123 788 0 03 Oct 2016
Deep multi-scale video prediction beyond mean square error Michaël Mathieu Camille Couprie Yann LeCun GAN 130 1,882 0 17 Nov 2015
Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting Xingjian Shi Zhourong Chen Hao Wang Dit-Yan Yeung W. Wong W. Woo 568 8,007 0 13 Jun 2015
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks Samy Bengio Oriol Vinyals Navdeep Jaitly Noam M. Shazeer 152 2,039 0 09 Jun 2015
Unsupervised Learning of Video Representations using LSTMs Nitish Srivastava Elman Mansimov Ruslan Salakhutdinov SSL 150 2,593 0 16 Feb 2015