MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation

19 May 2022

Vikram S. Voleti

Alexia Jolicoeur-Martineau

Papers citing "MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation"

50 / 87 papers shown

Title
Long-Context Autoregressive Video Modeling with Next-Frame Prediction Yuchao Gu Weijia Mao Mike Zheng Shou VGen 148 5 0 25 Mar 2025
DiffusedWrinkles: A Diffusion-Based Model for Data-Driven Garment Animation R. Vidaurre Elena Garces Dan Casas DiffM AI4CE 112 1 0 24 Mar 2025
ScalingNoise: Scaling Inference-Time Search for Generating Infinite Videos Haolin Yang Feilong Tang Ming Hu Yulong Li Junjie Guo ... Zelin Peng Junjun He Junjun He Zongyuan Ge Imran Razzak DiffM VGen 217 2 0 20 Mar 2025
EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation Zihao Zhang Haoran Chen Haoyu Zhao Guansong Lu Yanwei Fu Hang Xu Zuxuan Wu VGen DiffM 117 2 0 20 Mar 2025
FreqPrior: Improving Video Diffusion Models with Frequency Filtering Gaussian Noise Yunlong Yuan Yuanfan Guo Chunwei Wang Wei Zhang Hang Xu L. Zhang DiffM VGen 171 3 0 20 Feb 2025
Text2Data: Low-Resource Data Generation with Textual Control Shiyu Wang Yihao Feng Tian Lan Ning Yu Yu Bai Ran Xu Han Wang Caiming Xiong Siyang Song DiffM 112 0 0 03 Jan 2025
Navigation World Models Amir Bar G. Zhou Danny Tran Trevor Darrell Yann LeCun VGen EgoV 138 26 0 04 Dec 2024
Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharing Kaifeng Gao Jiaxin Shi Hanwang Zhang Chunping Wang Jun Xiao Long Chen VGen DiffM 160 2 0 25 Nov 2024
Implicit Dynamical Flow Fusion (IDFF) for Generative Modeling Mohammad R. Rezaei Rahul G. Krishnan Milos R. Popovic M. Lankarany DiffM 66 0 0 22 Sep 2024
DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes Jianbiao Mei T. Hu Xuemeng Yang Licheng Wen Yu Yang Tiantian Wei Yukai Ma Min Dou Botian Shi Yong Liu VGen DiffM 105 3 0 06 Sep 2024
Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolation Xiaojuan Wang Boyang Zhou Brian L. Curless Ira Kemelmacher-Shlizerman Aleksander Holynski Steven M. Seitz DiffM 75 16 0 27 Aug 2024
Masked Image Modeling: A Survey Vlad Hondru Florinel-Alin Croitoru Shervin Minaee Radu Tudor Ionescu N. Sebe 113 8 0 13 Aug 2024
SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency Yiming Xie Chun-Han Yao Vikram S. Voleti Huaizu Jiang Varun Jampani VGen 106 46 0 24 Jul 2024
Diffusion Models in Low-Level Vision: A Survey Chunming He Yuqi Shen Chengyu Fang Fengyang Xiao Longxiang Tang Yulun Zhang W. Zuo Zhenhua Guo Xiu Li VLM DiffM MedIm 118 39 0 17 Jun 2024
Collaboratively Self-supervised Video Representation Learning for Action Recognition Jie Zhang Zhifan Wan Lanqing Hu Stephen Lin Shuzhe Wu Shiguang Shan TTA 111 1 0 15 Jan 2024
Diffusion Models with Deterministic Normalizing Flow Priors Mohsen Zand Ali Etemad Michael A. Greenspan DiffM 84 3 0 03 Sep 2023
Score-based Diffusion Models in Function Space Jae Hyun Lim Nikola B. Kovachki Ricardo Baptista Christopher Beckham Kamyar Azizzadenesheli ... Karsten Kreis Jan Kautz Christopher Pal Arash Vahdat Anima Anandkumar DiffM 151 47 0 14 Feb 2023
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 190 1,610 0 07 Apr 2022
Diffusion Probabilistic Modeling for Video Generation Ruihan Yang Prakhar Srivastava Stephan Mandt DiffM VGen 125 266 0 16 Mar 2022
Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks Sihyun Yu Jihoon Tack Sangwoo Mo Hyunsu Kim Junho Kim Jung-Woo Ha Jinwoo Shin DiffM VGen 89 201 0 21 Feb 2022
Pseudo Numerical Methods for Diffusion Models on Manifolds Luping Liu Yi Ren Zhijie Lin Zhou Zhao DiffM 92 646 0 20 Feb 2022
Denoising Diffusion Restoration Models Bahjat Kawar Michael Elad Stefano Ermon Jiaming Song DiffM 269 833 0 27 Jan 2022
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 331 3,600 0 20 Dec 2021
Tackling the Generative Learning Trilemma with Denoising Diffusion GANs Zhisheng Xiao Karsten Kreis Arash Vahdat DiffM 95 551 0 15 Dec 2021
Palette: Image-to-Image Diffusion Models Chitwan Saharia William Chan Huiwen Chang Chris A. Lee Jonathan Ho Tim Salimans David J. Fleet Mohammad Norouzi DiffM VLM 471 1,635 0 10 Nov 2021
Denoising Diffusion Gamma Models Eliya Nachmani S. Robin Lior Wolf DiffM VLM 43 32 0 10 Oct 2021
SLAMP: Stochastic Latent Appearance and Motion Prediction Adil Kaan Akan Erkut Erdem Aykut Erdem Fatma Guney 44 40 0 05 Aug 2021
SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations Chenlin Meng Yutong He Yang Song Jiaming Song Jiajun Wu Jun-Yan Zhu Stefano Ermon DiffM 134 1,489 0 02 Aug 2021
Accurate Grid Keypoint Learning for Efficient Video Prediction Xiaojie Gao Yueming Jin Qi Dou Chi-Wing Fu Pheng-Ann Heng VGen 27 17 0 28 Jul 2021
CCVS: Context-aware Controllable Video Synthesis G. L. Moing Jean Ponce Cordelia Schmid 76 79 0 16 Jul 2021
FitVid: Overfitting in Pixel-Level Video Prediction Mohammad Babaeizadeh M. Saffar Suraj Nair Sergey Levine Chelsea Finn D. Erhan VLM 90 84 0 24 Jun 2021
Gotta Go Fast When Generating Data with Score-Based Models Alexia Jolicoeur-Martineau Ke Li Remi Piche-Taillefer Tal Kachman Ioannis Mitliagkas DiffM 72 224 0 28 May 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 213 7,831 0 11 May 2021
VideoGPT: Video Generation using VQ-VAE and Transformers Wilson Yan Yunzhi Zhang Pieter Abbeel A. Srinivas ViT VGen 295 500 0 20 Apr 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 63 102 0 06 Mar 2021
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 330 6,453 0 26 Nov 2020
Denoising Diffusion Implicit Models Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 255 7,356 0 06 Oct 2020
Adversarial score matching and improved sampling for image generation Alexia Jolicoeur-Martineau Remi Piche-Taillefer Rémi Tachet des Combes Ioannis Mitliagkas DiffM 60 126 0 11 Sep 2020
Learning for Video Compression with Recurrent Auto-Encoder and Recurrent Probability Model Ren Yang Fabian Mentzer Luc Van Gool Radu Timofte 50 139 0 24 Jun 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 592 18,036 0 19 Jun 2020
Latent Video Transformer Ruslan Rakhimov Denis Volkhonskiy Alexey Artemov Denis Zorin Evgeny Burnaev VGen 88 120 0 18 Jun 2020
Improved Techniques for Training Score-Based Generative Models Yang Song Stefano Ermon DiffM 227 1,151 0 16 Jun 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 743 41,932 0 28 May 2020
Transformation-based Adversarial Video Prediction on Large-Scale Data Pauline Luc Aidan Clark Sander Dieleman Diego de Las Casas Yotam Doron Albin Cassirer Karen Simonyan VGen 276 87 0 09 Mar 2020
Exploring Spatial-Temporal Multi-Frequency Analysis for High-Fidelity and Temporal-Consistency Video Prediction Beibei Jin Yu Hu Qiankun Tang Jingyu Niu Zhiping Shi Yinhe Han Xiaowei Li 49 96 0 23 Feb 2020
Stochastic Latent Residual Video Prediction Jean-Yves Franceschi E. Delasalles Mickaël Chen Sylvain Lamprier Patrick Gallinari VGen 59 159 0 21 Feb 2020
Input Dropout for Spatially Aligned Modalities Sébastien de Blois Mathieu Garon Christian Gagné Jean-François Lalonde 29 7 0 07 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 493 42,407 0 03 Dec 2019
High Fidelity Video Prediction with Large Stochastic Recurrent Neural Networks Ruben Villegas Arkanath Pathak Harini Kannan D. Erhan Quoc V. Le Honglak Lee VGen 53 139 0 05 Nov 2019
Learning Energy-Based Models in High-Dimensional Spaces with Multi-scale Denoising Score Matching Zengyi Li Yubei Chen Friedrich T. Sommer DiffM 43 28 0 17 Oct 2019