Video Diffusion Models

7 April 2022

David J. Fleet

Papers citing "Video Diffusion Models"

50 / 1,193 papers shown

Title
GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction Haodong Yan Zhiming Hu Syn Schmitt Andreas Bulling DiffM 98 7 0 19 Dec 2023
Optimizing Diffusion Noise Can Serve As Universal Motion Priors Korrawe Karunratanakul Konpat Preechakul Emre Aksan Thabo Beeler Supasorn Suwajanakorn Siyu Tang DiffM 36 37 0 19 Dec 2023
IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition Xiaomeng Yang Zhi Qiao Yu Zhou DiffM 62 1 0 19 Dec 2023
VidToMe: Video Token Merging for Zero-Shot Video Editing Xirui Li Chao Ma Xiaokang Yang Ming-Hsuan Yang DiffM VGen 43 40 0 17 Dec 2023
DETER: Detecting Edited Regions for Deterring Generative Manipulations Sai Wang Ye Zhu Ruoyu Wang Amaya Dharmasiri Olga Russakovsky Yu Wu 48 2 0 16 Dec 2023
Continuous Diffusion for Mixed-Type Tabular Data Markus Mueller Kathrin Gruber Dennis Fok DiffM 64 5 0 16 Dec 2023
Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathology Pedro Osório Guillermo Jiménez-Pérez Javier Montalt-Tordera Jens Hooge Guillem Duran Ballester ... Sabrina Schroeder K. Siudak Julia Vienenkoetter Bettina Lawrenz Sadegh Mohammadi MedIm 30 8 0 15 Dec 2023
A framework for conditional diffusion modelling with applications in motif scaffolding for protein design Kieran Didi Francisco Vargas Simon Mathis Vincent Dutordoir Emile Mathieu Urszula Julia Komorowska Pietro Lio DiffM 39 14 0 14 Dec 2023
PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion Ying-Tian Liu Yuanchen Guo Guan Luo Heyi Sun Wei Yin Song-Hai Zhang 34 18 0 14 Dec 2023
Motion Flow Matching for Human Motion Synthesis and Editing Vincent Tao Hu Wenzhe Yin Pingchuan Ma Yunlu Chen Basura Fernando Yuki M. Asano E. Gavves Pascal Mettes Bjorn Ommer Cees G. M. Snoek DiffM 37 19 0 14 Dec 2023
Guided Diffusion from Self-Supervised Diffusion Features Vincent Tao Hu Yunlu Chen Mathilde Caron Yuki M. Asano Cees G. M. Snoek Bjorn Ommer 45 11 0 14 Dec 2023
FreeInit: Bridging Initialization Gap in Video Diffusion Models Tianxing Wu Chenyang Si Yuming Jiang Ziqi Huang Ziwei Liu DiffM VGen 38 45 0 12 Dec 2023
PEEKABOO: Interactive Video Generation via Masked-Diffusion Yash Jain Anshul Nasery Vibhav Vineet Harkirat Singh Behl VGen 41 31 0 12 Dec 2023
Boosting Latent Diffusion with Flow Matching Johannes S. Fischer Ming Gui Pingchuan Ma Nick Stracke S. A. Baumann Bjorn Ommer 27 20 0 12 Dec 2023
One-Step Diffusion Distillation via Deep Equilibrium Models Zhengyang Geng Ashwini Pokle Trevor Killeen 39 30 0 12 Dec 2023
Relightful Harmonization: Lighting-aware Portrait Background Replacement Mengwei Ren Wei Xiong Jae Shin Yoon Zhixin Shu Jianming Zhang HyunJoon Jung Guido Gerig He Zhang DiffM 43 18 0 11 Dec 2023
Photorealistic Video Generation with Diffusion Models Agrim Gupta Lijun Yu Kihyuk Sohn Xiuye Gu Meera Hahn Fei-Fei Li Irfan Essa Lu Jiang José Lezama VGen 66 178 0 11 Dec 2023
Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution Shangchen Zhou Peiqing Yang Jianyi Wang Yihang Luo Chen Change Loy VGen 99 38 0 11 Dec 2023
Precipitation Downscaling with Spatiotemporal Video Diffusion Prakhar Srivastava Ruihan Yang Gavin Kerrigan Gideon Dresdner Jeremy McGibbon Christopher S. Bretherton Stephan Mandt DiffM 56 3 0 11 Dec 2023
Neutral Editing Framework for Diffusion-based Video Editing Sunjae Yoon Gwanhyeong Koo Jiajing Hong Changdong Yoo VGen DiffM 27 1 0 10 Dec 2023
CMMD: Contrastive Multi-Modal Diffusion for Video-Audio Conditional Modeling Ruihan Yang H. Gamper Sebastian Braun DiffM 39 5 0 08 Dec 2023
SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation Thuan Hoang Nguyen Anh Tran DiffM 26 58 0 08 Dec 2023
MotionCrafter: One-Shot Motion Customization of Diffusion Models Yuxin Zhang Fan Tang Nisha Huang Haibin Huang Chongyang Ma Weiming Dong Changsheng Xu DiffM VGen 46 14 0 08 Dec 2023
GenDeF: Learning Generative Deformation Field for Video Generation Wen Wang Kecheng Zheng Qiuyu Wang Hao Chen Zifan Shi Ceyuan Yang Yujun Shen Chunhua Shen VGen DiffM 54 2 0 07 Dec 2023
RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models Ozgur Kara Barışcan Kurtkaya Hidir Yesiltepe James M. Rehg Pinar Yanardag VGen DiffM 25 45 0 07 Dec 2023
Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation Zhiwu Qing Shiwei Zhang Jiayu Wang Xiang Wang Yujie Wei Yingya Zhang Changxin Gao Nong Sang VGen DiffM 37 37 0 07 Dec 2023
DreamVideo: Composing Your Dream Videos with Customized Subject and Motion Yujie Wei Shiwei Zhang Zhiwu Qing Hangjie Yuan Zhiheng Liu Yu Liu Yingya Zhang Jingren Zhou Hongming Shan DiffM VGen 24 90 0 07 Dec 2023
Investigating the Design Space of Diffusion Models for Speech Enhancement Philippe Gonzalez Zheng-Hua Tan Jan Østergaard Jesper Jensen T. S. Alstrøm Tobias May DiffM 35 6 0 07 Dec 2023
Natural-language-driven Simulation Benchmark and Copilot for Efficient Production of Object Interactions in Virtual Road Scenes Kairui Yang Zihao Guo Gengjie Lin Haotian Dong Die Zuo ... Zhao Huang Zhecheng Xu Fupeng Li Ziyun Bai Di Lin 32 1 0 07 Dec 2023
Controllable Human-Object Interaction Synthesis Jiaman Li Alexander Clegg Roozbeh Mottaghi Jiajun Wu Xavier Puig Chenxi Liu 44 46 0 06 Dec 2023
Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion Kira Prabhu Jane Wu Lynn Tsai Peter Hedman Dan B. Goldman Ben Poole Michael Broxton DiffM 31 7 0 06 Dec 2023
AVID: Any-Length Video Inpainting with Diffusion Model Zhixing Zhang Bichen Wu Xiaoyan Wang Yaqiao Luo Luxin Zhang Yinan Zhao Peter Vajda Dimitris N. Metaxas Licheng Yu VGen DiffM 47 33 0 06 Dec 2023
AnimateZero: Video Diffusion Models are Zero-Shot Image Animators Jiwen Yu Xiaodong Cun Chenyang Qi Yong Zhang Xintao Wang Ying Shan Jian Zhang VGen 55 13 0 06 Dec 2023
Diffused Task-Agnostic Milestone Planner Mineui Hong Minjae Kang Songhwai Oh 31 6 0 06 Dec 2023
DiffusionAtlas: High-Fidelity Consistent Diffusion Video Editing Shao-Yu Chang Hwann-Tzong Chen Tyng-Luh Liu DiffM VGen 44 3 0 05 Dec 2023
Drag-A-Video: Non-rigid Video Editing with Point-based Interaction Yao Teng Enze Xie Yue Wu Haoyu Han Zhenguo Li Xihui Liu DiffM VGen 39 11 0 05 Dec 2023
LivePhoto: Real Image Animation with Text-guided Motion Control Xi Chen Zhiheng Liu Mengting Chen Yutong Feng Yu Liu Yujun Shen Hengshuang Zhao VGen DiffM 47 30 0 05 Dec 2023
Fine-grained Controllable Video Generation via Object Appearance and Context Hsin-Ping Huang Yu-Chuan Su Deqing Sun Lu Jiang Xuhui Jia Yukun Zhu Ming-Hsuan Yang DiffM VGen 28 14 0 05 Dec 2023
Deterministic Guidance Diffusion Model for Probabilistic Weather Forecasting Donggeun Yoon Minseok Seo Do-Yun Kim Yeji Choi Donghyeon Cho DiffM 36 6 0 05 Dec 2023
BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models Fengyuan Shi Jiaxi Gu Hang Xu Songcen Xu Wei Zhang Limin Wang VGen DiffM 36 12 0 05 Dec 2023
Analyzing and Improving the Training Dynamics of Diffusion Models Tero Karras M. Aittala J. Lehtinen Janne Hellsten Timo Aila S. Laine 61 158 0 05 Dec 2023
Diffusion-Based Speech Enhancement in Matched and Mismatched Conditions Using a Heun-Based Sampler Philippe Gonzalez Zheng-Hua Tan Jan Østergaard Jesper Jensen T. S. Alstrøm Tobias May DiffM 37 4 0 05 Dec 2023
Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models Shengqu Cai Duygu Ceylan Matheus Gadelha C. Huang Tuanfeng Y. Wang Gordon Wetzstein VGen 32 17 0 03 Dec 2023
ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models Jeong-gi Kwak Erqun Dong Yuhe Jin Hanseok Ko Shweta Mahajan Kwang Moo Yi DiffM VGen 72 38 0 03 Dec 2023
Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D Karran Pandey Paul Guerrero Matheus Gadelha Yannick Hold-Geoffroy Karan Singh Niloy Mitra DiffM 34 31 0 02 Dec 2023
VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models Hyeonho Jeong Geon Yeong Park Jong Chul Ye VGen DiffM 117 54 0 01 Dec 2023
StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter Gongye Liu Menghan Xia Yong Zhang Haoxin Chen Jinbo Xing Xintao Wang Yujiu Yang Ying Shan DiffM VGen 149 0 0 01 Dec 2023
VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models Zhen Xing Qi Dai Zihao Zhang Hui Zhang Hang-Rui Hu Zuxuan Wu Yu-Gang Jiang VGen 63 17 0 30 Nov 2023
$ART$\boldsymbol{\cdot}$V: Auto-Regressive Text-to-Video Generation with Diffusion Models$ ART $\boldsymbol{\cdot}$ V: Auto-Regressive Text-to-Video Generation with Diffusion Models Wenming Weng Ruoyu Feng Yanhui Wang Qi Dai Chunyu Wang ... Jianmin Bao Yuhui Yuan Chong Luo Yueyi Zhang Zhiwei Xiong VGen 33 32 0 30 Nov 2023
MicroCinema: A Divide-and-Conquer Approach for Text-to-Video Generation Yanhui Wang Jianmin Bao Wenming Weng Ruoyu Feng Dacheng Yin ... Yuhui Yuan Chuanxin Tang Xiaoyan Sun Chong Luo Baining Guo DiffM VGen 68 15 0 30 Nov 2023