v1v2v3 (latest)

Generating Videos with Scene Dynamics

8 September 2016

Carl Vondrick

Antonio Torralba

Papers citing "Generating Videos with Scene Dynamics"

50 / 746 papers shown

Title
VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time Sicheng Xu Guojun Chen Yu-Xiao Guo Jiaolong Yang Chong Li Zhenyu Zang Yizhong Zhang Xin Tong Baining Guo 91 102 0 16 Apr 2024
Motion Inversion for Video Customization Luozhou Wang Guibao Shen Yixun Liang Xin Tao Pengfei Wan Di Zhang Yijun Li Yingcong Chen VGen DiffM 69 9 0 29 Mar 2024
Minimax density estimation in the adversarial framework under local differential privacy Mélisande Albert Juliette Chevallier Béatrice Laurent Ousmane Sacko 60 0 0 27 Mar 2024
SSM Meets Video Diffusion Models: Efficient Video Generation with Structured State Spaces Yuta Oshima Shohei Taniguchi Masahiro Suzuki Yutaka Matsuo 114 6 0 12 Mar 2024
AesopAgent: Agent-driven Evolutionary System on Story-to-Video Production Jiuniu Wang Zehua Du Yuyuan Zhao Bo Yuan Kexiang Wang ... Yihen Lu Gengliang Li Junlong Gao Xin Tu Zhenyu Guo LLMAG VGen 81 8 0 12 Mar 2024
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation Guosheng Zhao Xiaofeng Wang Zheng Zhu Xinze Chen Guan Huang Xiaoyi Bao Xingang Wang VGen 64 80 0 11 Mar 2024
WorldGPT: A Sora-Inspired Video AI Agent as Rich World Models from Text and Image Inputs Deshun Yang Luhui Hu Yu Tian Zihao Li Chris Kelly Bang Yang Cindy Yang Yuexian Zou VGen 94 14 0 10 Mar 2024
UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing Jianhong Bai Tianyu He Yuchi Wang Junliang Guo Haoji Hu Zuozhu Liu Jiang Bian VGen 102 30 0 20 Feb 2024
Anything in Any Scene: Photorealistic Video Object Insertion Chen Bai Zeman Shao Guoxiang Zhang Di Liang Jie Yang ... Zhendong Wang Yichen Guan Xiaoyin Zheng Tao Wang Cheng Lu DiffM VGen 57 3 0 30 Jan 2024
Active Generation Network of Human Skeleton for Action Recognition Longzhao Liu Xin Wang Fangming Li Jiayu Chen GAN 94 1 0 30 Jan 2024
A Survey on Generative AI and LLM for Video Generation, Understanding, and Streaming Pengyuan Zhou Lin Wang Zhi Liu Yanbin Hao Pan Hui Sasu Tarkoma J. Kangasharju VGen 116 30 0 30 Jan 2024
STREAM: Spatio-TempoRal Evaluation and Analysis Metric for Video Generative Models Pum Jun Kim Seojun Kim Jaejun Yoo EGVM 49 5 0 30 Jan 2024
ActAnywhere: Subject-Aware Video Background Generation Boxiao Pan Zhan Xu Chun-Hao Paul Huang Krishna Kumar Singh Yang Zhou Leonidas Guibas Jimei Yang VGen DiffM 61 3 0 19 Jan 2024
VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models Haoxin Chen Yong Zhang Xiaodong Cun Menghan Xia Xintao Wang Chao-Liang Weng Ying Shan VGen DiffM 262 323 0 17 Jan 2024
Collaboratively Self-supervised Video Representation Learning for Action Recognition Jie Zhang Zhifan Wan Lanqing Hu Stephen Lin Shuzhe Wu Shiguang Shan TTA 166 1 0 15 Jan 2024
Latte: Latent Diffusion Transformer for Video Generation Xin Ma Yaohui Wang Gengyun Jia Xinyuan Chen Ziqiang Liu Yuan-Fang Li Cunjian Chen Yu Qiao DiffM VGen 291 280 0 05 Jan 2024
Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditions David Junhao Zhang Dongxu Li Hung Le Mike Zheng Shou Caiming Xiong Doyen Sahoo VGen 89 25 0 03 Jan 2024
SFGANS Self-supervised Future Generator for human ActioN Segmentation Or Berman Adam Goldbraikh S. Laufer 90 0 0 31 Dec 2023
FlashVideo: A Framework for Swift Inference in Text-to-Video Generation Bin Lei Le Chen Caiwen Ding VGen 40 2 0 30 Dec 2023
MetaScript: Few-Shot Handwritten Chinese Content Generation via Generative Adversarial Networks Xiangyuan Xue Kailing Wang Jiazi Bu Qirui Li Zhiyuan Zhang GAN 57 1 0 25 Dec 2023
Sign Language Production with Latent Motion Transformer Pan Xie Taiying Peng Yao Du Qipeng Zhang SLR 71 5 0 20 Dec 2023
Consistency Models for Scalable and Fast Simulation-Based Inference Marvin Schmitt Valentin Pratz Ullrich Kothe Paul-Christian Bürkner Stefan T. Radev 107 13 0 09 Dec 2023
GenDeF: Learning Generative Deformation Field for Video Generation Wen Wang Kecheng Zheng Qiuyu Wang Hao Chen Zifan Shi Ceyuan Yang Yujun Shen Chunhua Shen VGen DiffM 76 2 0 07 Dec 2023
Hierarchical Spatio-temporal Decoupling for Text-to-Video Generation Zhiwu Qing Shiwei Zhang Jiayu Wang Xiang Wang Yujie Wei Yingya Zhang Changxin Gao Nong Sang VGen DiffM 64 43 0 07 Dec 2023
DreamVideo: Composing Your Dream Videos with Customized Subject and Motion Yujie Wei Shiwei Zhang Zhiwu Qing Hangjie Yuan Zhiheng Liu Yu Liu Yingya Zhang Jingren Zhou Hongming Shan DiffM VGen 82 98 0 07 Dec 2023
MEVG: Multi-event Video Generation with Text-to-Video Models Gyeongrok Oh Jaehwan Jeong Sieun Kim Wonmin Byeon Jinkyu Kim Sungwoong Kim Sangpil Kim VGen DiffM 117 23 0 07 Dec 2023
MotionCtrl: A Unified and Flexible Motion Controller for Video Generation Zhouxia Wang Ziyang Yuan Xintao Wang Tianshui Chen Menghan Xia Ping Luo Ying Shan DiffM VGen 167 230 0 06 Dec 2023
Generator Born from Classifier Runpeng Yu Xinchao Wang 71 4 0 05 Dec 2023
Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving Yu-Quan Wang Jiawei He Lue Fan Hongxin Li Yuntao Chen Zhaoxiang Zhang VGen 155 145 0 29 Nov 2023
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets A. Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian ... Zion English Vikram S. Voleti Adam Letts Varun Jampani Robin Rombach VGen 336 1,190 0 25 Nov 2023
Vamos: Versatile Action Models for Video Understanding Shijie Wang Qi Zhao Minh Quan Do Nakul Agarwal Kwonjoon Lee Chen Sun 149 21 0 22 Nov 2023
FusionFrames: Efficient Architectural Aspects for Text-to-Video Generation Pipeline V.Ya. Arkhipkin Zein Shaheen Viacheslav Vasilev E. Dakhova Andrey Kuznetsov Denis Dimitrov DiffM VGen 97 5 0 22 Nov 2023
Video Face Re-Aging: Toward Temporally Consistent Face Re-Aging Abdul Muqeet Kyuchul Lee Bumsoo Kim Yohan Hong Hyungrae Lee Woonggon Kim Kwang Hee Lee 95 3 0 20 Nov 2023
MoVideo: Motion-Aware Video Generation with Diffusion Models Christos Sakaridis Yuchen Fan Kai Zhang Radu Timofte Luc Van Gool Rakesh Ranjan DiffM VGen 85 10 0 19 Nov 2023
Make Pixels Dance: High-Dynamic Video Generation Yan Zeng Guoqiang Wei Jiani Zheng Jiaxin Zou Yang Wei Yuchen Zhang Hang Li DiffM VGen 88 102 0 18 Nov 2023
Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioning Rohit Girdhar Mannat Singh Andrew Brown Quentin Duval S. Azadi Sai Saketh Rambhatla Akbar Shah Xi Yin Devi Parikh Ishan Misra DiffM VGen 143 209 0 17 Nov 2023
DIFFNAT: Improving Diffusion Image Quality Using Natural Image Statistics Aniket Roy Maiterya Suin Anshul B. Shah Ketul Shah Jiang-Long Liu Rama Chellappa DiffM 83 4 0 16 Nov 2023
MeVGAN: GAN-based Plugin Model for Video Generation with Applications in Colonoscopy Lukasz Struski Tomasz Urbañczyk Krzysztof Bucki Bartłomiej Cupiał Aneta Kaczyńska Przemysław Spurek Jacek Tabor MedIm GAN 65 1 0 07 Nov 2023
United We Stand, Divided We Fall: UnityGraph for Unsupervised Procedure Learning from Videos Siddhant Bansal Chetan Arora C. V. Jawahar 108 6 0 06 Nov 2023
Transformation vs Tradition: Artificial General Intelligence (AGI) for Arts and Humanities Zheng Liu Yiwei Li Qian Cao Junwen Chen Tianze Yang ... John Gibbs Khaled Rasheed Ninghao Liu Gengchen Mai Tianming Liu AI4CE 129 10 0 30 Oct 2023
One Style is All you Need to Generate a Video Sandeep Manandhar Auguste Genovesio VGen 55 0 0 27 Oct 2023
MotionDirector: Motion Customization of Text-to-Video Diffusion Models Rui Zhao Yuchao Gu Jay Zhangjie Wu David Junhao Zhang Jia-Wei Liu Weijia Wu Jussi Keppo Mike Zheng Shou DiffM VGen 113 118 0 12 Oct 2023
RT-GAN: Recurrent Temporal GAN for Adding Lightweight Temporal Consistency to Frame-Based Domain Translation Approaches Shawn Mathew Saad Nadeem Alvin C. Goh Arie Kaufman MedIm 122 0 0 02 Oct 2023
FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagery Tasin Islam A. Miron Xiaohui Liu Yongmin Li DiffM 71 3 0 29 Sep 2023
GAIA-1: A Generative World Model for Autonomous Driving Masane Fuchi Lloyd Russell Hudson Yeo Zak Murez Hiroto Minami Alex Kendall Tomohiro Takagi Gianluca Corrado VGen 133 253 0 29 Sep 2023
Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation David Junhao Zhang Jay Zhangjie Wu Jia-Wei Liu Rui Zhao L. Ran Yuchao Gu Difei Gao Mike Zheng Shou DiffM VGen 134 223 0 27 Sep 2023
LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models Yaohui Wang Xinyuan Chen Xin Ma Shangchen Zhou Ziqi Huang ... Chen Change Loy Bo Dai Dahua Lin Yu Qiao Ziwei Liu VGen DiffM 121 232 0 26 Sep 2023
DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving Xiaofeng Wang Zheng Hua Zhu Guan Huang Xinze Chen Jiagang Zhu Jiwen Lu VGen 116 168 0 18 Sep 2023
Sim-to-Real Brush Manipulation using Behavior Cloning and Reinforcement Learning Biao Jia Tianyi Zhou 40 0 0 15 Sep 2023
Generative Image Dynamics Zhengqi Li Richard Tucker Noah Snavely Aleksander Holynski DiffM 102 66 0 14 Sep 2023