Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signals

26 May 2025

Papers citing "Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signals"

30 / 30 papers shown

Title
PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Drop Chenyu Li Oscar Michel Xichen Pan Sainan Liu Mike Roberts Saining Xie VGen 91 4 0 12 Mar 2025
Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception Jiajing Lin Zhenzhong Wang Shu Jiang Yongjie Hou Min Jiang Min Jiang VGen 92 0 0 25 Nov 2024
DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion Wenqiang Sun Shuo Chen Fan Liu Zilong Chen Yueqi Duan Jun Zhang Yikai Wang VGen 94 36 0 07 Nov 2024
SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generation Koichi Namekata Sherwin Bahmani Ziyi Wu Yash Kant Igor Gilitschenski David B. Lindell VGen 126 16 0 07 Nov 2024
GameGen-X: Interactive Open-world Game Video Generation Haoxuan Che Xuanhua He Quande Liu Cheng Jin Hao Chen VGen 100 22 0 01 Nov 2024
PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generation Shaowei Liu Zhongzheng Ren Saurabh Gupta Shenlong Wang VGen DiffM PINN 82 47 0 27 Sep 2024
Diffusion Models Are Real-Time Game Engines Dani Valevski Yaniv Leviathan Moab Arar Shlomi Fruchter DiffM VGen AI4CE 76 78 0 27 Aug 2024
CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer Zhuoyi Yang Jiayan Teng Wendi Zheng Ming Ding Shiyu Huang ... Weihan Wang Yean Cheng Xiaotao Gu Yuxiao Dong Jie Tang DiffM VGen 192 495 0 12 Aug 2024
Tora: Trajectory-oriented Diffusion Transformer for Video Generation Zhenghao Zhang Junchao Liao Menghao Li Zuozhuo Dai Bingxue Qiu Hao Hu Shaowei Cai Weizhi Wang VGen 66 52 0 31 Jul 2024
Image Conductor: Precision Control for Interactive Video Synthesis Yaowei Li Xintao Wang Zhaoyang Zhang Zhouxia Wang Ziyang Yuan Liangbin Xie Yuexian Zou Ying Shan VGen 71 27 0 21 Jun 2024
Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion Fan Liu Hanyang Wang Shunyu Yao Shengjun Zhang Jie Zhou Yueqi Duan AI4CE 36 25 0 06 Jun 2024
DreamPhysics: Learning Physical Properties of Dynamic 3D Gaussians with Video Diffusion Priors Tianyu Huang Yihan Zeng Hui Li Zhilu Zhang Rynson W. H. Lau Wangmeng Zuo Rynson W. H. Lau 3DGS VGen 55 5 0 03 Jun 2024
MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model Muyao Niu Xiaodong Cun Xintao Wang Yong Zhang Ying Shan Yinqiang Zheng DiffM VGen 65 41 0 30 May 2024
MotionCraft: Physics-based Zero-Shot Video Generation L. S. Aira Antonio Montanaro Emanuele Aiello D. Valsesia E. Magli DiffM VGen 52 13 0 22 May 2024
PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation Tianyuan Zhang Hong-Xing Yu Rundi Wu Brandon Yushan Feng Changxi Zheng Noah Snavely Jiajun Wu William T. Freeman AI4CE VGen 115 73 0 19 Apr 2024
Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians Licheng Zhong Hong-Xing Yu Jiajun Wu Yunzhu Li 82 28 0 14 Mar 2024
DragAnything: Motion Control for Anything using Entity Representation Wejia Wu Zhuang Li Yuchao Gu Rui Zhao Yefei He David Junhao Zhang Mike Zheng Shou Yan Li Yan Li Di Zhang VGen 100 58 0 12 Mar 2024
Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modeling Xiaoyu Shi Zhaoyang Huang Fu-Yun Wang Weikang Bian Dasong Li ... Ka Chun Cheung Simon See Hongwei Qin Jifeng Da Hongsheng Li VGen DiffM 82 91 0 29 Jan 2024
Lumiere: A Space-Time Diffusion Model for Video Generation Omer Bar-Tal Hila Chefer Omer Tov Charles Herrmann Roni Paiss ... T. Michaeli Oliver Wang Deqing Sun Tali Dekel Inbar Mosseri VGen 166 237 0 23 Jan 2024
MotionCtrl: A Unified and Flexible Motion Controller for Video Generation Zhouxia Wang Ziyang Yuan Xintao Wang Tianshui Chen Menghan Xia Ping Luo Ying Shan DiffM VGen 99 221 0 06 Dec 2023
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets A. Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian ... Zion English Vikram S. Voleti Adam Letts Varun Jampani Robin Rombach VGen 228 1,143 0 25 Nov 2023
PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics Tianyi Xie Zeshun Zong Yuxing Qiu Xuan Li Yutao Feng Yin Yang Chenfanfu Jiang 3DGS 76 197 0 20 Nov 2023
Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioning Rohit Girdhar Mannat Singh Andrew Brown Quentin Duval S. Azadi Sai Saketh Rambhatla Akbar Shah Xi Yin Devi Parikh Ishan Misra DiffM VGen 92 200 0 17 Nov 2023
DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory Sheng-Siang Yin Chenfei Wu Jian Liang Jie Shi Houqiang Li Gong Ming Nan Duan VGen 108 142 0 16 Aug 2023
Motion-Conditioned Diffusion Model for Controllable Video Synthesis Tsai-Shien Chen C. Lin Hung-Yu Tseng Nayeon Lee Ming-Hsuan Yang DiffM VGen 94 66 0 27 Apr 2023
Differentiable Physics Simulation of Dynamics-Augmented Neural Objects Simon Le Cleac'h Hong-Xing Yu Michelle Guo Taylor A. Howell Ruohan Gao Jiajun Wu Zachary Manchester Mac Schwager AI4CE 48 44 0 17 Oct 2022
Imagen Video: High Definition Video Generation with Diffusion Models Jonathan Ho William Chan Chitwan Saharia Jay Whang Ruiqi Gao ... Diederik P. Kingma Ben Poole Mohammad Norouzi David J. Fleet Tim Salimans VGen 105 1,518 0 05 Oct 2022
Make-A-Video: Text-to-Video Generation without Text-Video Data Uriel Singer Adam Polyak Thomas Hayes Xiaoyue Yin Jie An ... Oron Ashual Oran Gafni Devi Parikh Sonal Gupta Yaniv Taigman DiffM VGen 74 1,406 0 29 Sep 2022
World Models David R Ha Jürgen Schmidhuber SyDa 113 1,079 0 27 Mar 2018
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 480 62,122 0 04 Jun 2015