ComPhy: Compositional Physical Reasoning of Objects and Events from Videos

2 May 2022

Zhenfang Chen

Kexin Yi

Yunzhu Li

Mingyu Ding

Antonio Torralba

Chuang Gan

Papers citing "ComPhy: Compositional Physical Reasoning of Objects and Events from Videos"

41 / 41 papers shown

Title
Think before You Simulate: Symbolic Reasoning to Orchestrate Neural Computation for Counterfactual Question Answering Adam Ishay Zhun Yang Joohyung Lee Ilgu Kang Dongjae Lim NAI 104 1 0 12 Jun 2025
A Shortcut-aware Video-QA Benchmark for Physical Understanding via Minimal Video Pairs Benno Krojer Mojtaba Komeili Candace Ross Q. Garrido Koustuv Sinha Nicolas Ballas Mahmoud Assran 60 1 0 11 Jun 2025
A Challenge to Build Neuro-Symbolic Video Agents Sahil Shah Harsh Goel Sai Shankar Narasimhan Minkyu Choi S P Sharan Oguzhan Akcin Sandeep Chinchali AI4TS 75 0 0 20 May 2025
We'll Fix it in Post: Improving Text-to-Video Generation with Neuro-Symbolic Feedback Minkyu Choi S P Sharan Harsh Goel Sahil Shah Sandeep Chinchali DiffM VGen 148 1 0 24 Apr 2025
PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos Hanxiao Jiang Hao-Yu Hsu Kaifeng Zhang Hsin-Ni Yu Shenlong Wang Yunzhu Li VGen AI4CE 102 8 0 23 Mar 2025
Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling Mingtong Zhang Kaifeng Zhang Yunzhu Li 3DGS AI4CE 78 9 0 24 Oct 2024
MARPLE: A Benchmark for Long-Horizon Inference Emily Jin Zhuoyi Huang Jan-Philipp Fränken Weiyu Liu Hannah Cha Erik Brockbank Sarah Wu Ruohan Zhang Jiajun Wu Tobias Gerstenberg 71 3 0 02 Oct 2024
One-shot Video Imitation via Parameterized Symbolic Abstraction Graphs Jianren Wang Kangni Liu Dingkun Guo Xian Zhou Christopher G Atkeson 64 0 0 22 Aug 2024
Compositional Physical Reasoning of Objects and Events from Videos Zhenfang Chen Shilong Dong Kexin Yi Yunzhu Li Mingyu Ding Antonio Torralba Joshua B. Tenenbaum Chuang Gan OCL 126 3 0 02 Aug 2024
Nearest Neighbor Future Captioning: Generating Descriptions for Possible Collisions in Object Placement Tasks Takumi Komatsu Motonari Kambara Shumpei Hatanaka Haruka Matsuo Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi Komei Sugiura 66 0 0 18 Jul 2024
AdaptiGraph: Material-Adaptive Graph-Based Neural Dynamics for Robotic Manipulation Kaifeng Zhang Baoyu Li Kris Hauser Yunzhu Li AI4CE 100 19 0 10 Jul 2024
Latent Intuitive Physics: Learning to Transfer Hidden Physics from A 3D Video Xiangming Zhu Huayu Deng Haochen Yuan Yunbo Wang Xiaokang Yang AI4CE VGen PINN 94 1 0 18 Jun 2024
Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question Answering Xingrui Wang Wufei Ma Angtian Wang Shuo Chen Adam Kortylewski Alan Yuille 101 6 0 02 Jun 2024
SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge Andong Wang Bo Wu Sunli Chen Zhenfang Chen Haotian Guan Wei-Ning Lee Li Erran Li Chuang Gan LRM RALM 103 19 0 15 May 2024
Interactive Learning of Physical Object Properties Through Robot Manipulation and Database of Object Measurements Andrej Kružliak Jiri Hartvich Shubhan Patni Lukas Rustler Jan Kristof Behrens Fares J. Abu-Dakka K. Mikolajczyk Ville Kyrki Matej Hoffmann 83 3 0 10 Apr 2024
Neural-Symbolic VideoQA: Learning Compositional Spatio-Temporal Reasoning for Real-world Video Question Answering Lili Liang Guanglu Sun Jin Qiu Lizhong Zhang NAI 66 3 0 05 Apr 2024
PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models Dingkun Guo Yuqi Xiang Shuqi Zhao Xinghao Zhu Masayoshi Tomizuka Mingyu Ding Wei Zhan 83 11 0 26 Feb 2024
RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation Hanxiao Jiang Binghao Huang Ruihai Wu Zhuoran Li Shubham Garg H. Nayyeri Shenlong Wang Yunzhu Li 103 23 0 23 Feb 2024
ContPhy: Continuum Physical Concept Learning and Reasoning from Videos Zhicheng Zheng Xin Yan Zhenfang Chen Jingzhou Wang Qin Zhi Eddie Lim Joshua B. Tenenbaum Chuang Gan LRM 74 10 0 09 Feb 2024
SNP-S3: Shared Network Pre-training and Significant Semantic Strengthening for Various Video-Text Tasks Xingning Dong Qingpei Guo Tian Gan Qing Wang Jianlong Wu Xiangyuan Ren Yuan Cheng Wei Chu 63 5 0 31 Jan 2024
A Survey of Reasoning with Foundation Models Jiankai Sun Chuanyang Zheng Enze Xie Zhengying Liu Ruihang Chu ... Xipeng Qiu Yi-Chen Guo Hui Xiong Qun Liu Zhenguo Li ReLM LRM AI4CE 205 85 0 17 Dec 2023
Benchmarks for Physical Reasoning AI Andrew Melnik Robin Schiewer Moritz Lange Andrei Muresanu Mozhgan Saeidi Animesh Garg Helge J. Ritter 103 9 0 17 Dec 2023
I-PHYRE: Interactive Physical Reasoning Shiqian Li Ke Wu Chi Zhang Yixin Zhu LRM 89 7 0 04 Dec 2023
GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEs Zhenfang Chen Rui Sun Wenjun Liu Yining Hong Chuang Gan LRM 113 15 0 08 Nov 2023
CLEVRER-Humans: Describing Physical and Causal Events the Human Way Jiayuan Mao Xuelin Yang Xikun Zhang Noah D. Goodman Jiajun Wu NAI 99 22 0 05 Oct 2023
$A^2$ Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models Peihao Chen Xinyu Sun Hongyan Zhi Runhao Zeng Thomas H. Li Gaowen Liu Mingkui Tan Chuang Gan LLMAG LM&Ro 104 38 0 15 Aug 2023
Advancing Visual Grounding with Scene Knowledge: Benchmark and Method Zhihong Chen Ruifei Zhang Yibing Song Xiang Wan Guanbin Li 48 20 0 21 Jul 2023
Does Visual Pretraining Help End-to-End Reasoning? Chen Sun Calvin Luo Xingyi Zhou Anurag Arnab Cordelia Schmid OCL LRM ViT 78 3 0 17 Jul 2023
ICSVR: Investigating Compositional and Syntactic Understanding in Video Retrieval Models Avinash Madasu Vasudev Lal CoGe 93 3 0 28 Jun 2023
Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties H. Tung Mingyu Ding Zhenfang Chen Daniel M. Bear Chuang Gan J. Tenenbaum Daniel L. K. Yamins Judy Fan Kevin A. Smith 115 17 0 27 Jun 2023
ConceptBed: Evaluating Concept Learning Abilities of Text-to-Image Diffusion Models Maitreya Patel Tejas Gokhale Chitta Baral Yezhou Yang CoGe 67 15 0 07 Jun 2023
Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following Mingyu Ding Yan Xu Zhenfang Chen David D. Cox Ping Luo J. Tenenbaum Chuang Gan LM&Ro 91 21 0 07 Apr 2023
3D Concept Learning and Reasoning from Multi-View Images Yining Hong Chun-Tse Lin Yilun Du Zhenfang Chen J. Tenenbaum Chuang Gan 3DV 94 52 0 20 Mar 2023
Intrinsic Physical Concepts Discovery with Object-Centric Predictive Models Qu Tang Xiangyu Zhu Zhen Lei Zhaoxiang Zhang OCL 109 8 0 03 Mar 2023
See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning Zhenfang Chen Qinhong Zhou Songlin Yang Yining Hong Hao Zhang Chuang Gan LRM VLM 107 41 0 12 Jan 2023
CRIPP-VQA: Counterfactual Reasoning about Implicit Physical Properties via Video Question Answering Maitreya Patel Tejas Gokhale Chitta Baral Yezhou Yang 124 12 0 07 Nov 2022
Learning Physical Dynamics with Subequivariant Graph Neural Networks Jiaqi Han Wenbing Huang Hengbo Ma Jiachen Li J. Tenenbaum Chuang Gan AI4CE PINN 109 47 0 13 Oct 2022
Masked Motion Encoding for Self-Supervised Video Representation Learning Xinyu Sun Peihao Chen Liang-Chieh Chen Chan Li Thomas H. Li Mingkui Tan Chuang Gan 74 32 0 12 Oct 2022
On the Learning Mechanisms in Physical Reasoning Shiqian Li Ke Wu Chi Zhang Yixin Zhu AI4CE 101 15 0 05 Oct 2022
Neuro-Symbolic Learning: Principles and Applications in Ophthalmology Muhammad Hassan Haifei Guan Aikaterini Melliou Yuqi Wang Qianhui Sun ... Qi Huang Jiefu Tan Qinwang Xing Peiwu Qin Dongmei Yu NAI 104 15 0 31 Jul 2022
Cross-Modal Graph with Meta Concepts for Video Captioning Hao Wang Guosheng Lin Guosheng Lin Chunyan Miao 67 7 0 14 Aug 2021