Compositional Human-Scene Interaction Synthesis with Semantic Control

26 July 2022

Siyu Tang

Papers citing "Compositional Human-Scene Interaction Synthesis with Semantic Control"

50 / 56 papers shown

Title
HOIGen-1M: A Large-scale Dataset for Human-Object Interaction Video Generation Kun Liu Qi Liu Xinchen Liu Jie Li Yongdong Zhang Jiebo Luo Xiaodong He Wu Liu VGen 37 0 0 31 Mar 2025
Human-Object Interaction with Vision-Language Model Guided Relative Movement Dynamics Zekai Deng Ye-ling Shi Kaiyang Ji Lan Xu Shaoli Huang Jingya Wang 55 0 0 24 Mar 2025
Target-Aware Video Diffusion Models Taeksoo Kim Hanbyul Joo DiffM VGen 91 1 0 24 Mar 2025
Auto-Regressive Diffusion for Generating 3D Human-Object Interactions Zichen Geng Zeeshan Hayder Wei Liu Ajmal Saeed Mian DiffM VGen 61 0 0 21 Mar 2025
Reconstructing In-the-Wild Open-Vocabulary Human-Object Interactions Boran Wen Dingbang Huang Zichen Zhang J. Zhou Jianbin Deng Jingyu Gong Yulong Chen Lizhuang Ma Yongqian Li 3DH 49 0 0 20 Mar 2025
Motion Synthesis with Sparse and Flexible Keyjoint Control I. Hwang Jinseok Bae Donggeun Lim Y. Kim 60 0 0 18 Mar 2025
3D Human Interaction Generation: A Survey Siyuan Fan Wenke Huang Xiantao Cai Bo Du VGen 58 0 0 17 Mar 2025
Jointly Understand Your Command and Intention:Reciprocal Co-Evolution between Scene-Aware 3D Human Motion Synthesis and Analysis Xuehao Gao Yang Yang Shaoyi Du Guo-Jun Qi Junwei Han 41 1 0 01 Mar 2025
InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions Sirui Xu Hung Yu Ling Yu-xiong Wang Liang-Yan Gui 53 4 0 27 Feb 2025
Towards Affordance-Aware Articulation Synthesis for Rigged Objects Yu-Chu Yu C. Lin Hsin-Ying Lee Chaoyang Wang Yixuan Wang Ming Yang DiffM AI4CE 46 0 0 21 Jan 2025
CHOICE: Coordinated Human-Object Interaction in Cluttered Environments for Pick-and-Place Actions Jintao Lu He Zhang Yuting Ye Takaaki Shiratori Sebastian Starke Taku Komura 69 2 0 09 Dec 2024
Diffusion Implicit Policy for Unpaired Scene-aware Motion Synthesis Jingyu Gong Chong Zhang Fengqi Liu Ke Fan Qianyu Zhou Xin Tan Zhizhong Zhang Yuan Xie Lizhuang Ma VGen DiffM 84 1 0 03 Dec 2024
On Information-Theoretic Measures of Predictive Uncertainty Kajetan Schweighofer L. Aichberger Mykyta Ielanskyi Sepp Hochreiter UQCV UD 39 0 0 14 Oct 2024
HERM: Benchmarking and Enhancing Multimodal LLMs for Human-Centric Understanding Keliang Li Zaifei Yang Jiahe Zhao Hongze Shen Ruibing Hou Hong Chang Shiguang Shan Xilin Chen VLM 31 0 0 09 Oct 2024
Autonomous Character-Scene Interaction Synthesis from Text Instruction Nan Jiang Zimo He Zi Wang Hongjie Li Yixin Chen Siyuan Huang Yixin Zhu 40 18 0 04 Oct 2024
COLLAGE: Collaborative Human-Agent Interaction Generation using Hierarchical Latent Diffusion and Language Models Divyanshu Daiya Damon Conover Aniket Bera DiffM 36 0 0 30 Sep 2024
HMD^2: Environment-aware Motion Generation from Single Egocentric Head-Mounted Device Vladimir Guzov Yifeng Jiang Fangzhou Hong Gerard Pons-Moll Richard Newcombe C. Karen Liu Yuting Ye Lingni Ma 35 6 0 20 Sep 2024
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors Thomas Hanwen Zhu Ruining Li Tomas Jakab DiffM 36 4 0 12 Sep 2024
TextIM: Part-aware Interactive Motion Synthesis from Text Siyuan Fan Bo Du Xiantao Cai Bo Peng Longling Sun DiffM 40 1 0 06 Aug 2024
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting Daiwei Zhang Gengyan Li Jiajie Li Mickael Bressieux Otmar Hilliges Marc Pollefeys Luc Van Gool Xi Wang 39 9 0 28 Jun 2024
CORE4D: A 4D Human-Object-Human Interaction Dataset for Collaborative Object REarrangement Chengwen Zhang Yun-Hai Liu Ruofan Xing Bingda Tang Li Yi 43 10 0 27 Jun 2024
FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models Zhikai Zhang Yitang Li Haofeng Huang Mingxian Lin Li Yi 46 2 0 15 Jun 2024
Diverse 3D Human Pose Generation in Scenes based on Decoupled Structure Bowen Dang Xi Zhao 3DH 40 0 0 09 Jun 2024
Generating Human Motion in 3D Scenes from Text Descriptions Zhi Cen Huaijin Pi Sida Peng Zehong Shen Minghui Yang Shuai Zhu Hujun Bao Xiaowei Zhou 50 19 0 13 May 2024
Purposer: Putting Human Motion Generation in Context Nicolas Ugrinovic Thomas Lucas Fabien Baradel Philippe Weinzaepfel Grégory Rogez Francesc Moreno-Noguer DiffM 46 2 0 19 Apr 2024
Generating Human Interaction Motions in Scenes with Text Control Hongwei Yi Justus Thies Michael J. Black Xue Bin Peng Davis Rempe VGen DiffM 36 37 0 16 Apr 2024
GEARS: Local Geometry-aware Hand-object Interaction Synthesis Keyang Zhou Bharat Lal Bhatnagar J. E. Lenssen Gerard Pons-Moll 42 10 0 02 Apr 2024
InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction Sirui Xu Ziyin Wang Yu-Xiong Wang Liangyan Gui 42 24 0 28 Mar 2024
Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene Affordance Zan Wang Yixin Chen Baoxiong Jia Puhao Li Jinlu Zhang Jingze Zhang Tengyu Liu Yixin Zhu Wei Liang Siyuan Huang VGen DiffM 46 36 0 26 Mar 2024
InterFusion: Text-Driven Generation of 3D Human-Object Interaction Sisi Dai Wenhao Li Haowen Sun Haibin Huang Chongyang Ma Hui Huang Kai Xu Ruizhen Hu 28 7 0 22 Mar 2024
LaserHuman: Language-guided Scene-aware Human Motion Generation in Free Environment Peishan Cong Ziyi Wang Zhiyang Dou Yiming Ren Wei Yin Kai-Sheng Cheng Yujing Sun Xiaoxiao Long Xinge Zhu Yuexin Ma VGen 58 17 0 20 Mar 2024
AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents Jieming Cui Tengyu Liu Nian Liu Yaodong Yang Yixin Zhu Siyuan Huang 59 21 0 19 Mar 2024
ReGenNet: Towards Human Action-Reaction Synthesis Liang Xu Yizhou Zhou Yichao Yan Xin Jin Wenhan Zhu Fengyun Rao Xiaokang Yang Wenjun Zeng 30 16 0 18 Mar 2024
THOR: Text to Human-Object Interaction Diffusion via Relation Intervention Qianyang Wu Ye-ling Shi 0001 Xiaoshui Huang Jingyi Yu Lan Xu Jingya Wang 52 24 0 17 Mar 2024
Scaling Up Dynamic Human-Scene Interaction Modeling Nan Jiang Zhiyuan Zhang Hongjie Li Xiaoxuan Ma Zan Wang Yixin Chen Tengyu Liu Yixin Zhu Siyuan Huang 35 51 0 13 Mar 2024
DEMOS: Dynamic Environment Motion Synthesis in 3D Scenes via Local Spherical-BEV Perception Jing-yu Gong Min Wang Wentao Liu Chao Qian Zhizhong Zhang Yuan Xie Lizhuang Ma 42 0 0 04 Mar 2024
ContactGen: Contact-Guided Interactive 3D Human Generation for Partners Dongjun Gu Jaehyeok Shim Jaehoon Jang Changwoo Kang Kyungdon Joo DiffM 26 2 0 30 Jan 2024
Virtual Pets: Animatable Animal Generation in 3D Scenes Yen-Chi Cheng C. Lin Chaoyang Wang Yash Kant Sergey Tulyakov Alexander Schwing Liangyan Gui Hsin-Ying Lee 27 2 0 21 Dec 2023
Revisit Human-Scene Interaction via Space Occupancy Xinpeng Liu Haowen Hou Yanchao Yang Yong-Lu Li Cewu Lu 30 12 0 05 Dec 2023
GenZI: Zero-Shot 3D Human-Scene Interaction Generation Lei Li Angela Dai VGen 30 21 0 29 Nov 2023
CG-HOI: Contact-Guided 3D Human-Object Interaction Generation Christian Diller Angela Dai 29 59 0 27 Nov 2023
Unified Human-Scene Interaction via Prompted Chain-of-Contacts Zeqi Xiao Tai Wang Jingbo Wang Jinkun Cao Wenwei Zhang Bo Dai Dahua Lin Jiangmiao Pang 49 67 0 14 Sep 2023
InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion Sirui Xu Zhengyu Li Yu-Xiong Wang Liangyan Gui DiffM 41 111 0 31 Aug 2023
ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors Wanyue Zhang Rishabh Dabral Thomas Leimkuhler Vladislav Golyanik Marc Habermann Christian Theobalt 30 17 0 24 Aug 2023
Synthesizing Diverse Human Motions in 3D Indoor Scenes Kaifeng Zhao Yan Zhang Shaofei Wang Thabo Beeler Siyu Tang 33 65 0 21 May 2023
Compositional 3D Human-Object Neural Animation Zhi Hou Baosheng Yu Dacheng Tao 3DH 39 8 0 27 Apr 2023
SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation Nikos Athanasiou Mathis Petrovich Michael J. Black Gül Varol 13 40 0 20 Apr 2023
Generating Continual Human Motion in Diverse 3D Scenes Aymen Mir Xavier Puig Angjoo Kanazawa Gerard Pons-Moll 3DH 37 27 0 04 Apr 2023
Narrator: Towards Natural Control of Human-Scene Interaction Generation via Relationship Reasoning Haibiao Xuan Xiongzheng Li Jinsong Zhang Hongwen Zhang Yebin Liu Kun Li 23 7 0 16 Mar 2023
Diffusion-based Generation, Optimization, and Planning in 3D Scenes Siyuan Huang Zan Wang Puhao Li Baoxiong Jia Tengyu Liu Yixin Zhu Wei Liang Song-Chun Zhu DiffM 64 199 0 15 Jan 2023