EMHI: A Multimodal Egocentric Human Motion Dataset with HMD and Body-Worn IMUs

30 August 2024

Zhuo Su

Jiarui Zhang

Yang Zhang

Papers citing "EMHI: A Multimodal Egocentric Human Motion Dataset with HMD and Body-Worn IMUs"

33 / 33 papers shown

Title
Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild Lingni Ma Yuting Ye Fangzhou Hong Vladimir Guzov Yifeng Jiang ... C. Karen Liu Ziwei Liu Jakob Engel R. D. Nardi Richard Newcombe 66 25 0 14 Jun 2024
EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams Christen Millerdurai Hiroyasu Akada Jian Wang D. Luvizon Christian Theobalt Vladislav Golyanik EgoV 75 15 0 12 Apr 2024
Real-Time Simulated Avatar from Head-Mounted Sensors Zhengyi Luo Jinkun Cao Rawal Khirodkar Alexander Winkler Jing Huang Kris Kitani Weipeng Xu 75 7 0 11 Mar 2024
HMD-Poser: On-Device Real-time Human Motion Tracking from Scalable Sparse Observations Peng Dai Yang Zhang Tao Liu Zhen Fan Tianyuan Du Zhuo Su Xiaozheng Zheng Zeming Li 3DH 53 10 0 06 Mar 2024
SimpleEgo: Predicting Probabilistic Body Pose from Egocentric Cameras Hanz Cuevas-Velasquez Charlie Hewitt S. Aliakbarian Tadas Baltruvsaitis 59 7 0 26 Jan 2024
3D Human Pose Perception from Egocentric Stereo Videos Hiroyasu Akada Jian Wang Vladislav Golyanik Christian Theobalt EgoV 78 15 0 30 Dec 2023
Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement Jian Wang Zhe Cao D. Luvizon Lingjie Liu Kripasindhu Sarkar Danhang Tang Thabo Beeler Christian Theobalt DiffM 64 16 0 28 Nov 2023
Ego3DPose: Capturing 3D Cues from Binocular Egocentric Views Taeho Kang Kyungjin Lee Jinrui Zhang Youngki Lee EgoV 58 20 0 21 Sep 2023
Project Aria: A New Tool for Egocentric Multi-Modal AI Research Jakob Engel Kiran Somasundaram Michael Goesele Albert Sun Alexander Gamino ... Zijian Wang Mingfei Yan Carl Ren R. D. Nardi Richard Newcombe EgoV 120 99 0 24 Aug 2023
Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modeling Xiaozheng Zheng Z. Su Chao Wen Zhou Xue Xiaojie Jin 79 30 0 17 Aug 2023
MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognition Xinyu Gong S. Mohan Naina Dhingra Jean-Charles Bazin Yilei Li Zhangyang Wang Rakesh Ranjan EgoV 106 19 0 12 May 2023
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesis Angela Castillo María Escobar Guillaume Jeanneret Albert Pumarola Pablo Arbelaez Ali K. Thabet A. Sanakoyeu DiffM VGen 47 30 0 21 Apr 2023
Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model Yuming Du Robin Kips Albert Pumarola Sebastian Starke Ali K. Thabet A. Sanakoyeu VGen DiffM 76 98 0 17 Apr 2023
QuestSim: Human Motion Tracking from Sparse Sensors with Simulated Avatars Alexander Winkler Jungdam Won Yuting Ye 71 118 0 20 Sep 2022
UnrealEgo: A New Dataset for Robust Egocentric 3D Human Motion Capture Hiroyasu Akada Jian Wang Soshi Shimada Masaki Takahashi Christian Theobalt Vladislav Golyanik EgoV 130 45 0 02 Aug 2022
AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensing Jiaxi Jiang Paul Streli Huajian Qiu A. Fender Larissa Laich Patrick Snape Christian Holz 109 109 0 27 Jul 2022
HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling Zhongang Cai Daxuan Ren Ailing Zeng Zhengyu Lin Tao Yu ... Fangzhou Hong Mingyuan Zhang Chen Change Loy Lei Yang Ziwei Liu 3DH 121 106 0 28 Apr 2022
Transformer Inertial Poser: Real-time Human Motion Reconstruction from Sparse IMUs with Simultaneous Terrain Generation Yifeng Jiang Yuting Ye Deepak Gopinath Jungdam Won Alexander Winkler Chenxi Liu 64 79 0 29 Mar 2022
Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors Xinyu Yi Yuxiao Zhou Marc Habermann Soshi Shimada Vladislav Golyanik Christian Theobalt F. Xu 80 170 0 16 Mar 2022
Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervision Jian Wang Lingjie Liu Weipeng Xu Kripasindhu Sarkar D. Luvizon Christian Theobalt EgoV 59 36 0 20 Jan 2022
EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices Siwei Zhang Qianli Ma Yan Zhang Zhiyin Qian Taein Kwon Marc Pollefeys Federica Bogo Siyu Tang 85 97 0 14 Dec 2021
Home Action Genome: Cooperative Compositional Action Understanding Nishant Rai Haofeng Chen Jingwei Ji Rishi Desai Kazuki Kozuka Shun Ishizaka Ehsan Adeli Juan Carlos Niebles 43 77 0 11 May 2021
Estimating Egocentric 3D Human Pose in Global Space Jian Wang Lingjie Liu Weipeng Xu Kripasindhu Sarkar Christian Theobalt EgoV 68 66 0 27 Apr 2021
Rescaling Egocentric Vision Dima Damen Hazel Doughty G. Farinella Antonino Furnari Evangelos Kazakos ... Davide Moltisanti Jonathan Munro Toby Perrett Will Price Michael Wray EgoV 91 464 0 23 Jun 2020
Designing Network Design Spaces Ilija Radosavovic Raj Prateek Kosaraju Ross B. Girshick Kaiming He Piotr Dollár GNN 102 1,692 0 30 Mar 2020
xR-EgoPose: Egocentric 3D Human Pose from an HMD Camera Denis Tomè Patrick Peluse Lourdes Agapito H. Badino EgoV 88 112 0 23 Jul 2019
Expressive Body Capture: 3D Hands, Face, and Body from a Single Image Georgios Pavlakos Vasileios Choutas N. Ghorbani Timo Bolkart Ahmed A. A. Osman Dimitrios Tzionas Michael J. Black 3DH 55 1,725 0 11 Apr 2019
AMASS: Archive of Motion Capture as Surface Shapes Naureen Mahmood N. Ghorbani N. Troje Gerard Pons-Moll Michael J. Black 3DH 48 1,259 0 05 Apr 2019
Deep High-Resolution Representation Learning for Human Pose Estimation Ke Sun Bin Xiao Dong Liu Jingdong Wang 3DV 136 4,059 0 25 Feb 2019
Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera Weipeng Xu Avishek Chatterjee Michael Zollhoefer Helge Rhodin Pascal Fua Hans-Peter Seidel Christian Theobalt 57 150 0 15 Mar 2018
Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs T. V. Marcard Bodo Rosenhahn Michael J. Black Gerard Pons-Moll 3DH 71 302 0 23 Mar 2017
Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields Zhe Cao Tomas Simon S. Wei Yaser Sheikh 3DH 153 6,546 0 24 Nov 2016
Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image Federica Bogo Angjoo Kanazawa Christoph Lassner Peter V. Gehler Javier Romero Michael J. Black 3DH 111 1,584 0 27 Jul 2016