EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting

28 June 2024

Gengyan Li

Marc Pollefeys

Xi Wang

Papers citing "EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting"

37 / 37 papers shown

Title
Predict-Optimize-Distill: A Self-Improving Cycle for 4D Object Understanding Mingxuan Wu Huang Huang Justin Kerr Chung Min Kim Anthony Zhang Brent Yi Angjoo Kanazawa 86 0 0 24 Apr 2025
DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstruction Ben Kaye Tomas Jakab Shangzhe Wu Christian Rupprecht Andrea Vedaldi 3DPC 3DH 148 1 0 05 Dec 2024
Get a Grip: Reconstructing Hand-Object Stable Grasps in Egocentric Videos Zhifan Zhu Dima Damen 52 7 0 25 Dec 2023
SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering Antoine Guédon Vincent Lepetit 3DGS 38 359 0 21 Nov 2023
Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction Ziyi Yang Xinyu Gao Wenming Zhou Shaohui Jiao Yuqing Zhang Xiaogang Jin 3DGS 97 389 0 22 Sep 2023
Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perception Xiaqing Pan Nicholas Charron Yongqiang Yang Scott Peters Thomas Whelan Chen Kong Omkar M. Parkhi Richard Newcombe C. Ren VGen 53 62 0 10 Jun 2023
MIME: Human-Aware 3D Scene Generation Hongwei Yi C. Huang Shashank Tripathi Lea Hering Justus Thies Michael J. Black 3DH 66 52 0 08 Dec 2022
Mixed Neural Voxels for Fast Multi-view Video Synthesis Feng Wang Sinan Tan Xinghang Li Zeyue Tian Yafei Song Huaping Liu VGen 62 95 0 01 Dec 2022
Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applications Lingzhi Zhang Shenghao Zhou Simon Stent Jianbo Shi EgoV 66 61 0 07 Aug 2022
Neural Pixel Composition: 3D-4D View Synthesis from Multi-Views Aayush Bansal Michael Zollhoefer 3DV 34 8 0 21 Jul 2022
Capturing and Inferring Dense Full-Body Human-Scene Contact C. Huang Hongwei Yi Markus Hoschle Matvey Safroshkin Tsvetelina Alexiadis Senya Polikovsky D. Scharstein Michael J. Black 3DH 73 125 0 20 Jun 2022
Fast Dynamic Radiance Fields with Time-Aware Neural Voxels Jiemin Fang Taoran Yi Xinggang Wang Lingxi Xie Xiaopeng Zhang Wenyu Liu Matthias Nießner Qi Tian VGen 166 302 0 30 May 2022
What's in your hands? 3D Reconstruction of Generic Objects in Hands Yufei Ye Abhinav Gupta Shubham Tulsiani 3DH 48 85 0 14 Apr 2022
TensoRF: Tensorial Radiance Fields Anpei Chen Zexiang Xu Andreas Geiger Jingyi Yu Hao Su 85 1,295 0 17 Mar 2022
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction Yunze Liu Yun-Hai Liu Chen Jiang Kangbo Lyu Weikang Wan Hao Shen Bo-Hua Liang Zhoujie Fu He Wang Li Yi 79 184 0 03 Mar 2022
Point-NeRF: Point-based Neural Radiance Fields Qiangeng Xu Zexiang Xu Julien Philip Sai Bi Zhixin Shu Kalyan Sunkavalli Ulrich Neumann 3DPC 94 572 0 21 Jan 2022
Instant Neural Graphics Primitives with a Multiresolution Hash Encoding Thomas Müller Alex Evans Christoph Schied A. Keller 291 4,009 0 16 Jan 2022
Plenoxels: Radiance Fields without Neural Networks Alex Yu Sara Fridovich-Keil Matthew Tancik Qinhong Chen Benjamin Recht Angjoo Kanazawa 239 1,646 0 09 Dec 2021
Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields Dor Verbin Peter Hedman B. Mildenhall Todd E. Zickler Jonathan T. Barron Pratul P. Srinivasan 90 596 0 07 Dec 2021
NeRFReN: Neural Radiance Fields with Reflections Yuanchen Guo Di Kang Linchao Bao Yu He Song-Hai Zhang 91 146 0 30 Nov 2021
Deblur-NeRF: Neural Radiance Fields from Blurry Images Li Ma Xiaoyu Li Jing Liao Qi Zhang Xuan Wang Jue Wang Pedro Sander 52 186 0 29 Nov 2021
Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields Jonathan T. Barron B. Mildenhall Dor Verbin Pratul P. Srinivasan Peter Hedman 158 1,668 0 23 Nov 2021
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Cheng Sun Min Sun Hwann-Tzong Chen 115 1,070 0 22 Nov 2021
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 363 1,081 0 13 Oct 2021
Depth-supervised NeRF: Fewer Views and Faster Training for Free Kangle Deng Andrew Liu Jun-Yan Zhu Deva Ramanan 164 886 0 06 Jul 2021
PlenOctrees for Real-time Rendering of Neural Radiance Fields Alex Yu Ruilong Li Matthew Tancik Hao Li Ren Ng Angjoo Kanazawa 86 1,072 0 25 Mar 2021
Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields Jonathan T. Barron B. Mildenhall Matthew Tancik Peter Hedman Ricardo Martín Brualla Pratul P. Srinivasan 94 1,961 0 24 Mar 2021
Reconstructing Hand-Object Interactions in the Wild Zhe Cao Ilija Radosavovic Angjoo Kanazawa Jitendra Malik 3DH 68 147 0 17 Dec 2020
Neural Radiance Flow for 4D View Synthesis and Video Processing Yilun Du Yinan Zhang Hong-Xing Yu J. Tenenbaum Jiajun Wu AI4CE 59 275 0 17 Dec 2020
CPF: Learning a Contact Potential Field to Model the Hand-Object Interaction Lixin Yang Xinyu Zhan Kailin Li Wenqiang Xu Jiefeng Li Cewu Lu 73 126 0 02 Dec 2020
Nerfies: Deformable Neural Radiance Fields Keunhong Park U. Sinha Jonathan T. Barron Sofien Bouaziz Dan B. Goldman S. M. Seitz Ricardo Martín Brualla 3DH 132 1,135 0 25 Nov 2020
Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wild Jason Y. Zhang Sam Pepose Hanbyul Joo Deva Ramanan Jitendra Malik Angjoo Kanazawa 105 148 0 30 Jul 2020
GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis Katja Schwarz Yiyi Liao Michael Niemeyer Andreas Geiger VGen 127 870 0 05 Jul 2020
Rescaling Egocentric Vision Dima Damen Hazel Doughty G. Farinella Antonino Furnari Evangelos Kazakos ... Davide Moltisanti Jonathan Munro Toby Perrett Will Price Michael Wray EgoV 54 454 0 23 Jun 2020
H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactions Bugra Tekin Federica Bogo Marc Pollefeys EgoV 67 253 0 10 Apr 2019
On the Continuity of Rotation Representations in Neural Networks Yi Zhou Connelly Barnes Jingwan Lu Jimei Yang Hao Li 3DH 57 1,281 0 17 Dec 2018
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric Richard Y. Zhang Phillip Isola Alexei A. Efros Eli Shechtman Oliver Wang EGVM 327 11,734 0 11 Jan 2018