1

EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World

Ryan Punamiya
Simar Kareer
Zeyi Liu
Josh Citron
Ri-Zhao Qiu
Xiongyi Cai
Alexey Gavryushin
Jiaqi Chen
Davide Liconti
Lawrence Y. Zhu
Patcharapong Aphiwetsa
Baoyu Li
Aniketh Cheluva
Pranav Kuppili
Yangcen Liu
Dhruv Patel
Aidan Gao
Hye-Young Chung
Ryan Co
Renee Zbizika
Jeff Liu
Xiaomeng Xu
Haoyu Xiong
Geng Chen
Sebastiano Oliani
Chenyu Yang
Xi Wang
James Fort
Richard Newcombe
Josh Gao
Jason Chong
Garrett Matsuda
Aseem Doriwala
Marc Pollefeys
Robert Katzschmann
Xiaolong Wang
Shuran Song
Judy Hoffman
Danfei Xu
Main:8 Pages
19 Figures
Bibliography:4 Pages
15 Tables
Appendix:9 Pages
Abstract

Robot learning increasingly depends on large and diverse data, yet robot data collection remains expensive and difficult to scale. Egocentric human data offer a promising alternative by capturing rich manipulation behavior across everyday environments. However, existing human datasets are often limited in scope, difficult to extend, and fragmented across institutions. We introduce EgoVerse, a collaborative platform for human data-driven robot learning that unifies data collection, processing, and access under a shared framework, enabling contributions from individual researchers, academic labs, and industry partners. The current release includes 1,362 hours (80k episodes) of human demonstrations spanning 1,965 tasks, 240 scenes, and 2,087 unique demonstrators, with standardized formats, manipulation-relevant annotations, and tooling for downstream learning. Beyond the dataset, we conduct a large-scale study of human-to-robot transfer with experiments replicated across multiple labs, tasks, and robot embodiments under shared protocols. We find that policy performance generally improves with increased human data, but that effective scaling depends on alignment between human data and robot learning objectives. Together, the dataset, platform, and study establish a foundation for reproducible progress in human data-driven robot learning. Videos and additional information can be found atthis https URL

View on arXiv
Comments on this paper