Visual Imitation Enables Contextual Humanoid Control

6 May 2025

Papers citing "Visual Imitation Enables Contextual Humanoid Control"

48 / 48 papers shown

Title
PyRoki: A Modular Toolkit for Robot Kinematic Optimization Chung Min Kim Brent Yi Hongsuk Choi Yi Ma Ken Goldberg Angjoo Kanazawa 83 2 0 06 May 2025
TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization Liang Pan Zeshi Yang Zhiyang Dou Wenjia Wang Buzhen Huang Bo Dai Taku Komura Jingbo Wang 97 4 0 25 Mar 2025
Continuous 3D Perception Model with Persistent State Qianqian Wang Yifei Zhang Aleksander Holyñski Alexei A. Efros Angjoo Kanazawa VGen 100 41 0 21 Jan 2025
Align3R: Aligned Monocular Depth Estimation for Dynamic Videos Jiahao Lu Tianyu Huang Peng Li Zhiyang Dou Cheng Lin Zhiming Cui Z. Dong Sai-Kit Yeung Wenping Wang Yuan Liu VGen MDE 131 10 0 04 Dec 2024
Learning Humanoid Locomotion with Perceptive Internal Model Junfeng Long Junli Ren Moji Shi Ziyi Wang Tao Huang Ping Luo Jiangmiao Pang 124 23 0 21 Nov 2024
Estimating Body and Hand Motion in an Ego-sensed World Brent Yi Vickie Ye Maya Zheng Lea Müller Georgios Pavlakos Yi Ma Jitendra Malik Angjoo Kanazawa DiffM 68 8 0 04 Oct 2024
Learning Humanoid Locomotion over Challenging Terrain Ilija Radosavovic Sarthak Kamat Trevor Darrell Jitendra Malik 46 13 0 04 Oct 2024
MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion Junyi Zhang Charles Herrmann Junhwa Hur Varun Jampani Trevor Darrell Forrester Cole Deqing Sun Ming-Hsuan Yang VGen 140 89 0 04 Oct 2024
MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpainting Chen Tessler Yunrong Guo Ofir Nabati Gal Chechik Xue Bin Peng VGen AI4CE 73 33 0 22 Sep 2024
Hand-Object Interaction Pretraining from Videos Himanshu Gaurav Singh Antonio Loquercio Carmelo Sferrazza Jane Wu Haozhi Qi Pieter Abbeel Jitendra Malik 65 17 0 12 Sep 2024
GeoCalib: Learning Single-image Calibration with Geometric Optimization Alexander Veicht Paul-Edouard Sarlin Philipp Lindenberger Marc Pollefeys 51 7 0 10 Sep 2024
SAM 2: Segment Anything in Images and Videos Nikhila Ravi Valentin Gabeur Yuan-Ting Hu Ronghang Hu Chaitanya K. Ryali ... Nicolas Carion Chao-Yuan Wu Ross B. Girshick Piotr Dollár Christoph Feichtenhofer VLM MLLM 116 871 0 01 Aug 2024
Expressive Whole-Body 3D Gaussian Avatar Gyeongsik Moon Takaaki Shiratori Shunsuke Saito VGen 50 33 0 31 Jul 2024
DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabrics Tyler Ga Wei Lum Martin Matak Viktor Makoviychuk Ankur Handa Arthur Allshire Tucker Hermans Nathan D. Ratliff Karl Van Wyk 70 16 0 02 Jul 2024
MultiPhys: Multi-Person Physics-aware 3D Motion Estimation Nicolas Ugrinovic Boxiao Pan Georgios Pavlakos Despoina Paschalidou Bokui Shen Jordi Sánchez-Riera Francesc Moreno-Noguer Leonidas Guibas 3DH 51 5 0 18 Apr 2024
TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos Yufu Wang ZiYun Wang Lingjie Liu Kostas Daniilidis 71 32 0 26 Mar 2024
Learning Human-to-Humanoid Real-Time Whole-Body Teleoperation Tairan He Zhengyi Luo Wenli Xiao Chong Zhang Kris Kitani Changliu Liu Guanya Shi 64 92 0 07 Mar 2024
Humanoid Locomotion as Next Token Prediction Ilija Radosavovic Bike Zhang Baifeng Shi Jathushan Rajasegaran Sarthak Kamat Trevor Darrell Koushil Sreenath Jitendra Malik LM&Ro 69 65 0 29 Feb 2024
WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion Soyong Shin Juyong Kim Eni Halilaj Michael J. Black 3DH 89 76 0 12 Dec 2023
PACE: Human and Camera Motion Estimation from in-the-wild Videos Muhammed Kocabas Ye Yuan Pavlo Molchanov Yunrong Guo Michael J. Black Otmar Hilliges Jan Kautz Umar Iqbal 3DH 63 15 0 20 Oct 2023
Universal Humanoid Motion Representations for Physics-Based Control Zhengyi Luo Jinkun Cao Josh Merel Alexander Winkler Jing Huang Kris Kitani Weipeng Xu 53 57 0 06 Oct 2023
ANYmal Parkour: Learning Agile Navigation for Quadrupedal Robots David Hoeller Nikita Rudin Dhionis V. Sako Marco Hutter 87 149 0 26 Jun 2023
Neural Kernel Surface Reconstruction Jiahui Huang Zan Gojcic Matan Atzmon Or Litany Sanja Fidler Francis Williams 3DV 59 73 0 31 May 2023
On the Benefits of 3D Pose and Tracking for Human Action Recognition Jathushan Rajasegaran Georgios Pavlakos Angjoo Kanazawa Christoph Feichtenhofer Jitendra Malik 72 34 0 03 Apr 2023
SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments Yudi Dai Yi Lin Xiping Lin Chenglu Wen Lan Xu Hongwei Yi Siqiu Shen Yuexin Ma China 3DH 59 40 0 16 Mar 2023
Real-World Humanoid Locomotion with Reinforcement Learning Ilija Radosavovic Tete Xiao Bike Zhang Trevor Darrell Jitendra Malik Koushil Sreenath 76 136 0 06 Mar 2023
Decoupling Human and Camera Motion from Videos in the Wild Vickie Ye Georgios Pavlakos Jitendra Malik Angjoo Kanazawa 3DH 64 86 0 24 Feb 2023
Synthesizing Physical Character-Scene Interactions Mohamed Hassan Yunrong Guo Tingwu Wang Michael J. Black Sanja Fidler Xue Bin Peng 81 84 0 02 Feb 2023
Legged Locomotion in Challenging Terrains using Egocentric Vision Ananye Agarwal Ashish Kumar Jitendra Malik Deepak Pathak 68 216 0 14 Nov 2022
D&D: Learning Human Dynamics from Dynamic Camera Jiefeng Li Siyuan Bian Chaoshun Xu Gang Liu Gang Yu Cewu Lu 53 39 0 19 Sep 2022
Capturing and Inferring Dense Full-Body Human-Scene Contact C. Huang Hongwei Yi Markus Hoschle Matvey Safroshkin Tsvetelina Alexiadis Senya Polikovsky D. Scharstein Michael J. Black 3DH 73 125 0 20 Jun 2022
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation Yufei Xu Jing Zhang Qiming Zhang Dacheng Tao ViT 67 531 0 26 Apr 2022
GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras Ye Yuan Umar Iqbal Pavlo Molchanov Kris Kitani Jan Kautz 3DH 87 118 0 02 Dec 2021
Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning Nikita Rudin David Hoeller Philipp Reist Marco Hutter 237 575 0 24 Sep 2021
Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning Viktor Makoviychuk Lukasz Wawrzyniak Yunrong Guo Michelle Lu Kier Storey ... David Hoeller Nikita Rudin Arthur Allshire Ankur Handa Gavriel State 158 1,072 0 24 Aug 2021
Learning Motion Priors for 4D Human Body Capture in 3D Scenes Siwei Zhang Yan Zhang Federica Bogo Marc Pollefeys Siyu Tang 3DH 71 104 0 23 Aug 2021
FAST-LIO2: Fast Direct LiDAR-inertial Odometry Wei Xu Yixi Cai Dongjiao He Jiarong Lin Fu Zhang 41 869 0 14 Jul 2021
RMA: Rapid Motor Adaptation for Legged Robots Ashish Kumar Zipeng Fu Deepak Pathak Jitendra Malik 137 575 0 08 Jul 2021
SimPoE: Simulated Character Control for 3D Human Pose Estimation Ye Yuan S. Wei Tomas Simon Kris Kitani Jason M. Saragih 115 134 0 01 Apr 2021
Robust Motion In-betweening Félix G. Harvey Mike Yurick Derek Nowrouzezahrai C. Pal VGen 59 257 0 09 Feb 2021
Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans Sida Peng Yuanqing Zhang Yinghao Xu Qianqian Wang Qing Shuai Hujun Bao Xiaowei Zhou 3DH 269 701 0 31 Dec 2020
Learning Quadrupedal Locomotion over Challenging Terrain Joonho Lee Jemin Hwangbo Lorenz Wellhausen V. Koltun Marco Hutter 118 1,170 0 21 Oct 2020
VIBE: Video Inference for Human Body Pose and Shape Estimation Muhammed Kocabas Nikos Athanasiou Michael J. Black 3DH 67 928 0 11 Dec 2019
Learning agile and dynamic motor skills for legged robots Jemin Hwangbo Joonho Lee Alexey Dosovitskiy Dario Bellicoso Vassilios Tsounis V. Koltun Marco Hutter 103 1,308 0 24 Jan 2019
DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills Xue Bin Peng Pieter Abbeel Sergey Levine M. van de Panne AI4CE 224 498 0 08 Apr 2018
2D/3D Pose Estimation and Action Recognition using Multitask Deep Learning D. Luvizon David Picard Hedi Tabia 3DH 154 484 0 26 Feb 2018
End-to-end Recovery of Human Shape and Pose Angjoo Kanazawa Michael J. Black David Jacobs Jitendra Malik 3DH 200 1,795 0 18 Dec 2017
Proximal Policy Optimization Algorithms John Schulman Filip Wolski Prafulla Dhariwal Alec Radford Oleg Klimov OffRL 463 19,006 0 20 Jul 2017