DexMV: Imitation Learning for Dexterous Manipulation from Human Videos

12 August 2021

Hanwen Jiang

Papers citing "DexMV: Imitation Learning for Dexterous Manipulation from Human Videos"

41 / 141 papers shown

Title
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 49 87 0 21 Aug 2023
InterTracker: Discovering and Tracking General Objects Interacting with Hands in the Wild Yan Shao Qi Ye Wenhan Luo Kaihao Zhang Jiming Chen 31 0 0 06 Aug 2023
Learning Generalizable Tool Use with Non-rigid Grasp-pose Registration Malte Mosbach Sven Behnke 33 2 0 31 Jul 2023
Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations Moo Jin Kim Jiajun Wu Chelsea Finn 21 7 0 12 Jul 2023
AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation System Yuzhe Qin Wei Yang Binghao Huang Karl Van Wyk Hao Su Xiaolong Wang Yu-Wei Chao Dieter Fox 42 94 0 10 Jul 2023
DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects Chen Bao Helin Xu Yuzhe Qin Xiaolong Wang 25 32 0 09 May 2023
Learning Hand-Held Object Reconstruction from In-The-Wild Videos Aditya Prakash Matthew Chang Matthew Jin Saurabh Gupta 3DH 20 3 0 04 May 2023
ContactArt: Learning 3D Interaction Priors for Category-level Articulated Object and Hand Poses Estimation Zehao Zhu Jiashun Wang Yuzhe Qin Deqing Sun Varun Jampani Xiaolong Wang DiffM 45 14 0 02 May 2023
Affordances from Human Videos as a Versatile Representation for Robotics Shikhar Bahl Russell Mendonca Lili Chen Unnat Jain Deepak Pathak 44 164 0 17 Apr 2023
POEM: Reconstructing Hand in a Point Embedded Multi-view Stereo Lixin Yang Jian Xu Licheng Zhong Xinyu Zhan Zhicheng Wang Kejian Wu Cewu Lu 28 7 0 08 Apr 2023
DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics Sizhe Li Zhiao Huang Tao Chen Tao Du Hao Su J. Tenenbaum Chuang Gan 83 19 0 27 Mar 2023
Affordance Diffusion: Synthesizing Hand-Object Interactions Yufei Ye Xueting Li Abhi Gupta Shalini De Mello Stan Birchfield Jiaming Song Shubham Tulsiani Sifei Liu DiffM 38 76 0 21 Mar 2023
Rotating without Seeing: Towards In-hand Dexterity through Touch Zhao-Heng Yin Binghao Huang Yuzhe Qin Qifeng Chen Xiaolong Wang 104 91 0 20 Mar 2023
UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policy Yinzhen Xu Weikang Wan Jialiang Zhang Haoran Liu Zikang Shan ... Yijia Weng Jiayi Chen Tengyu Liu Li Yi He Wang 64 115 0 02 Mar 2023
Zero-Shot Robot Manipulation from Passive Human Videos Homanga Bharadhwaj Abhi Gupta Shubham Tulsiani Vikash Kumar 26 35 0 03 Feb 2023
Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environments Jiye Lee Hanbyul Joo 27 37 0 09 Jan 2023
VideoDex: Learning Dexterity from Internet Videos Kenneth Shaw Shikhar Bahl Deepak Pathak 30 89 0 08 Dec 2022
HERD: Continuous Human-to-Robot Evolution for Learning from Human Demonstration Xingyu Liu Deepak Pathak Kris M. Kitani 21 7 0 08 Dec 2022
Accelerating Interactive Human-like Manipulation Learning with GPU-based Simulation and High-quality Demonstrations Malte Mosbach Kara Moraw Sven Behnke 18 13 0 05 Dec 2022
Learning to Imitate Object Interactions from Internet Videos Austin Patel Andrew E. Wang Ilija Radosavovic Jitendra Malik 29 21 0 23 Nov 2022
DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulation Yuzhe Qin Binghao Huang Zhao-Heng Yin Hao Su Xiaolong Wang 3DPC 31 78 0 17 Nov 2022
Learning Reward Functions for Robotic Manipulation by Observing Humans Minttu Alakuijala Gabriel Dulac-Arnold Julien Mairal Jean Ponce Cordelia Schmid OffRL 37 26 0 16 Nov 2022
Multi-Finger Grasping Like Humans Yuming Du Philippe Weinzaepfel Vincent Lepetit Romain Brégier 20 6 0 14 Nov 2022
Learning Robust Real-World Dexterous Grasping Policies via Implicit Shape Augmentation Zoey Qiuyu Chen Karl Van Wyk Yu-Wei Chao Wei Yang Arsalan Mousavian Abhishek Gupta Dieter Fox 31 29 0 24 Oct 2022
DexTransfer: Real World Multi-fingered Dexterous Grasping with Minimal Human Demonstrations Zoey Qiuyu Chen Karl Van Wyk Yu-Wei Chao Wei Yang Arsalan Mousavian Abhishek Gupta Dieter Fox 35 21 0 28 Sep 2022
Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wild Jiayi Chen Min Yan Jiazhao Zhang Yinzhen Xu Xiaolong Li Yijia Weng Li Yi Shuran Song He Wang 3DH 55 15 0 24 Sep 2022
Learning Dexterous Manipulation from Exemplar Object Trajectories and Pre-Grasps Sudeep Dasari Abhi Gupta Vikash Kumar 52 42 0 22 Sep 2022
Signs of Language: Embodied Sign Language Fingerspelling Acquisition from Demonstrations for Human-Robot Interaction Federico Tavella Aphrodite Galata Angelo Cangelosi 19 1 0 12 Sep 2022
Graph Inverse Reinforcement Learning from Diverse Videos Sateesh Kumar Jonathan Zamora Nicklas Hansen Rishabh Jangir Xiaolong Wang 35 53 0 28 Jul 2022
Learning Continuous Grasping Function with a Dexterous Hand from Human Demonstrations Jianglong Ye Jiashun Wang Binghao Huang Yuzhe Qin Xiaolong Wang 117 51 0 11 Jul 2022
Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning Yuanpei Chen Tianhao Wu Shengjie Wang Xidong Feng Jiechuan Jiang ... Yiran Geng Hao Dong Zongqing Lu Song-Chun Zhu Yaodong Yang OffRL 38 109 0 17 Jun 2022
Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey Takehiko Ohkawa Ryosuke Furuta Yoichi Sato 3DH 27 20 0 05 Jun 2022
From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation Yuzhe Qin Hao Su Xiaolong Wang 27 99 0 26 Apr 2022
Learning Generalizable Dexterous Manipulation from Human Grasp Affordance Yueh-hua Wu Jiashun Wang Xiaolong Wang 26 55 0 05 Apr 2022
OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction Lixin Yang Kailin Li Xinyu Zhan Fei Wu Anran Xu Liu Liu Cewu Lu 31 93 0 29 Mar 2022
Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulation Sridhar Pandian Arunachalam Sneha Silwal Ben Evans Lerrel Pinto 35 101 0 24 Mar 2022
Masked Visual Pre-training for Motor Control Tete Xiao Ilija Radosavovic Trevor Darrell Jitendra Malik SSL 34 242 0 11 Mar 2022
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction Yunze Liu Yun-Hai Liu Chen Jiang Kangbo Lyu Weikang Wan Hao Shen Bo-Hua Liang Zhoujie Fu He Wang Li Yi 45 173 0 03 Mar 2022
D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions Sammy Christen Muhammed Kocabas Emre Aksan Jemin Hwangbo Mingli Song Otmar Hilliges 114 103 0 01 Dec 2021
Learning by Watching: Physical Imitation of Manipulation Skills from Human Videos Haoyu Xiong Quanzhou Li Yun-Chun Chen Homanga Bharadhwaj Samarth Sinha Animesh Garg SSL 128 93 0 18 Jan 2021
FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images Christiane Zimmermann Duygu Ceylan Jimei Yang Bryan C. Russell Max Argus Thomas Brox 3DH 189 399 0 10 Sep 2019