DexMV: Imitation Learning for Dexterous Manipulation from Human Videos

12 August 2021

Hanwen Jiang

Papers citing "DexMV: Imitation Learning for Dexterous Manipulation from Human Videos"

50 / 141 papers shown

Title
NL2Contact: Natural Language Guided 3D Hand-Object Contact Modeling with Diffusion Model Zhongqun Zhang Hengfei Wang Ziwei Yu Yihua Cheng Angela Yao Hyung Jin Chang DiffM 41 5 0 17 Jul 2024
Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learning Runyu Ding Yuzhe Qin Jiyue Zhu Chengzhe Jia Shiqi Yang Ruihan Yang Xiaojuan Qi Xiaolong Wang 37 49 0 03 Jul 2024
Human-Agent Joint Learning for Efficient Robot Manipulation Skill Acquisition Shengcheng Luo Quanquan Peng Jun Lv Kaiwen Hong Katherine Rose Driggs-Campbell Cewu Lu Yong-Lu Li 55 3 0 29 Jun 2024
HumanPlus: Humanoid Shadowing and Imitation from Humans Zipeng Fu Qingqing Zhao Qi Wu Gordon Wetzstein Chelsea Finn SyDa 30 89 0 15 Jun 2024
Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions with Physics Haoyu Hu Xinyu Yi Zhe Cao Jun-hai Yong Feng Xu 40 2 0 04 May 2024
Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation Homanga Bharadhwaj Roozbeh Mottaghi Abhinav Gupta Shubham Tulsiani 3DPC 54 17 0 02 May 2024
What Foundation Models can Bring for Robot Learning in Manipulation : A Survey Dingzhe Li Yixiang Jin A. Yong Hongze Yu Jun Shi Xiaoshuai Hao Peng Hao Huaping Liu Gang Hua Bin Fang AI4CE LM&Ro 72 13 0 28 Apr 2024
Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representations Puhao Li Tengyu Liu Yuyang Li Muzhi Han Haoran Geng Shu Wang Yixin Zhu Song-Chun Zhu Siyuan Huang 39 16 0 26 Apr 2024
Leveraging Pretrained Latent Representations for Few-Shot Imitation Learning on a Dexterous Robotic Hand Davide Liconti Yasunori Toshimitsu Robert K. Katzschmann 54 3 0 25 Apr 2024
Single-View Scene Point Cloud Human Grasp Generation Yan-Kang Wang Chengyi Xing Yi-Lin Wei Xiao-Ming Wu Wei-Shi Zheng 31 10 0 24 Apr 2024
ViViDex: Learning Vision-based Dexterous Manipulation from Human Videos Zerui Chen Shizhe Chen Cordelia Schmid Ivan Laptev Cordelia Schmid 35 13 0 24 Apr 2024
Rank2Reward: Learning Shaped Reward Functions from Passive Video Daniel Yang Davin Tjia Jacob Berg Dima Damen Pulkit Agrawal Abhishek Gupta OffRL 40 5 0 23 Apr 2024
QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer Xueyi Liu Kangbo Lyu Jieqiong Zhang Tao Du Li Yi 43 4 0 11 Apr 2024
Learning Prehensile Dexterity by Imitating and Emulating State-only Observations Yunhai Han Zhenyang Chen Harish Ravichandar 30 5 0 08 Apr 2024
Koala: Key frame-conditioned long video-LLM Reuben Tan Ximeng Sun Ping Hu Jui-hsien Wang Hanieh Deilamsalehy Bryan A. Plummer Bryan C. Russell Kate Saenko 38 36 0 05 Apr 2024
SemGrasp: Semantic Grasp Generation via Language Aligned Discretization Kailin Li Jingbo Wang Lixin Yang Cewu Lu Bo Dai 46 16 0 04 Apr 2024
GraspXL: Generating Grasping Motions for Diverse Objects at Scale Hui Zhang Sammy Christen Zicong Fan Otmar Hilliges Mingli Song 46 30 0 28 Mar 2024
OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completion Xinyu Zhan Lixin Yang Yifei Zhao Kangrui Mao Hanlin Xu Zenan Lin Kailin Li Cewu Lu 38 20 0 28 Mar 2024
DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions Sammy Christen Shreyas Hampali Fadime Sener Edoardo Remelli Tomás Hodan Eric Sauser Shugao Ma Bugra Tekin 46 18 0 26 Mar 2024
Dexterous Functional Pre-Grasp Manipulation with Diffusion Policy Tianhao Wu Yunchong Gan Mingdong Wu Jingbo Cheng Yaodong Yang Yixin Zhu Hao Dong 54 0 0 19 Mar 2024
HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data Mengqi Zhang Yang Fu Zheng Ding Sifei Liu Zhuowen Tu Xiaolong Wang 41 17 0 18 Mar 2024
ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Images Fangqiang Ding Yunzhou Zhu Xiangyu Wen Gaowen Liu Chris Xiaoxuan Lu 42 2 0 14 Mar 2024
DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation Chen Wang Haochen Shi Weizhuo Wang Ruohan Zhang Fei-Fei Li Karen Liu 55 104 0 12 Mar 2024
Spatiotemporal Predictive Pre-training for Robotic Motor Control Jiange Yang Bei Liu Jianlong Fu Bocheng Pan Gangshan Wu Limin Wang 42 10 0 08 Mar 2024
3D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representations Yanjie Ze Gu Zhang Kangning Zhang Chenyuan Hu Muhan Wang Huazhe Xu VGen 45 78 0 06 Mar 2024
Bi-KVIL: Keypoints-based Visual Imitation Learning of Bimanual Manipulation Tasks Jianfeng Gao Xiaoshu Jin F. Krebs Noémie Jaquier Tamim Asfour SSL 47 14 0 05 Mar 2024
Tac-Man: Tactile-Informed Prior-Free Manipulation of Articulated Objects Zihang Zhao Yuyang Li Wanlin Li Zhenghao Qi Lecheng Ruan Yixin Zhu K. Althoefer 38 8 0 04 Mar 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 43 20 0 22 Feb 2024
Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots Cheng Chi Zhenjia Xu Chuer Pan Eric A. Cousineau Benjamin Burchfiel Siyuan Feng Russ Tedrake Shuran Song 17 190 0 15 Feb 2024
Learning by Watching: A Review of Video-based Learning Approaches for Robot Manipulation Chrisantus Eze Christopher Crick SSL 82 12 0 11 Feb 2024
NCRF: Neural Contact Radiance Fields for Free-Viewpoint Rendering of Hand-Object Interaction Zhongqun Zhang Jifei Song Eduardo Pérez-Pellitero Yiren Zhou Hyung Jin Chang A. Leonardis 53 0 0 08 Feb 2024
Kinematic Motion Retargeting for Contact-Rich Anthropomorphic Manipulations A. Lakshmipathy Jessica Hodgins N. S. Pollard 32 5 0 07 Feb 2024
DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity Kang-Won Lee Yuzhe Qin Xiaolong Wang Soo-Chul Lim 21 3 0 23 Jan 2024
Functional Eigen-Grasping Using Approach Heatmaps Malek Aburub Kazuki Higashi Weiwei Wan Kensuke Harada 74 1 0 22 Jan 2024
TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understanding Yun-Hai Liu Haolin Yang Xu Si Ling Liu Zipeng Li Yuxiang Zhang Yebin Liu Li Yi 59 22 0 16 Jan 2024
Learning Multi-Step Manipulation Tasks from A Single Human Demonstration Dingkun Guo 35 6 0 23 Dec 2023
Dexterous Functional Grasping Ananye Agarwal Shagun Uppal Kenneth Shaw Deepak Pathak 36 34 0 05 Dec 2023
Human Demonstrations are Generalizable Knowledge for Robots Te Cui Guangyan Chen Tianxing Zhou Zicai Peng Mengxiao Hu Haoyang Lu Haizhou Li Meiling Wang Yi Yang Yufeng Yue LM&Ro 39 6 0 05 Dec 2023
Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensing Ying Yuan Haichuan Che Yuzhe Qin Binghao Huang Zhao-Heng Yin Kang-Won Lee Yi Wu Soo-Chul Lim Xiaolong Wang 50 40 0 04 Dec 2023
Towards Generalizable Zero-Shot Manipulation via Translating Human Interaction Plans Homanga Bharadhwaj Abhi Gupta Vikash Kumar Shubham Tulsiani LM&Ro 24 38 0 01 Dec 2023
Extending Multilingual Machine Translation through Imitation Learning Wen Lai Viktor Hangya Alexander Fraser LRM CLL 19 3 0 14 Nov 2023
MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation Kelin Yu Yunhai Han Matthew Zhu Vaibhav Saxena Danfei Xu Ye Zhao 16 12 0 25 Oct 2023
H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation Yanjie Ze Yuyao Liu Ruizhe Shi Jiaxin Qin Zhecheng Yuan Jiashun Wang Huazhe Xu 31 1 0 02 Oct 2023
Task-Oriented Dexterous Hand Pose Synthesis Using Differentiable Grasp Wrench Boundary Estimator Jiayi Chen Yuxing Chen Jialiang Zhang He Wang 50 1 0 24 Sep 2023
GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators Philipp Wu Yide Shentu Zhongke Yi Xingyu Lin Pieter Abbeel 32 105 0 22 Sep 2023
General In-Hand Object Rotation with Vision and Touch Haozhi Qi Brent Yi Sudharshan Suresh Mike Lambeta Y. Ma Roberto Calandra Jitendra Malik 58 84 0 18 Sep 2023
Physically Plausible Full-Body Hand-Object Interaction Synthesis Jona Braun Sammy Christen Muhammed Kocabas Emre Aksan Otmar Hilliges 26 38 0 14 Sep 2023
LEAP Hand: Low-Cost, Efficient, and Anthropomorphic Hand for Robot Learning Kenneth Shaw Ananye Agarwal Deepak Pathak 33 80 0 12 Sep 2023
GraspGF: Learning Score-based Grasping Primitive for Human-assisting Dexterous Grasping Tianhao Wu Mingdong Wu Jiyao Zhang Yunchong Gan Hao Dong 46 20 0 12 Sep 2023
ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation Hui Zhang Sammy Christen Zicong Fan Luocheng Zheng Jemin Hwangbo Mingli Song Otmar Hilliges 32 43 0 07 Sep 2023