DexMV: Imitation Learning for Dexterous Manipulation from Human Videos

12 August 2021

Hanwen Jiang

Papers citing "DexMV: Imitation Learning for Dexterous Manipulation from Human Videos"

45 / 45 papers shown

Title
Robust Model-Based In-Hand Manipulation with Integrated Real-Time Motion-Contact Planning and Tracking Yongpeng Jiang Mingrui Yu Xinghao Zhu M. Tomizuka Xiang-Yang Li 49 0 0 08 May 2025
Latent Adaptive Planner for Dynamic Manipulation Donghun Noh Deqian Kong Minglu Zhao Andrew Lizarraga Jianwen Xie Ying Nian Wu Dennis W. Hong 112 0 0 06 May 2025
DexCtrl: Towards Sim-to-Real Dexterity with Adaptive Controller Learning Shuqi Zhao Ke Yang Yuxin Chen Chenran Li Yichen Xie Xiang Zhang Changhao Wang M. Tomizuka 41 0 0 02 May 2025
DexFlow: A Unified Approach for Dexterous Hand Pose Retargeting and Interaction Xiaoyi Lin Kunpeng Yao Lixin Xu X. Wang Xuetao Li Y. Wang Miao Li 32 0 0 02 May 2025
RL-Driven Data Generation for Robust Vision-Based Dexterous Grasping Atsushi Kanehira Naoki Wake Kazuhiro Sasabuchi Jun Takamatsu Katsushi Ikeuchi 42 0 0 25 Apr 2025
CIVIL: Causal and Intuitive Visual Imitation Learning Yinlong Dai Robert Ramirez Sanchez Ryan Jeronimus Shahabedin Sagheb Cara M. Nunez Heramb Nemlekar Dylan P. Losey 68 0 0 24 Apr 2025
Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstration Tyler Ga Wei Lum Olivia Y. Lee C. Karen Liu Jeannette Bohg 37 1 0 17 Apr 2025
SIGHT: Single-Image Conditioned Generation of Hand Trajectories for Hand-Object Interaction Alexey Gavryushin Florian Redhardt Gaia Di Lorenzo Luc Van Gool Marc Pollefeys Kaichun Mo Xi Wang 37 0 0 28 Mar 2025
VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation Hanzhi Chen Boyang Sun Anran Zhang Marc Pollefeys Stefan Leutenegger LM&Ro 67 0 0 10 Mar 2025
AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons Hongjie Fang Chenxi Wang Yiming Wang J. Chen Shangning Xia ... Xinyu Zhan Lixin Yang Weiming Wang Cewu Lu Hao-Shu Fang 82 1 0 05 Mar 2025
Few-shot Sim2Real Based on High Fidelity Rendering with Force Feedback Teleoperation Yanwen Zou Junda Huang Boyuan Liang Honghao Guo Zhengyang Liu Xin Ma Jianshu Zhou M. Tomizuka 82 1 0 03 Mar 2025
DexTrack: Towards Generalizable Neural Tracking Control for Dexterous Manipulation from Human References Xueyi Liu Jianibieke Adalibieke Qianwei Han Yuzhe Qin Li Yi 66 3 0 13 Feb 2025
DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control Junjie Wen Y. X. Zhu Jinming Li Zhibin Tang Chaomin Shen Feifei Feng VLM 53 12 0 09 Feb 2025
Dexterous Cable Manipulation: Taxonomy, Multi-Fingered Hand Design, and Long-Horizon Manipulation Sun Zhaole Xiao Gao Xiaofeng Mao Jihong Zhu A. Billard Robert B. Fisher 54 0 0 01 Feb 2025
On the Surprising Effectiveness of Spectrum Clipping in Learning Stable Linear Dynamics Hanyao Guo Yunhai Han H. Ravichandar 76 0 0 02 Dec 2024
On-Robot Reinforcement Learning with Goal-Contrastive Rewards Ondrej Biza Thomas Weng Lingfeng Sun Karl Schmeckpeper Tarik Kelestemur Yecheng Jason Ma Robert C. Platt Jan Willem van de Meent Lawson L. S. Wong OffRL 43 0 0 25 Oct 2024
Latent Action Pretraining from Videos Seonghyeon Ye Joel Jang Byeongguk Jeon Sejune Joo Jianwei Yang ... Kimin Lee J. Gao Luke Zettlemoyer Dieter Fox Minjoon Seo 35 27 0 15 Oct 2024
DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Control Zichen Jeff Cui Hengkai Pan Aadhithya Iyer Siddhant Haldar Lerrel Pinto VGen 26 10 0 18 Sep 2024
Hand-Object Interaction Pretraining from Videos Himanshu Gaurav Singh Antonio Loquercio Carmelo Sferrazza Jane Wu Haozhi Qi Pieter Abbeel Jitendra Malik 42 13 0 12 Sep 2024
One-Shot Imitation under Mismatched Execution K. Kedia Prithwish Dan Sanjiban Choudhury Maximus Adrian Pace Sanjiban Choudhury 37 2 0 10 Sep 2024
Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions with Physics Haoyu Hu Xinyu Yi Zhe Cao Jun-hai Yong Feng Xu 38 2 0 04 May 2024
Learning Prehensile Dexterity by Imitating and Emulating State-only Observations Yunhai Han Zhenyang Chen H. Ravichandar 30 5 0 08 Apr 2024
Koala: Key frame-conditioned long video-LLM Reuben Tan Ximeng Sun Ping Hu Jui-hsien Wang Hanieh Deilamsalehy Bryan A. Plummer Bryan C. Russell Kate Saenko 38 35 0 05 Apr 2024
ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Images Fangqiang Ding Yunzhou Zhu Xiangyu Wen Gaowen Liu Chris Xiaoxuan Lu 36 2 0 14 Mar 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 40 19 0 22 Feb 2024
Functional Eigen-Grasping Using Approach Heatmaps Malek Aburub Kazuki Higashi Weiwei Wan Kensuke Harada 64 1 0 22 Jan 2024
Human Demonstrations are Generalizable Knowledge for Robots Te Cui Guangyan Chen Tianxing Zhou Zicai Peng Mengxiao Hu Haoyang Lu Haizhou Li Meiling Wang Yi Yang Yufeng Yue LM&Ro 29 6 0 05 Dec 2023
H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation Yanjie Ze Yuyao Liu Ruizhe Shi Jiaxin Qin Zhecheng Yuan Jiashun Wang Huazhe Xu 28 1 0 02 Oct 2023
GraspGF: Learning Score-based Grasping Primitive for Human-assisting Dexterous Grasping Tianhao Wu Mingdong Wu Jiyao Zhang Yunchong Gan Hao Dong 36 20 0 12 Sep 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 32 85 0 21 Aug 2023
AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation System Yuzhe Qin Wei Yang Binghao Huang Karl Van Wyk Hao Su Xiaolong Wang Yu-Wei Chao D. Fox 28 91 0 10 Jul 2023
Affordances from Human Videos as a Versatile Representation for Robotics Shikhar Bahl Russell Mendonca Lili Chen Unnat Jain Deepak Pathak 37 160 0 17 Apr 2023
Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environments Jiye Lee Hanbyul Joo 22 37 0 09 Jan 2023
Learning to Imitate Object Interactions from Internet Videos Austin Patel Andrew E. Wang Ilija Radosavovic Jitendra Malik 29 21 0 23 Nov 2022
Learning Reward Functions for Robotic Manipulation by Observing Humans Minttu Alakuijala Gabriel Dulac-Arnold Julien Mairal Jean Ponce Cordelia Schmid OffRL 30 26 0 16 Nov 2022
DexTransfer: Real World Multi-fingered Dexterous Grasping with Minimal Human Demonstrations Zoey Qiuyu Chen Karl Van Wyk Yu-Wei Chao Wei Yang Arsalan Mousavian Abhishek Gupta D. Fox 35 21 0 28 Sep 2022
Learning Dexterous Manipulation from Exemplar Object Trajectories and Pre-Grasps Sudeep Dasari Abhi Gupta Vikash Kumar 40 42 0 22 Sep 2022
Graph Inverse Reinforcement Learning from Diverse Videos Sateesh Kumar Jonathan Zamora Nicklas Hansen Rishabh Jangir Xiaolong Wang 27 53 0 28 Jul 2022
Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning Yuanpei Chen Tianhao Wu Shengjie Wang Xidong Feng Jiechuan Jiang ... Yiran Geng Hao Dong Zongqing Lu Song-Chun Zhu Yaodong Yang OffRL 33 108 0 17 Jun 2022
From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation Yuzhe Qin Hao Su Xiaolong Wang 17 98 0 26 Apr 2022
Learning Generalizable Dexterous Manipulation from Human Grasp Affordance Yueh-hua Wu Jiashun Wang Xiaolong Wang 21 55 0 05 Apr 2022
Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulation Sridhar Pandian Arunachalam Sneha Silwal Ben Evans Lerrel Pinto 31 101 0 24 Mar 2022
HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction Yunze Liu Yun-Hai Liu Chen Jiang Kangbo Lyu Weikang Wan Hao Shen Bo-Hua Liang Zhoujie Fu He-Nan Wang Li Yi 45 172 0 03 Mar 2022
Learning by Watching: Physical Imitation of Manipulation Skills from Human Videos Haoyu Xiong Quanzhou Li Yun-Chun Chen Homanga Bharadhwaj Samarth Sinha Animesh Garg SSL 119 93 0 18 Jan 2021
FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images Christiane Zimmermann Duygu Ceylan Jimei Yang Bryan C. Russell Max Argus Thomas Brox 3DH 189 397 0 10 Sep 2019