VideoDex: Learning Dexterity from Internet Videos

8 December 2022

Papers citing "VideoDex: Learning Dexterity from Internet Videos"

50 / 78 papers shown

Title
TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperation Hangyu Li Qin Zhao Haoran Xu Xinyu Jiang Qingwei Ben ... Jia Zeng Hanqing Wang Bo Dai Junting Dong Jiangmiao Pang 7 0 0 19 May 2025
DreamGen: Unlocking Generalization in Robot Learning through Neural Trajectories Joel Jang Seonghyeon Ye Zongyu Lin Jiannan Xiang Johan Bjorck ... D. Fox Jan Kautz Scott Reed Yuke Zhu Linxi Fan VGen OffRL AI4TS 0 0 0 19 May 2025
Imitation Learning for Adaptive Control of a Virtual Soft Exoglove Shirui Lyu Vittorio Caggiano Matteo Leonetti Dario Farina Letizia Gionfrida 13 0 0 14 May 2025
DexWild: Dexterous Human Interactions for In-the-Wild Robot Policies Tony Tao Mohan Kumar Srirama Jason Jingzhou Liu Kenneth Shaw Deepak Pathak 31 0 0 12 May 2025
X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real Prithwish Dan K. Kedia Angela Chao Edward Weiyi Duan Maximus Adrian Pace Wei-Chiu Ma Sanjiban Choudhury 23 0 0 11 May 2025
Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions Hongyi Chen Yunchao Yao Yufei Ye Zhixuan Xu Homanga Bharadhwaj Jiashun Wang Shubham Tulsiani Zackory Erickson Jeffrey Ichnowski 33 0 0 07 May 2025
KineDex: Learning Tactile-Informed Visuomotor Policies via Kinesthetic Teaching for Dexterous Manipulation Di Zhang Chengbo Yuan Chuan Wen H. Zhang Junqiao Zhao Yang Gao 34 0 0 04 May 2025
Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models Chen Wang Fei Xia Wenhao Yu Tingnan Zhang Ruohan Zhang Ce Liu Li Fei-Fei Jie Tan Jacky Liang 36 0 0 17 Apr 2025
Tool-as-Interface: Learning Robot Policies from Human Tool Usage through Imitation Learning Haonan Chen Cheng Zhu Yunzhu Li Katherine Driggs-Campbell 26 0 0 06 Apr 2025
Slot-Level Robotic Placement via Visual Imitation from Single Human Video Dandan Shan Kaichun Mo Wei Yang Yu-Wei Chao David Fouhey Dieter Fox Arsalan Mousavian 36 0 0 02 Apr 2025
ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos Junyao Shi Zhuolun Zhao Tianyou Wang Ian Pedroza Amy Luo Jie Wang Jason Ma Dinesh Jayaraman LM&Ro 50 0 0 31 Mar 2025
ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning Kailin Li Puhao Li Tengyu Liu Yuyang Li Siyuan Huang 48 3 0 27 Mar 2025
DexGrasp Anything: Towards Universal Robotic Dexterous Grasping with Physics Awareness Yiming Zhong Qi Jiang Jingyi Yu Yuexin Ma 58 2 0 11 Mar 2025
VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulation Hanzhi Chen Boyang Sun Anran Zhang Marc Pollefeys Stefan Leutenegger LM&Ro 75 0 0 10 Mar 2025
TacCap: A Wearable FBG-Based Tactile Sensor for Seamless Human-to-Robot Skill Transfer Chengyi Xing Hao Li Yi-Lin Wei Tian-Ao Ren Tianyu Tu Yuhao Lin Elizabeth Schumann Wei-Shi Zheng M. Cutkosky 69 0 0 03 Mar 2025
Human2Robot: Learning Robot Actions from Paired Human-Robot Videos Sicheng Xie Haidong Cao Zejia Weng Zhen Xing Shiwei Shen Jiaqi Leng Xipeng Qiu Yanwei Fu Zuxuan Wu Yu Jiang 56 0 0 23 Feb 2025
LEGATO: Cross-Embodiment Imitation Using a Grasping Tool Mingyo Seo H. Andy Park Shenli Yuan Yuke Zhu Luis Sentis 70 5 0 20 Feb 2025
Learning to Transfer Human Hand Skills for Robot Manipulations S. Park Seungho Lee M. Choi Jiye Lee Jeonghwan Kim Jisoo Kim Hanbyul Joo 38 1 0 07 Jan 2025
Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge Hengxu Yan Haoshu Fang Cewu Lu 76 0 0 20 Dec 2024
Reinforcement Learning from Wild Animal Videos Elliot Chane-Sane Constant Roux O. Stasse Nicolas Mansard 178 0 0 05 Dec 2024
On the Surprising Effectiveness of Spectrum Clipping in Learning Stable Linear Dynamics Hanyao Guo Yunhai Han Harish Ravichandar 81 0 0 02 Dec 2024
VLMimic: Vision Language Models are Visual Imitation Learner for Fine-grained Actions Guanyan Chen Hao Wu Te Cui Yao Mu Haoyang Lu ... Mengxiao Hu Haizhou Li Y. Li Yi Yang Yufeng Yue VLM 28 3 0 28 Oct 2024
On-Robot Reinforcement Learning with Goal-Contrastive Rewards Ondrej Biza Thomas Weng Lingfeng Sun Karl Schmeckpeper Tarik Kelestemur Yecheng Jason Ma Robert Platt Jan-Willem van de Meent Lawson L. S. Wong OffRL 45 0 0 25 Oct 2024
Latent Action Pretraining from Videos Seonghyeon Ye Joel Jang Byeongguk Jeon Sejune Joo Jianwei Yang ... Kimin Lee J. Gao Luke Zettlemoyer Dieter Fox Minjoon Seo 35 27 0 15 Oct 2024
Learning Diverse Bimanual Dexterous Manipulation Skills from Human Demonstrations Bohan Zhou Haoqi Yuan Yuhui Fu Zongqing Lu 37 11 0 03 Oct 2024
Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulation Homanga Bharadhwaj Debidatta Dwibedi Abhinav Gupta Shubham Tulsiani Carl Doersch Ted Xiao Dhruv Shah Fei Xia Dorsa Sadigh Sean Kirmani VGen LM&Ro 42 28 0 24 Sep 2024
Hand-Object Interaction Pretraining from Videos Himanshu Gaurav Singh Antonio Loquercio Carmelo Sferrazza Jane Wu Haozhi Qi Pieter Abbeel Jitendra Malik 47 13 0 12 Sep 2024
One-Shot Imitation under Mismatched Execution K. Kedia Prithwish Dan Sanjiban Choudhury Maximus Adrian Pace Sanjiban Choudhury 40 2 0 10 Sep 2024
Semantically Controllable Augmentations for Generalizable Robot Learning Zoey Chen Zhao Mandi Homanga Bharadhwaj Mohit Sharma Shuran Song Abhishek Gupta Vikash Kumar LM&Ro 37 5 0 02 Sep 2024
ACE: A Cross-Platform Visual-Exoskeletons System for Low-Cost Dexterous Teleoperation Shiqi Yang Minghuan Liu Yuzhe Qin Runyu Ding Jialong Li Xuxin Cheng Ruihan Yang Sha Yi Xiaolong Wang 32 29 0 21 Aug 2024
Contrast, Imitate, Adapt: Learning Robotic Skills From Raw Human Videos Zhifeng Qian Mingyu You Hongjun Zhou Xuanhui Xu Hao Fu Jinzhe Xue Bin He 26 0 0 10 Aug 2024
VITAL: Visual Teleoperation to Enhance Robot Learning through Human-in-the-Loop Corrections H. Kasaei M. Kasaei 37 1 0 30 Jul 2024
HRP: Human Affordances for Robotic Pre-Training Mohan Kumar Srirama Sudeep Dasari Shikhar Bahl Abhinav Gupta 35 14 0 26 Jul 2024
Flow as the Cross-Domain Manipulation Interface Mengda Xu Zhenjia Xu Yinghao Xu Cheng Chi Gordon Wetzstein Manuela Veloso Shuran Song AI4CE 40 36 0 21 Jul 2024
Adapt2Reward: Adapting Video-Language Models to Generalizable Robotic Rewards via Failure Prompts Yanting Yang Minghao Chen Qibo Qiu Jiahao Wu Wenxiao Wang Binbin Lin Ziyu Guan Xiaofei He LM&Ro 45 2 0 20 Jul 2024
TieBot: Learning to Knot a Tie from Visual Demonstration through a Real-to-Sim-to-Real Approach Weikun Peng Jun Lv Yuwei Zeng Haonan Chen Siheng Zhao Jichen Sun Cewu Lu Lin Shao 31 2 0 03 Jul 2024
Open-TeleVision: Teleoperation with Immersive Active Visual Feedback Xuxin Cheng Jialong Li Shiqi Yang Ge Yang Xiaolong Wang 61 96 0 01 Jul 2024
ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projection Arpit Bahety Priyanka Mandikal Ben Abbatematteo Roberto Martín-Martín 39 14 0 06 May 2024
Track2Act: Predicting Point Tracks from Internet Videos enables Diverse Zero-shot Robot Manipulation Homanga Bharadhwaj Roozbeh Mottaghi Abhinav Gupta Shubham Tulsiani 3DPC 54 16 0 02 May 2024
What Foundation Models can Bring for Robot Learning in Manipulation : A Survey Dingzhe Li Yixiang Jin A. Yong Hongze Yu Jun Shi Xiaoshuai Hao Peng Hao Huaping Liu Gang Hua Bin Fang AI4CE LM&Ro 72 13 0 28 Apr 2024
ViViDex: Learning Vision-based Dexterous Manipulation from Human Videos Zerui Chen Shizhe Chen Cordelia Schmid Ivan Laptev Cordelia Schmid 35 12 0 24 Apr 2024
Rank2Reward: Learning Shaped Reward Functions from Passive Video Daniel Yang Davin Tjia Jacob Berg Dima Damen Pulkit Agrawal Abhishek Gupta OffRL 37 5 0 23 Apr 2024
QuasiSim: Parameterized Quasi-Physical Simulators for Dexterous Manipulations Transfer Xueyi Liu Kangbo Lyu Jieqiong Zhang Tao Du Li Yi 43 4 0 11 Apr 2024
EVE: Enabling Anyone to Train Robots using Augmented Reality Jun Wang Chun-Cheng Chang Jiafei Duan Dieter Fox Ranjay Krishna 21 7 0 09 Apr 2024
Learning Prehensile Dexterity by Imitating and Emulating State-only Observations Yunhai Han Zhenyang Chen Harish Ravichandar 30 5 0 08 Apr 2024
Humanoid Robots at work: where are we ? Fabrice R. Noreils 40 3 0 05 Apr 2024
Fusion Dynamical Systems with Machine Learning in Imitation Learning: A Comprehensive Overview Yingbai Hu Fares J. Abu-Dakka Fei Chen Xiao Luo Zheng Li Alois C. Knoll Weiping Ding AI4CE 38 7 0 29 Mar 2024
Design and Control Co-Optimization for Automated Design Iteration of Dexterous Anthropomorphic Soft Robotic Hands Pragna Mannam Xingyu Liu Ding Zhao Jean Oh N. S. Pollard 40 0 0 15 Mar 2024
DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation Chen Wang Haochen Shi Weizhuo Wang Ruohan Zhang Fei-Fei Li Karen Liu 55 104 0 12 Mar 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 43 19 0 22 Feb 2024