Transferring Dexterous Manipulation from GPU Simulation to a Remote Real-World TriFinger

22 August 2021

Mayank Mittal

Stefan Bauer

Papers citing "Transferring Dexterous Manipulation from GPU Simulation to a Remote Real-World TriFinger"

50 / 54 papers shown

Title
MatchMaker: Automated Asset Generation for Robotic Assembly Yian Wang Bingjie Tang Chuang Gan Dieter Fox Kaichun Mo Yashraj S. Narang Iretiayo Akinola 53 0 0 07 Mar 2025
Design of a low-cost and lightweight 6 DoF bimanual arm for dynamic and contact-rich manipulation Jaehyung Kim Jiho Kim Dongryung Lee Yujin Jang Beomjoon Kim 48 0 0 24 Feb 2025
Dynamic object goal pushing with mobile manipulators through model-free constrained reinforcement learning Ioannis Dadiotis Mayank Mittal Nikos Tsagarakis Marco Hutter 66 2 0 03 Feb 2025
Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge Hengxu Yan Haoshu Fang Cewu Lu 76 0 0 20 Dec 2024
Sampling-Based Model Predictive Control for Dexterous Manipulation on a Biomimetic Tendon-Driven Hand Adrian Hess Alexander M. Kübler Benedek Forrai Mehmet Dogar Robert K. Katzschmann 33 1 0 09 Nov 2024
Local Policies Enable Zero-shot Long-horizon Manipulation Murtaza Dalal Min Liu Walter Talbott Chen Chen Deepak Pathak Jian Zhang Ruslan Salakhutdinov 44 3 0 29 Oct 2024
On the Feasibility of A Mixed-Method Approach for Solving Long Horizon Task-Oriented Dexterous Manipulation Shaunak A. Mehta Rana Soltani Zarrin 31 0 0 09 Oct 2024
Whole-body End-Effector Pose Tracking Tifanny Portela Andrei Cramariuc Mayank Mittal Marco Hutter 52 3 0 24 Sep 2024
DemoStart: Demonstration-led auto-curriculum applied to sim-to-real with multi-fingered robots Maria Bauzá José Enrique Chen Valentin Dalibard Nimrod Gileadi Roland Hafner ... Martin Riedmiller Jon Scholz Konstantinos Bousmalis Francesco Nori Nicolas Heess 34 5 0 10 Sep 2024
RP1M: A Large-Scale Motion Dataset for Piano Playing with Bi-Manual Dexterous Robot Hands Yi Zhao Le Chen Jan Schneider Quankai Gao Arno Solin Bernhard Scholkopf Joni Pajarinen Le Chen 33 1 0 20 Aug 2024
ContactSDF: Signed Distance Functions as Multi-Contact Models for Dexterous Manipulation Wen Yang Wanxin Jin 50 3 0 18 Aug 2024
Complementarity-Free Multi-Contact Modeling and Optimization for Dexterous Manipulation Wanxin Jin 61 6 0 14 Aug 2024
FORGE: Force-Guided Exploration for Robust Contact-Rich Manipulation under Uncertainty Michael Noseworthy Bingjie Tang Bowen Wen Ankur Handa Nicholas Roy Nicholas Roy Dieter Fox Yashraj S. Narang Iretiayo Akinola Iretiayo Akinola 54 8 0 08 Aug 2024
Vegetable Peeling: A Case Study in Constrained Dexterous Manipulation Tao Chen Eric A. Cousineau Naveen Kuppuswamy Pulkit Agrawal 32 7 0 10 Jul 2024
AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch Max Yang Chenghua Lu Alex Church Yijiong Lin Christopher J. Ford Haoran Li Efi Psomopoulou David A.W. Barton Nathan Lepora 60 15 0 12 May 2024
ORBIT-Surgical: An Open-Simulation Framework for Learning Surgical Augmented Dexterity Qinxi Yu Masoud Moghani K. Dharmarajan Vincent Schorp Will Panitch ... Kush Hari Huang Huang Mayank Mittal Ken Goldberg Animesh Garg 40 14 0 24 Apr 2024
Scaling Population-Based Reinforcement Learning with GPU Accelerated Simulation Asad Ali Shahid Yashraj S. Narang Vincenzo Petrone Enrico Ferrentino Ankur Handa Dieter Fox Marco Pavone L. Roveda 40 3 0 04 Apr 2024
Exploring CausalWorld: Enhancing robotic manipulation via knowledge transfer and curriculum learning Xinrui Wang Yan Jin 40 1 0 25 Mar 2024
CORN: Contact-based Object Representation for Nonprehensile Manipulation of General Unseen Objects Yoonyoung Cho Junhyek Han Yoontae Cho Beomjoon Kim 42 8 0 16 Mar 2024
Symmetry Considerations for Learning Task Symmetric Robot Policies Mayank Mittal Nikita Rudin Victor Klemm Arthur Allshire Marco Hutter 46 11 0 07 Mar 2024
$R$\times$R: Rapid eXploration for Reinforcement Learning via Sampling-based Reset Distributions and Imitation Pre-training$ R $\times$ R: Rapid eXploration for Reinforcement Learning via Sampling-based Reset Distributions and Imitation Pre-training Gagan Khandate Tristan L. Saidi Siqi Shang Eric T. Chang Yang Liu Seth Matthew Dennis Johnson Adams M. Ciocarlie 45 4 0 27 Jan 2024
MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations Ajay Mandlekar Soroush Nasiriany Bowen Wen Iretiayo Akinola Yashraj S. Narang Linxi Fan Yuke Zhu Dieter Fox LM&Ro 90 100 0 26 Oct 2023
Enhancing Task Performance of Learned Simplified Models via Reinforcement Learning Hien Bui Michael Posa 29 1 0 15 Oct 2023
EARL: Eye-on-Hand Reinforcement Learner for Dynamic Grasping with Active Pose Estimation Baichuan Huang Jingjin Yu Siddarth Jain 40 9 0 10 Oct 2023
REBOOT: Reuse Data for Bootstrapping Efficient Real-World Dexterous Manipulation Zheyuan Hu Aaron Rovinsky Jianlan Luo Vikash Kumar Abhishek Gupta Sergey Levine OffRL 22 9 0 06 Sep 2023
Pre- and post-contact policy decomposition for non-prehensile manipulation with zero-shot sim-to-real transfer Minchan Kim Junhyek Han Jaehyung Kim Beomjoon Kim 27 17 0 06 Sep 2023
Learning Whole-body Manipulation for Quadrupedal Robot S. Jeon Moonkyu Jung Suyoung Choi Beomjoon Kim Jemin Hwangbo 18 28 0 31 Aug 2023
Real Robot Challenge 2022: Learning Dexterous Manipulation from Offline Data in the Real World Nicolas Gurtler Felix Widmaier Cansu Sancaktar Sebastian Blaes Pavel Kolev ... Arman Raayatsanati Hehui Zheng Barnabas Gavin Cangan Bernhard Schölkopf Georg Martius OffRL 35 2 0 15 Aug 2023
Getting the Ball Rolling: Learning a Dexterous Policy for a Biomimetic Tendon-Driven Hand with Rolling Contact Joints Yasunori Toshimitsu Benedek Forrai Barnabas Gavin Cangan U. Steger Manuel Knecht Stefan Weirich Robert K. Katzschmann 26 20 0 04 Aug 2023
Benchmarking Offline Reinforcement Learning on Real-Robot Hardware Nico Gürtler Sebastian Blaes Pavel Kolev Felix Widmaier Manuel Wüthrich Stefan Bauer Bernhard Schölkopf Georg Martius OffRL 33 28 0 28 Jul 2023
Robust Visual Sim-to-Real Transfer for Robotic Manipulation Ricardo Garcia Pinel Robin Strudel Shizhe Chen Etienne Arlaud Ivan Laptev Cordelia Schmid OffRL 28 4 0 28 Jul 2023
Learning Continuous Control with Geometric Regularity from Robot Intrinsic Symmetry Shengchao Yan Baohe Zhang Yuan Zhang Joschka Boedecker Wolfram Burgard 24 2 0 28 Jun 2023
IndustReal: Transferring Contact-Rich Assembly Tasks from Simulation to Reality Bingjie Tang Michael A. Lin Iretiayo Akinola Ankur Handa Gaurav Sukhatme Fabio Ramos Dieter Fox Yashraj S. Narang OffRL 27 44 0 26 May 2023
DexPBT: Scaling up Dexterous Manipulation for Hand-Arm Systems with Population Based Training Aleksei Petrenko Arthur Allshire Gavriel State Ankur Handa Viktor Makoviychuk 32 23 0 20 May 2023
Progressive Transfer Learning for Dexterous In-Hand Manipulation with Multi-Fingered Anthropomorphic Hand Yongkang Luo Wanyi Li Peng Wang Haonan Duan Wei Wei Jia sun 38 1 0 19 Apr 2023
Dexterous In-Hand Manipulation of Slender Cylindrical Objects through Deep Reinforcement Learning with Tactile Sensing Wenbin Hu Bidan Huang Wang Wei Lee Sibei Yang Yu Zheng Zhibin Li 8 9 0 11 Apr 2023
Dexterous In-hand Manipulation by Guiding Exploration with Simple Sub-skill Controllers Gagan Khandate C. Mehlman Xingsheng Wei M. Ciocarlie 25 3 0 06 Mar 2023
Sampling-based Exploration for Reinforcement Learning of Dexterous Manipulation Gagan Khandate Siqi Shang Eric Chang Tristan L. Saidi Yang Liu Seth Matthew Dennis Johnson Adams M. Ciocarlie 57 30 0 06 Mar 2023
Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments Mayank Mittal C. Yu Qinxi Yu Jingzhou Liu Nikita Rudin ... Ajay Mandlekar Buck Babich Gavriel State Marco Hutter Animesh Garg 47 170 0 10 Jan 2023
Dexterous Manipulation from Images: Autonomous Real-World RL via Substep Guidance Kelvin Xu Zheyuan Hu Ria Doshi Aaron Rovinsky Vikash Kumar Abhishek Gupta Sergey Levine 32 19 0 19 Dec 2022
Task-Driven Hybrid Model Reduction for Dexterous Manipulation Wanxin Jin Michael Posa 35 15 0 30 Nov 2022
Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapes Tao Chen Megha H. Tippur Siyang Wu Vikash Kumar Edward H. Adelson Pulkit Agrawal 28 112 0 21 Nov 2022
DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality Ankur Handa Arthur Allshire Viktor Makoviychuk Aleksei Petrenko Ritvik Singh ... Balakumar Sundaralingam Yashraj S. Narang Jean-Francois Lafleche Dieter Fox Gavriel State 40 148 0 25 Oct 2022
Grasp'D: Differentiable Contact-rich Grasp Synthesis for Multi-fingered Hands Dylan Turpin Liquang Wang Eric Heiden Yun-Chun Chen Miles Macklin Stavros Tsogkas Sven J. Dickinson Animesh Garg 18 67 0 25 Aug 2022
Dexterous Robotic Manipulation using Deep Reinforcement Learning and Knowledge Transfer for Complex Sparse Reward-based Tasks Qiang Wang Francisco Roldan Sanchez Robert McCarthy David Córdova Bulens Kevin McGuinness Noel E. O'Connor M. Wuthrich Felix Widmaier Stefan Bauer S. Redmond 15 14 0 19 May 2022
Factory: Fast Contact for Robotic Assembly Yashraj S. Narang Kier Storey Iretiayo Akinola Miles Macklin Philipp Reist ... Ádám Moravánszky Gavriel State Michelle Lu Ankur Handa Dieter Fox 32 74 0 07 May 2022
Learning to Fold Real Garments with One Arm: A Case Study in Cloud-Based Robotics Research Ryan Hoque K. Shivakumar Shrey Aeron Gabriel Deza Aditya Ganapathi Adrian S. Wong Johnny Lee Andy Zeng Vincent Vanhoucke Ken Goldberg 31 21 0 21 Apr 2022
Accelerated Policy Learning with Parallel Differentiable Simulation Jie Xu Viktor Makoviychuk Yashraj S. Narang Fabio Ramos Wojciech Matusik Animesh Garg Miles Macklin 21 85 0 14 Apr 2022
Compositional Multi-Object Reinforcement Learning with Linear Relation Networks Davide Mambelli Frederik Trauble Stefan Bauer Bernhard Schölkopf Francesco Locatello OCL 33 17 0 31 Jan 2022
Assistive Tele-op: Leveraging Transformers to Collect Robotic Task Demonstrations Henry M. Clever Ankur Handa H. Mazhar Kevin Parker Omer Shapira Qian Wan Yashraj S. Narang Iretiayo Akinola Maya Cakmak Dieter Fox 20 18 0 09 Dec 2021