Learning to See before Learning to Act: Visual Pre-training for
Manipulation

Learning to See before Learning to Act: Visual Pre-training for Manipulation

1 July 2021

Shuran Song

Papers citing "Learning to See before Learning to Act: Visual Pre-training for Manipulation"

19 / 19 papers shown

Title
DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control Junjie Wen Y. X. Zhu Jinming Li Zhibin Tang Chaomin Shen Feifei Feng VLM 53 12 0 09 Feb 2025
Feature Extractor or Decision Maker: Rethinking the Role of Visual Encoders in Visuomotor Policies Ruiyu Wang Zheyu Zhuang Shutong Jin Nils Ingelhag Danica Kragic Florian T. Pokorny 26 0 0 30 Sep 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 40 19 0 22 Feb 2024
What Makes Pre-Trained Visual Representations Successful for Robust Manipulation? Kaylee Burns Zach Witzel Jubayer Ibn Hamid Tianhe Yu Chelsea Finn Karol Hausman OOD SSL 25 22 0 03 Nov 2023
Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulation Annie Xie Lisa Lee Ted Xiao Chelsea Finn 21 54 0 07 Jul 2023
Transferring Foundation Models for Generalizable Robotic Manipulation Jiange Yang Wenhui Tan Chuhao Jin Keling Yao Bei Liu Jianlong Fu Ruihua Song Gangshan Wu Limin Wang LM&Ro 47 6 0 09 Jun 2023
Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation Mohit Sharma Claudio Fantacci Yuxiang Zhou Skanda Koppula N. Heess Jonathan Scholz Y. Aytar VLM 42 29 0 13 Apr 2023
Open-World Object Manipulation using Pre-trained Vision-Language Models Austin Stone Ted Xiao Yao Lu K. Gopalakrishnan Kuang-Huei Lee ... Sean Kirmani Brianna Zitkovich F. Xia Chelsea Finn Karol Hausman LM&Ro 142 144 0 02 Mar 2023
Heuristic-free Optimization of Force-Controlled Robot Search Strategies in Stochastic Environments Bastian Alt Darko Katic Rainer Jäkel Michael Beetz 16 6 0 15 Jul 2022
Don't Start From Scratch: Leveraging Prior Data to Automate Robotic Reinforcement Learning Homer Walke Jonathan Yang Albert Yu Aviral Kumar Jedrzej Orbik Avi Singh Sergey Levine OffRL OnRL 25 32 0 11 Jul 2022
Object Manipulation via Visual Target Localization Kiana Ehsani Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 24 9 0 15 Mar 2022
The Unsurprising Effectiveness of Pre-Trained Vision Models for Control Simone Parisi Aravind Rajeswaran Senthil Purushwalkam Abhinav Gupta LM&Ro 26 186 0 07 Mar 2022
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video Priyanka Mandikal Kristen Grauman 133 94 0 01 Feb 2022
Can Wikipedia Help Offline Reinforcement Learning? Machel Reid Yutaro Yamada S. Gu 3DV RALM OffRL 129 95 0 28 Jan 2022
Robot Skill Adaptation via Soft Actor-Critic Gaussian Mixture Models Iman Nematollahi Erick Rosete-Beas Adrian Rofer Tim Welschehold Abhinav Valada Wolfram Burgard 17 15 0 25 Nov 2021
CLIPort: What and Where Pathways for Robotic Manipulation Mohit Shridhar Lucas Manuelli D. Fox LM&Ro 34 629 0 24 Sep 2021
GKNet: grasp keypoint network for grasp candidates detection Ruinian Xu Fu-Jen Chu Patricio A. Vela 3DPC 22 37 0 16 Jun 2021
Learning Dexterous Grasping with Object-Centric Visual Affordances Priyanka Mandikal Kristen Grauman 21 134 0 03 Sep 2020
TossingBot: Learning to Throw Arbitrary Objects with Residual Physics Andy Zeng Shuran Song Johnny Lee Alberto Rodriguez Thomas Funkhouser 26 374 0 27 Mar 2019