Learning to See before Learning to Act: Visual Pre-training for Manipulation

1 July 2021

Shuran Song

Papers citing "Learning to See before Learning to Act: Visual Pre-training for Manipulation"

24 / 24 papers shown

Title
DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control Junjie Wen Bo Li Jinming Li Zhibin Tang Chaomin Shen Feifei Feng VLM 63 14 0 09 Feb 2025
Feature Extractor or Decision Maker: Rethinking the Role of Visual Encoders in Visuomotor Policies Ruiyu Wang Zheyu Zhuang Shutong Jin Nils Ingelhag Danica Kragic Florian T. Pokorny 38 0 0 30 Sep 2024
CyberDemo: Augmenting Simulated Human Demonstration for Real-World Dexterous Manipulation Jun Wang Yuzhe Qin Kaiming Kuang Yigit Korkmaz Akhilan Gurumoorthy Hao Su Xiaolong Wang 43 20 0 22 Feb 2024
What Makes Pre-Trained Visual Representations Successful for Robust Manipulation? Kaylee Burns Zach Witzel Jubayer Ibn Hamid Tianhe Yu Chelsea Finn Karol Hausman OOD SSL 32 23 0 03 Nov 2023
Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulation Annie Xie Lisa Lee Ted Xiao Chelsea Finn 25 55 0 07 Jul 2023
Transferring Foundation Models for Generalizable Robotic Manipulation Jiange Yang Wenhui Tan Chuhao Jin Keling Yao Bei Liu Jianlong Fu Ruihua Song Gangshan Wu Limin Wang LM&Ro 57 6 0 09 Jun 2023
Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation Mohit Sharma Claudio Fantacci Yuxiang Zhou Skanda Koppula N. Heess Jonathan Scholz Y. Aytar VLM 52 29 0 13 Apr 2023
Open-World Object Manipulation using Pre-trained Vision-Language Models Austin Stone Ted Xiao Yao Lu K. Gopalakrishnan Kuang-Huei Lee ... Sean Kirmani Brianna Zitkovich F. Xia Chelsea Finn Karol Hausman LM&Ro 156 145 0 02 Mar 2023
Heuristic-free Optimization of Force-Controlled Robot Search Strategies in Stochastic Environments Bastian Alt Darko Katic Rainer Jäkel Michael Beetz 27 6 0 15 Jul 2022
Don't Start From Scratch: Leveraging Prior Data to Automate Robotic Reinforcement Learning Homer Walke Jonathan Yang Albert Yu Aviral Kumar Jedrzej Orbik Avi Singh Sergey Levine OffRL OnRL 29 32 0 11 Jul 2022
Object Manipulation via Visual Target Localization Kiana Ehsani Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 26 9 0 15 Mar 2022
Masked Visual Pre-training for Motor Control Tete Xiao Ilija Radosavovic Trevor Darrell Jitendra Malik SSL 34 242 0 11 Mar 2022
The Unsurprising Effectiveness of Pre-Trained Vision Models for Control Simone Parisi Aravind Rajeswaran Senthil Purushwalkam Abhinav Gupta LM&Ro 34 187 0 07 Mar 2022
DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Video Priyanka Mandikal Kristen Grauman 143 93 0 01 Feb 2022
Can Wikipedia Help Offline Reinforcement Learning? Machel Reid Yutaro Yamada S. Gu 3DV RALM OffRL 140 95 0 28 Jan 2022
Robot Skill Adaptation via Soft Actor-Critic Gaussian Mixture Models Iman Nematollahi Erick Rosete-Beas Adrian Rofer Tim Welschehold Abhinav Valada Wolfram Burgard 19 15 0 25 Nov 2021
CLIPort: What and Where Pathways for Robotic Manipulation Mohit Shridhar Lucas Manuelli Dieter Fox LM&Ro 65 632 0 24 Sep 2021
GKNet: grasp keypoint network for grasp candidates detection Ruinian Xu Fu-Jen Chu Patricio A. Vela 3DPC 24 37 0 16 Jun 2021
Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations Zhenyu Jiang Yifeng Zhu Maxwell Svetlik Kuan Fang Yuke Zhu 28 139 0 04 Apr 2021
DIPN: Deep Interaction Prediction Network with Application to Clutter Removal Baichuan Huang Shuai D. Han Abdeslam Boularias Jingjin Yu AI4CE 14 61 0 09 Nov 2020
S3K: Self-Supervised Semantic Keypoints for Robotic Manipulation via Multi-View Consistency Mel Vecerík Jean-Baptiste Regli Oleg O. Sushkov David Barker Rugile Pevceviciute Thomas Rothörl C. Schuster R. Hadsell Lourdes Agapito Jonathan Scholz 3DPC 18 40 0 30 Sep 2020
Learning Dexterous Grasping with Object-Centric Visual Affordances Priyanka Mandikal Kristen Grauman 30 135 0 03 Sep 2020
Spatial Action Maps for Mobile Manipulation Jimmy Wu Xingyuan Sun Andy Zeng Shuran Song Johnny Lee Szymon Rusinkiewicz Thomas Funkhouser 24 71 0 20 Apr 2020
TossingBot: Learning to Throw Arbitrary Objects with Residual Physics Andy Zeng Shuran Song Johnny Lee Alberto Rodriguez Thomas Funkhouser 37 375 0 27 Mar 2019