Open-vocabulary Pick and Place via Patch-level Semantic Maps

21 June 2024

Haojie Huang

Robin Walters

Robert Platt

Stefanie Tellex

LM&Ro

ArXiv (abs)PDF HTML

Papers citing "Open-vocabulary Pick and Place via Patch-level Semantic Maps"

28 / 28 papers shown

Title
Efficient Alignment of Unconditioned Action Prior for Language-conditioned Pick and Place in Clutter Kechun Xu Xunlong Xia Kaixuan Wang Yifei Yang Yunxuan Mao Bing Deng R. Xiong Yansen Wang OffRL 161 0 0 12 Mar 2025
Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D Hao-zhe Huang Owen Howell Dian Wang Xu Zhu Robin Walters Robert Platt 92 25 0 22 Jan 2024
EquivAct: SIM(3)-Equivariant Visuomotor Policies beyond Rigid Object Manipulation Jingyun Yang Congyue Deng Jimmy Wu Rika Antonova Leonidas Guibas Jeannette Bohg LM&Ro 86 36 0 24 Oct 2023
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models Wenlong Huang Chen Wang Ruohan Zhang Yunzhu Li Jiajun Wu Li Fei-Fei LM&Ro 114 517 0 12 Jul 2023
Diffusion Policy: Visuomotor Policy Learning via Action Diffusion Cheng Chi Zhenjia Xu S. Feng Eric A. Cousineau Yilun Du Benjamin Burchfiel Russ Tedrake Shuran Song 349 1,231 0 07 Mar 2023
Open-World Object Manipulation using Pre-trained Vision-Language Models Austin Stone Ted Xiao Yao Lu K. Gopalakrishnan Kuang-Huei Lee ... Sean Kirmani Brianna Zitkovich F. Xia Chelsea Finn Karol Hausman LM&Ro 255 155 0 02 Mar 2023
Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection Hao-zhe Huang Dian Wang Xu Zhu Robin Walters Robert Platt 3DPC 71 37 0 31 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts Yunfan Jiang Agrim Gupta Zichen Zhang Guanzhi Wang Yongqiang Dou Yanjun Chen Li Fei-Fei Anima Anandkumar Yuke Zhu Linxi Fan LM&Ro 103 355 0 06 Oct 2022
Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learning Hyunwoo Ryu Jeong-Hoon Lee Honglak Lee Jongeun Choi 92 57 0 16 Jun 2022
Toward Compositional Generalization in Object-Oriented World Modeling Linfeng Zhao Lingzhi Kong Robin Walters Lawson L. S. Wong OCL 70 22 0 28 Apr 2022
Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Items Laura Downs Anthony G. Francis Nate Koenig Brandon Kinman R. Hickman Krista Reymann T. B. McHugh Vincent Vanhoucke LM&Ro 109 500 0 25 Apr 2022
Learning Symmetric Embeddings for Equivariant World Models Jung Yeon Park Ondrej Biza Linfeng Zhao Jan-Willem van de Meent Robin Walters 73 45 0 24 Apr 2022
Do As I Can, Not As I Say: Grounding Language in Robotic Affordances Michael Ahn Anthony Brohan Noah Brown Yevgen Chebotar Omar Cortes ... Ted Xiao Peng Xu Sichun Xu Mengyuan Yan Andy Zeng LM&Ro 192 1,984 0 04 Apr 2022
R3M: A Universal Visual Representation for Robot Manipulation Suraj Nair Aravind Rajeswaran Vikash Kumar Chelsea Finn Abhi Gupta LM&Ro 101 584 0 23 Mar 2022
Equivariant Transporter Network Hao-zhe Huang Dian Wang Robin Walters Robert Platt 100 59 0 18 Feb 2022
A Survey of Vision-Language Pre-Trained Models Yifan Du Zikang Liu Junyi Li Wayne Xin Zhao VLM 117 187 0 18 Feb 2022
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Anthony Simeonov Yilun Du Andrea Tagliasacchi J. Tenenbaum Alberto Rodriguez Pulkit Agrawal Vincent Sitzmann 122 248 0 09 Dec 2021
Equivariant $Q$ Learning in Spatial Action Spaces Dian Wang Robin Walters Xu Zhu Robert Platt 86 78 0 28 Oct 2021
CLIPort: What and Where Pathways for Robotic Manipulation Mohit Shridhar Lucas Manuelli Dieter Fox LM&Ro 123 658 0 24 Sep 2021
Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisation Stephen James Kentaro Wada Tristan Laidlow Andrew J. Davison 76 133 0 23 Jun 2021
Perceiver: General Perception with Iterative Attention Andrew Jaegle Felix Gimeno Andrew Brock Andrew Zisserman Oriol Vinyals João Carreira VLM ViT MDE 207 1,022 0 04 Mar 2021
General $E(2)$ -Equivariant Steerable CNNs Maurice Weiler Gabriele Cesa 115 524 0 19 Nov 2019
Self-Supervised Correspondence in Visuomotor Policy Learning Peter R. Florence Lucas Manuelli Russ Tedrake SSL 86 163 0 16 Sep 2019
Deep Learning using Rectified Linear Units (ReLU) Abien Fred Agarap 74 3,235 0 22 Mar 2018
FiLM: Visual Reasoning with a General Conditioning Layer Ethan Perez Florian Strub H. D. Vries Vincent Dumoulin Aaron Courville FAtt AIMat OffRL AI4CE 363 2,233 0 22 Sep 2017
Vision-Based Multi-Task Manipulation for Inexpensive Robots Using End-To-End Learning from Demonstration Rouhollah Rahmatizadeh P. Abolghasemi Ladislau Bölöni Sergey Levine 102 258 0 10 Jul 2017
Steerable CNNs Taco S. Cohen Max Welling BDL 142 499 0 27 Dec 2016
Group Equivariant Convolutional Networks Taco S. Cohen Max Welling BDL 171 1,945 0 24 Feb 2016