Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation

12 September 2022

Papers citing "Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation"

50 / 106 papers shown

Title
Mitigating the Human-Robot Domain Discrepancy in Visual Pre-training for Robotic Manipulation Jiaming Zhou Teli Ma Kun-Yu Lin Ronghe Qiu Zifan Wang Junwei Liang 57 5 0 20 Jun 2024
Language-Guided Manipulation with Diffusion Policies and Constrained Inpainting Ce Hao Kelvin Lin Siyuan Luo Harold Soh 41 4 0 14 Jun 2024
BAKU: An Efficient Transformer for Multi-Task Policy Learning Siddhant Haldar Zhuoran Peng Lerrel Pinto OffRL 51 28 0 11 Jun 2024
Visual Representation Learning with Stochastic Frame Prediction Huiwon Jang Dongyoung Kim Junsu Kim Jinwoo Shin Pieter Abbeel Younggyo Seo 47 2 0 11 Jun 2024
Interpretable Robotic Manipulation from Language Boyuan Zheng Jianlong Zhou Fang Chen LM&Ro 46 0 0 27 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 82 45 0 23 May 2024
Learning Manipulation Skills through Robot Chain-of-Thought with Sparse Failure Guidance Kaifeng Zhang Zhao-Heng Yin Weirui Ye Yang Gao 70 3 0 22 May 2024
Natural Language Can Help Bridge the Sim2Real Gap Albert Yu Adeline Foote Raymond J. Mooney Roberto Martín-Martín LM&Ro 51 11 0 16 May 2024
Chameleon: A Data-Efficient Generalist for Dense Visual Prediction in the Wild Donggyun Kim Seongwoong Cho Semin Kim Chong Luo Seunghoon Hong VLM 45 2 0 29 Apr 2024
AdaDemo: Data-Efficient Demonstration Expansion for Generalist Robotic Agent Tongzhou Mu Yijie Guo Jie Xu Ankit Goyal Hao Su Dieter Fox Animesh Garg LM&Ro 49 0 0 11 Apr 2024
EVE: Enabling Anyone to Train Robots using Augmented Reality Jun Wang Chun-Cheng Chang Jiafei Duan Dieter Fox Ranjay Krishna 31 6 0 09 Apr 2024
JUICER: Data-Efficient Imitation Learning for Robotic Assembly Lars Ankile Anthony Simeonov Idan Shenfeld Pulkit Agrawal LM&Ro 42 15 0 04 Apr 2024
Temporal and Semantic Evaluation Metrics for Foundation Models in Post-Hoc Analysis of Robotic Sub-tasks Jonathan Salfity Selma Wanna Minkyu Choi Mitch Pryor 43 1 0 25 Mar 2024
DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset Alexander Khazatsky Karl Pertsch Suraj Nair Ashwin Balakrishna Sudeep Dasari ... Thomas Kollar Sergey Levine Chelsea Finn Sergey Levine Chelsea Finn 61 182 0 19 Mar 2024
GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping Yuhang Zheng Xiangyu Chen Yupeng Zheng Songen Gu Runyi Yang ... Chao Yang Dawei Wang Zhen Chen Xiaoxiao Long Meiqing Wang 63 44 0 14 Mar 2024
DNAct: Diffusion Guided Multi-Task 3D Policy Learning Ge Yan Yueh-hua Wu Xiaolong Wang VGen 37 20 0 07 Mar 2024
Talk Through It: End User Directed Manipulation Learning Carl Winge Adam Imdieke Bahaa Aldeeb Dongyeop Kang Karthik Desingh LM&Ro 49 1 0 19 Feb 2024
Improving Token-Based World Models with Parallel Observation Prediction Lior Cohen Kaixin Wang Bingyi Kang Shie Mannor 38 3 0 08 Feb 2024
Offline Actor-Critic Reinforcement Learning Scales to Large Models Jost Tobias Springenberg A. Abdolmaleki Jingwei Zhang Oliver Groth Michael Bloesch ... Sarah Bechtle Steven Kapturowski Roland Hafner N. Heess Martin Riedmiller OffRL LRM 27 12 0 08 Feb 2024
LHManip: A Dataset for Long-Horizon Language-Grounded Manipulation Tasks in Cluttered Tabletop Environments Federico Ceola Lorenzo Natale Niko Sünderhauf Krishan Rana LM&Ro 42 1 0 19 Dec 2023
Human Demonstrations are Generalizable Knowledge for Robots Te Cui Guangyan Chen Tianxing Zhou Zicai Peng Mengxiao Hu Haoyang Lu Haizhou Li Meiling Wang Yi Yang Yufeng Yue LM&Ro 41 6 0 05 Dec 2023
Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language Corrections Lihan Zha Yuchen Cui Li-Heng Lin Minae Kwon Montse Gonzalez Arenas Andy Zeng Fei Xia Dorsa Sadigh 35 36 0 17 Nov 2023
Learning Generalizable Manipulation Policies with Object-Centric 3D Representations Yifeng Zhu Zhenyu Jiang Peter Stone Yuke Zhu 3DPC 29 45 0 22 Oct 2023
Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning Jiachen Li Qiaozi Gao Michael Johnston Xiaofeng Gao Xuehai He Suhaila Shakiah Hangjie Shi R. Ghanadan William Y. Wang LM&Ro 29 12 0 14 Oct 2023
Universal Visual Decomposer: Long-Horizon Manipulation Made Easy Zichen Zhang Yunshuang Li Osbert Bastani Abhishek Gupta Dinesh Jayaraman Yecheng Jason Ma Luca Weihs 37 17 0 12 Oct 2023
How Physics and Background Attributes Impact Video Transformers in Robotic Manipulation: A Case Study on Planar Pushing Shutong Jin Ruiyu Wang Muhammad Zahid Florian T. Pokorny 38 1 0 03 Oct 2023
CLIPUNetr: Assisting Human-robot Interface for Uncalibrated Visual Servoing Control with CLIP-driven Referring Expression Segmentation Chen Jiang Yuchen Yang Martin Jägersand 34 1 0 17 Sep 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 51 87 0 21 Aug 2023
Skill Transformer: A Monolithic Policy for Mobile Manipulation Xiaoyu Huang Dhruv Batra Akshara Rai Andrew Szot LM&Ro 38 21 0 19 Aug 2023
MOMA-Force: Visual-Force Imitation for Real-World Mobile Manipulation Taozheng Yang Yaxing Jing Hongtao Wu Jiafeng Xu Kuankuan Sima Guangzeng Chen Qie Sima Tao Kong 20 19 0 07 Aug 2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control Anthony Brohan Noah Brown Justice Carbajal Yevgen Chebotar Xi Chen ... Ted Xiao Peng Xu Sichun Xu Tianhe Yu Brianna Zitkovich LM&Ro LRM 35 1,116 0 28 Jul 2023
Distilled Feature Fields Enable Few-Shot Language-Guided Manipulation Bokui (William) Shen Ge Yang Alan Yu J. Wong L. Kaelbling Phillip Isola VLM 34 104 0 27 Jul 2023
"Tidy Up the Table": Grounding Common-sense Objective for Tabletop Object Rearrangement Yiqing Xu David Hsu LM&Ro LMTD 34 0 0 21 Jul 2023
Multi-Stage Cable Routing through Hierarchical Imitation Learning Jianlan Luo Charles Xu Xinyang Geng Gilbert Feng Kuan Fang L. Tan S. Schaal Sergey Levine 38 53 0 18 Jul 2023
An Integrated FPGA Accelerator for Deep Learning-based 2D/3D Path Planning Keisuke Sugiura Hiroki Matsutani 3DPC 23 3 0 30 Jun 2023
On the Efficacy of 3D Point Cloud Reinforcement Learning Z. Ling Yuan Yao Xuanlin Li H. Su 3DPC 34 13 0 11 Jun 2023
Transferring Foundation Models for Generalizable Robotic Manipulation Jiange Yang Wenhui Tan Chuhao Jin Keling Yao Bei Liu Jianlong Fu Ruihua Song Gangshan Wu Limin Wang LM&Ro 57 6 0 09 Jun 2023
Multimodal Web Navigation with Instruction-Finetuned Foundation Models Hiroki Furuta Kuang-Huei Lee Ofir Nachum Yutaka Matsuo Aleksandra Faust S. Gu Izzeddin Gur LM&Ro 36 93 0 19 May 2023
Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model Siyuan Huang Zhengkai Jiang Hao Dong Yu Qiao Peng Gao Hongsheng Li LM&Ro 33 93 0 18 May 2023
Latent Space Planning for Multi-Object Manipulation with Environment-Aware Relational Classifiers Yixuan Huang Nichols Crawford Taylor Adam Conkey Weiyu Liu Tucker Hermans 39 7 0 18 May 2023
ERRA: An Embodied Representation and Reasoning Architecture for Long-horizon Language-conditioned Manipulation Tasks Chao Zhao Shuai Yuan Chunli Jiang Junhao Cai Hongyu Yu M. Y. Wang Qifeng Chen LM&Ro 29 14 0 05 Apr 2023
Chain-of-Thought Predictive Control Zhiwei Jia Vineet Thumuluri Fangchen Liu Ling-Hao Chen Zhiao Huang H. Su LM&Ro 39 20 0 03 Apr 2023
Open-World Object Manipulation using Pre-trained Vision-Language Models Austin Stone Ted Xiao Yao Lu K. Gopalakrishnan Kuang-Huei Lee ... Sean Kirmani Brianna Zitkovich F. Xia Chelsea Finn Karol Hausman LM&Ro 156 145 0 02 Mar 2023
Grounded Decoding: Guiding Text Generation with Grounded Models for Embodied Agents Wenlong Huang Fei Xia Dhruv Shah Danny Driess Andy Zeng ... Pete Florence Igor Mordatch Sergey Levine Karol Hausman Brian Ichter LM&Ro 32 43 0 01 Mar 2023
Language-Driven Representation Learning for Robotics Siddharth Karamcheti Suraj Nair Annie S. Chen Thomas Kollar Chelsea Finn Dorsa Sadigh Percy Liang LM&Ro SSL 47 145 0 24 Feb 2023
MimicPlay: Long-Horizon Imitation Learning by Watching Human Play Chen Wang Linxi Fan Jiankai Sun Ruohan Zhang Li Fei-Fei Danfei Xu Yuke Zhu Anima Anandkumar 46 184 0 24 Feb 2023
ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills Jiayuan Gu Fanbo Xiang Xuanlin Li Z. Ling Xiqiang Liu ... Xiao Yuan P. Xie Zhiao Huang Rui Chen Hao Su 34 176 0 09 Feb 2023
A Data-Efficient Visual-Audio Representation with Intuitive Fine-tuning for Voice-Controlled Robots Peixin Chang Shuijing Liu Tianchen Ji Neeloy Chakraborty Kaiwen Hong Katherine Driggs-Campbell 51 3 0 23 Jan 2023
One-Shot Neural Fields for 3D Object Understanding Valts Blukis Taeyeop Lee Jonathan Tremblay Bowen Wen In So Kweon Kuk-Jin Yoon Dieter Fox Stan Birchfield 37 6 0 21 Oct 2022
VIMA: General Robot Manipulation with Multimodal Prompts Yunfan Jiang Agrim Gupta Zichen Zhang Guanzhi Wang Yongqiang Dou Yanjun Chen Li Fei-Fei Anima Anandkumar Yuke Zhu Linxi Fan LM&Ro 38 338 0 06 Oct 2022