Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model

18 May 2023

Yu Qiao

Papers citing "Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model"

25 / 75 papers shown

Title
Making Harmful Behaviors Unlearnable for Large Language Models Xin Zhou Yi Lu Ruotian Ma Tao Gui Qi Zhang Xuanjing Huang MU 41 9 0 02 Nov 2023
Towards A Natural Language Interface for Flexible Multi-Agent Task Assignment Jake Brawer Kayleigh Bishop Bradley Hayes A. Roncone 13 4 0 31 Oct 2023
Creative Robot Tool Use with Large Language Models Mengdi Xu Peide Huang Wenhao Yu Shiqi Liu Xilun Zhang Yaru Niu Tingnan Zhang Fei Xia Jie Tan Ding Zhao LM&Ro LLMAG 37 39 0 19 Oct 2023
Eureka: Human-Level Reward Design via Coding Large Language Models Yecheng Jason Ma William Liang Guanzhi Wang De-An Huang Osbert Bastani Dinesh Jayaraman Yuke Zhu Linxi Fan A. Anandkumar 30 293 0 19 Oct 2023
Multimodal Large Language Model for Visual Navigation Yao-Hung Tsai Vansh Dhar Jialu Li Bowen Zhang Jian Zhang VLM LM&Ro 24 9 0 12 Oct 2023
Octopus: Embodied Vision-Language Programmer from Environmental Feedback Jingkang Yang Yuhao Dong Shuai Liu Bo-wen Li Ziyue Wang ... Haoran Tan Jiamu Kang Yuanhan Zhang Kaiyang Zhou Ziwei Liu LM&Ro 52 46 0 12 Oct 2023
Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehicles Can Cui Yunsheng Ma Xu Cao Wenqian Ye Ziran Wang 30 80 0 12 Oct 2023
Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To! Xiangyu Qi Yi Zeng Tinghao Xie Pin-Yu Chen Ruoxi Jia Prateek Mittal Peter Henderson SILM 70 533 0 05 Oct 2023
DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models Licheng Wen Daocheng Fu Xin Li Xinyu Cai Tengyu Ma Pinlong Cai Min Dou Botian Shi Liang He Yu Qiao 34 146 0 28 Sep 2023
Natural Language based Context Modeling and Reasoning for Ubiquitous Computing with Large Language Models: A Tutorial Haoyi Xiong Jiang Bian Sijia Yang Xiaofei Zhang Linghe Kong Daqing Zhang LRM LLMAG 35 5 0 24 Sep 2023
Bridging Zero-shot Object Navigation and Foundation Models through Pixel-Guided Navigation Skill Wenzhe Cai Siyuan Huang Guangran Cheng Yuxing Long Peng Gao Changyin Sun Hao Dong LM&Ro 25 41 0 19 Sep 2023
Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles Can Cui Yunsheng Ma Xu Cao Wenqian Ye Ziran Wang 21 107 0 19 Sep 2023
SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models S. S. Kannan Vishnunandan L. N. Venkatesh Byung-Cheol Min LLMAG LM&Ro 29 101 0 18 Sep 2023
Cognitive Architectures for Language Agents T. Sumers Shunyu Yao Karthik Narasimhan Thomas L. Griffiths LLMAG LM&Ro 56 154 0 05 Sep 2023
Testing the Depth of ChatGPT's Comprehension via Cross-Modal Tasks Based on ASCII-Art: GPT3.5's Abilities in Regard to Recognizing and Generating ASCII-Art Are Not Totally Lacking David Bayani MLLM 36 5 0 28 Jul 2023
Drive Like a Human: Rethinking Autonomous Driving with Large Language Models Daocheng Fu Xin Li Licheng Wen Min Dou Pinlong Cai Botian Shi Yu Qiao 32 151 0 14 Jul 2023
RoCo: Dialectic Multi-Robot Collaboration with Large Language Models Zhao Mandi Shreeya Jain Shuran Song LM&Ro LLMAG 31 125 0 10 Jul 2023
Visual Adversarial Examples Jailbreak Aligned Large Language Models Xiangyu Qi Kaixuan Huang Ashwinee Panda Peter Henderson Mengdi Wang Prateek Mittal AAML 25 138 0 22 Jun 2023
A Comprehensive Survey on Segment Anything Model for Vision and Beyond Chunhui Zhang Li Liu Yawen Cui Guanjie Huang Weilin Lin Yiqian Yang Yuehong Hu VLM 43 90 0 14 May 2023
Real-World Robot Learning with Masked Visual Pre-training Ilija Radosavovic Tete Xiao Stephen James Pieter Abbeel Jitendra Malik Trevor Darrell SSL 156 241 0 06 Oct 2022
DALL-E-Bot: Introducing Web-Scale Diffusion Models to Robotics Ivan Kapelyukh Vitalis Vosylius Edward Johns LM&Ro DiffM 113 146 0 05 Oct 2022
Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation Mohit Shridhar Lucas Manuelli Dieter Fox LM&Ro 166 460 0 12 Sep 2022
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 328 4,077 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 339 12,003 0 04 Mar 2022
Ego4D: Around the World in 3,000 Hours of Egocentric Video Kristen Grauman Andrew Westbury Eugene Byrne Zachary Chavis Antonino Furnari ... Mike Zheng Shou Antonio Torralba Lorenzo Torresani Mingfei Yan Jitendra Malik EgoV 253 1,024 0 13 Oct 2021