Papers citing "Do As I Can, Not As I Say: Grounding Language in Robotic Affordances"

50 / 402 papers shown

Title
DAG-Plan: Generating Directed Acyclic Dependency Graphs for Dual-Arm Cooperative Planning Zeyu Gao Yao Mu Jinye Qu Mengkang Hu Lingyue Guo Ping Luo Yanfeng Lu Ping Luo Shanghang Zhang Yanfeng Lu 54 10 0 14 Jun 2024
Grounding Multimodal Large Language Models in Actions Andrew Szot Bogdan Mazoure Harsh Agrawal Devon Hjelm Z. Kira Alexander Toshev LM&Ro 40 10 0 12 Jun 2024
BAKU: An Efficient Transformer for Multi-Task Policy Learning Siddhant Haldar Zhuoran Peng Lerrel Pinto OffRL 46 28 0 11 Jun 2024
The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models Seungone Kim Juyoung Suk Ji Yong Cho Shayne Longpre Chaeeun Kim ... Sean Welleck Graham Neubig Moontae Lee Kyungjae Lee Minjoon Seo ELM ALM LM&MA 105 31 0 09 Jun 2024
LGR2: Language Guided Reward Relabeling for Accelerating Hierarchical Reinforcement Learning Utsav Singh Pramit Bhattacharyya Vinay P. Namboodiri LM&Ro 47 1 0 09 Jun 2024
Trust the PRoC3S: Solving Long-Horizon Robotics Problems with LLMs and Constraint Satisfaction Aidan Curtis Nishanth Kumar Jing Cao Tomás Lozano-Pérez Leslie Pack Kaelbling 56 10 0 08 Jun 2024
Language Guided Skill Discovery Seungeun Rho Laura Smith Tianyu Li Sergey Levine Xue Bin Peng Sehoon Ha LM&Ro 42 4 0 07 Jun 2024
Open-Endedness is Essential for Artificial Superhuman Intelligence Edward Hughes Michael Dennis Jack Parker-Holder Feryal M. P. Behbahani Aditi Mavalankar Yuge Shi Tom Schaul Tim Rocktaschel LRM 42 22 0 06 Jun 2024
Re-ReST: Reflection-Reinforced Self-Training for Language Agents Zi-Yi Dou Cheng-Fu Yang Xueqing Wu Kai-Wei Chang Nanyun Peng LRM 88 7 0 03 Jun 2024
Evaluating Uncertainty-based Failure Detection for Closed-Loop LLM Planners Zhi Zheng Qian Feng Hang Li Alois C. Knoll Jianxiang Feng 54 6 0 01 Jun 2024
"Pass the butter": A study on desktop-classic multitasking robotic arm based on advanced YOLOv7 and BERT Haohua Que Wenbin Pan Jie Xu Hao Luo Pei Wang Li Zhang 39 1 0 27 May 2024
VICtoR: Learning Hierarchical Vision-Instruction Correlation Rewards for Long-horizon Manipulation Kuo-Han Hung Pang-Chi Lo Jia-Fong Yeh Han-Yuan Hsu Yi-Ting Chen Winston H. Hsu 33 0 0 26 May 2024
MeMo: Meaningful, Modular Controllers via Noise Injection Megan Tjandrasuwita Jie Xu Armando Solar-Lezama Wojciech Matusik 26 0 0 24 May 2024
Reinforcing Language Agents via Policy Optimization with Action Decomposition Muning Wen Bo Liu Weinan Zhang Jun Wang Ying Wen 46 8 0 23 May 2024
Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration Yang Zhang Shixin Yang Chenjia Bai Fei Wu Xiu Li Zhen Wang Xuelong Li LLMAG 36 25 0 23 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 82 43 0 23 May 2024
Learning Manipulation Skills through Robot Chain-of-Thought with Sparse Failure Guidance Kaifeng Zhang Zhao-Heng Yin Weirui Ye Yang Gao 70 3 0 22 May 2024
LLM+Reasoning+Planning for Supporting Incomplete User Queries in Presence of APIs Sudhir Agarwal A. Sreepathy David H. Alonso Prarit Lamba LRM 60 1 0 21 May 2024
"Set It Up!": Functional Object Arrangement with Compositional Generative Models Yiqing Xu Jiayuan Mao Yilun Du Tomás Lozano-Pérez L. Kaelbling David Hsu LM&Ro 86 5 0 20 May 2024
Learning Reward for Robot Skills Using Large Language Models via Self-Alignment Yuwei Zeng Yao Mu Lin Shao 42 12 0 12 May 2024
Policy Learning with a Language Bottleneck Megha Srivastava Cédric Colas Dorsa Sadigh Jacob Andreas 43 3 0 07 May 2024
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models Gabriel H. Sarch Sahil Somani Raghav Kapoor Michael J. Tarr Katerina Fragkiadaki LM&Ro LLMAG 37 3 0 29 Apr 2024
Testing and Understanding Erroneous Planning in LLM Agents through Synthesized User Inputs Zhenlan Ji Daoyuan Wu Pingchuan Ma Zongjie Li Shuai Wang LLMAG 48 3 0 27 Apr 2024
BlenderAlchemy: Editing 3D Graphics with Vision-Language Models Ian Huang Guandao Yang Leonidas J. Guibas 34 3 0 26 Apr 2024
Benchmarking Mobile Device Control Agents across Diverse Configurations Juyong Lee Taywon Min Minyong An Changyeon Kim Kimin Lee 44 10 0 25 Apr 2024
Logic Learning from Demonstrations for Multi-step Manipulation Tasks in Dynamic Environments Yan Zhang Teng Xue Amirreza Razmjoo Sylvain Calinon 37 2 0 24 Apr 2024
FL-TAC: Enhanced Fine-Tuning in Federated Learning via Low-Rank, Task-Specific Adapter Clustering Siqi Ping Yuzhu Mao Yang Liu Xiao-Ping Zhang Wenbo Ding FedML 31 4 0 23 Apr 2024
Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Clouds Oliver Lemke Z. Bauer René Zurbrugg Marc Pollefeys Francis Engelmann Hermann Blum 3DPC 29 11 0 18 Apr 2024
FoundationGrasp: Generalizable Task-Oriented Grasping with Foundation Models Chao Tang Dehao Huang Wenlong Dong Ruinian Xu Hong Zhang 36 11 0 16 Apr 2024
COMBO: Compositional World Models for Embodied Multi-Agent Cooperation Hongxin Zhang Zeyuan Wang Qiushi Lyu Zheyuan Zhang Sunli Chen Tianmin Shu Yilun Du Kwonjoon Lee Yilun Du Chuang Gan 48 12 0 16 Apr 2024
"Don't forget to put the milk back!" Dataset for Enabling Embodied Agents to Detect Anomalous Situations James F. Mullen Prasoon Goyal Robinson Piramuthu Michael Johnston Dinesh Manocha R. Ghanadan LM&Ro 28 5 0 12 Apr 2024
Training a Vision Language Model as Smartphone Assistant Nicolai Dorka Janusz Marecki Ammar Anwar 26 3 0 12 Apr 2024
AdaDemo: Data-Efficient Demonstration Expansion for Generalist Robotic Agent Tongzhou Mu Yijie Guo Jie Xu Ankit Goyal Hao Su Dieter Fox Animesh Garg LM&Ro 44 0 0 11 Apr 2024
A Survey on the Integration of Generative AI for Critical Thinking in Mobile Networks Athanasios Karapantelakis Alexandros Nikou Ajay Kattepur Jean Martins Leonid Mokrushin S. Mohalik Marin Orlic Aneta Vulgarakis Feljan 29 1 0 10 Apr 2024
Long-horizon Locomotion and Manipulation on a Quadrupedal Robot with Large Language Models Yutao Ouyang Jinhan Li Yunfei Li Zhongyu Li Chao Yu Koushil Sreenath Yi Wu 57 15 0 08 Apr 2024
Embodied AI with Two Arms: Zero-shot Learning, Safety and Modularity Jacob Varley Sumeet Singh Deepali Jain Krzysztof Choromanski Andy Zeng Somnath Basu Roy Chowdhury Kumar Avinava Dubey Vikas Sindhwani LM&Ro 34 14 0 04 Apr 2024
DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models Yuchen Liu Luigi Palmieri Sebastian Koch Ilche Georgievski Marco Aiello LM&Ro 52 15 0 04 Apr 2024
Large Language Models for Orchestrating Bimanual Robots Kun-Mo Chu Xufeng Zhao C. Weber Mengdi Li Wenhao Lu Stefan Wermter LM&Ro LLMAG 40 8 0 02 Apr 2024
A Survey on Large Language Model-Based Game Agents Sihao Hu Tiansheng Huang Gaowen Liu Ramana Rao Kompella Gaowen Liu Selim Furkan Tekin Yichang Xu Zachary Yahn Ling Liu LLMAG LM&Ro AI4CE LM&MA 71 51 0 02 Apr 2024
IVLMap: Instance-Aware Visual Language Grounding for Consumer Robot Navigation Jiacui Huang Hongtao Zhang Mingbo Zhao Zhou Wu LM&Ro 39 5 0 28 Mar 2024
RH20T-P: A Primitive-Level Robotic Dataset Towards Composable Generalization Agents Zeren Chen Zhelun Shi Xiaoya Lu Lehan He Sucheng Qian ... Zhen-fei Yin Jing Shao Jing Shao Cewu Lu Cewu Lu 38 5 0 28 Mar 2024
Exploring CausalWorld: Enhancing robotic manipulation via knowledge transfer and curriculum learning Xinrui Wang Yan Jin 40 1 0 25 Mar 2024
Temporal and Semantic Evaluation Metrics for Foundation Models in Post-Hoc Analysis of Robotic Sub-tasks Jonathan Salfity Selma Wanna Minkyu Choi Mitch Pryor 43 1 0 25 Mar 2024
Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art Neeloy Chakraborty Melkior Ornik Katherine Driggs-Campbell LRM 57 9 0 25 Mar 2024
TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Models Ishika Singh David Traum Jesse Thomason Jesse Thomason LM&Ro LLMAG 46 16 0 25 Mar 2024
AIOS: LLM Agent Operating System Kai Mei Zelong Li Wujiang Xu Wenyue Hua Mingyu Jin Yongfeng Zhang Shuyuan Xu Ruosong Ye Yingqiang Ge Yongfeng Zhang LLMAG 30 17 0 25 Mar 2024
To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions Daniel Tanneberg Felix Ocker Stephan Hasler Joerg Deigmoeller Anna Belardinelli Chao Wang H. Wersing Bernhard Sendhoff Michael Gienger LM&Ro 61 14 0 19 Mar 2024
LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning Shu Wang Muzhi Han Ziyuan Jiao Zeyu Zhang Yingnian Wu Song-Chun Zhu Hangxin Liu LRM 33 33 0 18 Mar 2024
GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment Lance Ying Kunal Jha Shivam Aarya Joshua B. Tenenbaum Antonio Torralba Tianmin Shu 42 14 0 17 Mar 2024
FlowMind: Automatic Workflow Generation with LLMs Zhen Zeng William Watson Nicole Cho Saba Rahimi Shayleen Reynolds T. Balch Manuela Veloso 41 26 0 17 Mar 2024