LaMI: Large Language Models for Multi-Modal Human-Robot Interaction

LaMI: Large Language Models for Multi-Modal Human-Robot Interaction

26 January 2024

Daniel Tanneberg

Frank Joublin

Antonello Ceravola

Joerg Deigmoeller

Michael Gienger

Papers citing "LaMI: Large Language Models for Multi-Modal Human-Robot Interaction"

15 / 15 papers shown

Title
BT-ACTION: A Test-Driven Approach for Modular Understanding of User Instruction Leveraging Behaviour Trees and LLMs Alexander Leszczynski Sarah Gillet Iolanda Leite Fethiye Irmak Dogan LM&Ro 56 0 0 03 Apr 2025
TransforMerger: Transformer-based Voice-Gesture Fusion for Robust Human-Robot Communication Petr Vanc Karla Stepanova 38 0 0 02 Apr 2025
Plan-and-Act using Large Language Models for Interactive Agreement Kazuhiro Sasabuchi Naoki Wake Atsushi Kanehira Jun Takamatsu Katsushi Ikeuchi LLMAG LM&Ro 58 0 0 01 Apr 2025
SemanticScanpath: Combining Gaze and Speech for Situated Human-Robot Interaction Using LLMs Elisabeth Menendez Michael Gienger Santiago Martínez Carlos Balaguer Anna Belardinelli 44 0 0 19 Mar 2025
FAM-HRI: Foundation-Model Assisted Multi-Modal Human-Robot Interaction Combining Gaze and Speech Yuzhi Lai Shenghai Yuan Boya Zhang Benjamin Kiefer Peizheng Li Andreas Zell 36 1 0 11 Mar 2025
The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare Souren Pashangpour Goldie Nejat LM&MA 50 7 0 05 Nov 2024
Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks Graziano A. Manduzio Federico A. Galatolo M. G. Cimino Enzo Pasquale Scilingo Lorenzo Cominelli LRM 24 1 0 24 Oct 2024
A Framework for Adapting Human-Robot Interaction to Diverse User Groups Theresa Pekarek-Rosin Vanessa Hassouna Xiaowen Sun Luca Krohm Henri-Leon Kordt Michael Beetz Stefan Wermter 28 0 0 15 Oct 2024
Tulip Agent -- Enabling LLM-Based Agents to Solve Tasks Using Large Tool Libraries Felix Ocker Daniel Tanneberg Julian Eggert Michael Gienger LLMAG LM&Ro VLM 42 5 0 31 Jul 2024
When Robots Get Chatty: Grounding Multimodal Human-Robot Conversation and Collaboration Philipp Allgeuer Hassan Ali Stefan Wermter LM&Ro 33 9 0 29 Jun 2024
A New Era in Human Factors Engineering: A Survey of the Applications and Prospects of Large Multimodal Models Fan Li Ching-Hung Lee Su Han Shanshan Feng Zhuoxuan Jiang Zhu Sun AI4CE 43 3 0 22 May 2024
Comparing Apples to Oranges: LLM-powered Multimodal Intention Prediction in an Object Categorization Task Hassan Ali Philipp Allgeuer Stefan Wermter 54 1 0 12 Apr 2024
To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions Daniel Tanneberg Felix Ocker Stephan Hasler Joerg Deigmoeller Anna Belardinelli Chao Wang H. Wersing Bernhard Sendhoff Michael Gienger LM&Ro 61 14 0 19 Mar 2024
Large Language Models as Zero-Shot Human Models for Human-Robot Interaction Bowen Zhang Harold Soh LLMAG LM&Ro 72 40 0 06 Mar 2023
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 389 8,495 0 28 Jan 2022