Language Models Meet World Models: Embodied Experiences Enhance Language Models

18 May 2023

Papers citing "Language Models Meet World Models: Embodied Experiences Enhance Language Models"

50 / 83 papers shown

Title
Security of Internet of Agents: Attacks and Countermeasures Yuntao Wang Yanghe Pan Shaolong Guo Zhou Su LLMAG 44 0 0 12 May 2025
Bi-LSTM based Multi-Agent DRL with Computation-aware Pruning for Agent Twins Migration in Vehicular Embodied AI Networks Yuxiang Wei Zhuoqi Zeng Yue Zhong Jiawen Kang R. W. Liu M. S. Hossain 28 0 0 09 May 2025
TinyMA-IEI-PPO: Exploration Incentive-Driven Multi-Agent DRL with Self-Adaptive Pruning for Vehicular Embodied AI Agent Twins Migration Zhuoqi Zeng Yuxiang Wei Jiawen Kang 31 0 0 30 Apr 2025
Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability Zishen Wan Jiayi Qian Yuhang Du Jason J. Jabbour Yilun Du Yang Katie Zhao A. Raychowdhury Tushar Krishna Vijay Janapa Reddi LM&Ro 91 0 0 26 Apr 2025
WALL-E 2.0: World Alignment by NeuroSymbolic Learning improves World Model-based LLM Agents Siyu Zhou Tianyi Zhou Yijun Yang Guodong Long Deheng Ye Jing Jiang Chengqi Zhang LM&Ro 27 0 0 22 Apr 2025
A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agents Yuting Huang Leilei Ding Zhipeng Tang Tianfu Wang Xinrui Lin W. Zhang Mingxiao Ma Yanyong Zhang LLMAG 37 0 0 20 Apr 2025
MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Driving Haiguang Wang Daqi Liu Hongwei Xie Haisong Liu Enhui Ma Kaicheng Yu Limin Wang Bing Wang VGen 72 0 0 20 Mar 2025
MoMa-Kitchen: A 100K+ Benchmark for Affordance-Grounded Last-Mile Navigation in Mobile Manipulation P. Zhang Xianqiang Gao Yuhan Wu Kehui Liu Dong Wang Z. Wang Bin Zhao Yan Ding X. Li LM&Ro 53 1 0 14 Mar 2025
Multi-Agent LLM Actor-Critic Framework for Social Robot Navigation Weizheng Wang Ike Obi Byung-Cheol Min LLMAG 52 1 0 12 Mar 2025
Revisiting the Othello World Model Hypothesis Yifei Yuan Anders Søgaard LRM 60 0 0 06 Mar 2025
A Survey on Feedback-based Multi-step Reasoning for Large Language Models on Mathematics Ting-Ruen Wei Haowei Liu Xuyang Wu Yi Fang LRM AI4CE ReLM KELM 193 1 0 21 Feb 2025
The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understanding Mo Yu Lemao Liu J. Wu Tsz Ting Chung Shunchi Zhang JiangNan Li Dit-Yan Yeung Jie Zhou 85 1 0 13 Feb 2025
DMWM: Dual-Mind World Model with Long-Term Imagination Lingyi Wang Rashed Shelim Walid Saad Naren Ramakrishnan LRM 148 1 0 11 Feb 2025
DesCLIP: Robust Continual Adaptation via General Attribute Descriptions for Pretrained Vision-Language Models Chiyuan He Zihuan Qiu Fanman Meng Linfeng Xu Q. Wu H. Li VLM CLL KELM 63 0 0 02 Feb 2025
How to Alleviate Catastrophic Forgetting in LLMs Finetuning? Hierarchical Layer-Wise and Element-Wise Regularization Shezheng Song Hao Xu Jun Ma Shasha Li Long Peng Qian Wan Xiaodong Liu Jie Yu KELM CLL ALM 65 0 0 23 Jan 2025
Vision-and-Language Navigation Today and Tomorrow: A Survey in the Era of Foundation Models Yue Zhang Ziqiao Ma Jialu Li Yanyuan Qiao Zun Wang J. Chai Qi Wu Mohit Bansal Parisa Kordjamshidi LRM 63 18 0 31 Dec 2024
From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents Xinyi Mou Xuanwen Ding Qi He Liang Wang Jingcong Liang ... L. Sun Jiayu Lin Jie Zhou Xuanjing Huang Zhongyu Wei LLMAG LM&Ro AI4CE 86 13 0 04 Dec 2024
From Laws to Motivation: Guiding Exploration through Law-Based Reasoning and Rewards Ziyu Chen Zhiqing Xiao Xinbei Jiang Junbo Zhao 80 0 0 24 Nov 2024
Evaluating World Models with LLM for Decision Making Chang Yang Xinrun Wang Junzhe Jiang Qinggang Zhang Xiao Huang LLMAG ELM 36 2 0 13 Nov 2024
CaStL: Constraints as Specifications through LLM Translation for Long-Horizon Task and Motion Planning Weihang Guo Zachary K. Kingston Lydia E. Kavraki 37 2 0 29 Oct 2024
Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfitting Mohamed Salim Aissi Clément Romac Thomas Carta Sylvain Lamprier Pierre-Yves Oudeyer Olivier Sigaud Laure Soulier Nicolas Thome 21 2 0 25 Oct 2024
Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina Yuan Gao Dokyun Lee Gordon Burtch Sina Fazelpour LRM 56 7 0 25 Oct 2024
ControlAgent: Automating Control System Design via Novel Integration of LLM Agents and Domain Expertise Xingang Guo Darioush Keivan U. Syed Lianhui Qin Huan Zhang Geir Dullerud Peter M. Seiler Bin Hu 34 5 0 17 Oct 2024
WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents Siyu Zhou Tianyi Zhou Yijun Yang Guodong Long Deheng Ye Jing Jiang Chengqi Zhang LLMAG LM&Ro 23 3 0 09 Oct 2024
Grounding Large Language Models In Embodied Environment With Imperfect World Models Haolan Liu Jishen Zhao LLMAG SyDa AI4CE 28 0 0 03 Oct 2024
Planning in the Dark: LLM-Symbolic Planning Pipeline without Experts Sukai Huang N. Lipovetzky Trevor Cohn DiffM 23 1 0 24 Sep 2024
Making Large Language Models into World Models with Precondition and Effect Knowledge Kaige Xie Ian Yang John Gunerli Mark Riedl 29 5 0 18 Sep 2024
E2CL: Exploration-based Error Correction Learning for Embodied Agents Hanlin Wang Chak Tou Leong Jian Wang Wenjie Li 32 1 0 05 Sep 2024
Semantic Skill Grounding for Embodied Instruction-Following in Cross-Domain Environments Sangwoo Shin Takehiro Matsuoka Youngsoo Jang Moontae Lee Kazuya Yoshida 38 0 0 02 Aug 2024
BadRobot: Jailbreaking Embodied LLMs in the Physical World Hangtao Zhang Chenyu Zhu Xianlong Wang Ziqi Zhou Yichen Wang ... Shengshan Hu Leo Yu Zhang Aishan Liu Peijin Guo Leo Yu Zhang LM&Ro 47 7 0 16 Jul 2024
Transforming Agency. On the mode of existence of Large Language Models Xabier E. Barandiaran Lola S. Almendros LLMAG LM&Ro 40 4 0 15 Jul 2024
Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI Y. Liu Weixing Chen Yongjie Bai Xiaodan Liang Guanbin Li Wen Gao Liang Lin LM&Ro SyDa AI4CE 51 50 0 09 Jul 2024
Mental Modeling of Reinforcement Learning Agents by Language Models Wenhao Lu Xufeng Zhao Josua Spisak Jae Hee Lee Stefan Wermter LLMAG LRM LM&Ro 27 3 0 26 Jun 2024
CityGPT: Empowering Urban Spatial Cognition of Large Language Models Jie Feng Yuwei Du Tianhui Liu Siqi Guo Yuming Lin Yong Li 43 12 0 20 Jun 2024
CityBench: Evaluating the Capabilities of Large Language Model as World Model Jie Feng Jun Zhang Junbo Yan Xin Zhang Tianjian Ouyang Tianhui Liu Yuwei Du Siqi Guo Yong Li ELM 56 0 0 20 Jun 2024
Pandora: Towards General World Model with Natural Language Actions and Video States Jiannan Xiang Guangyi Liu Yi Gu Qiyue Gao Yuting Ning ... Shibo Hao Yemin Shi Zhengzhong Liu Eric P. Xing Zhiting Hu VGen 56 35 0 12 Jun 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 59 12 0 06 Jun 2024
DriVLMe: Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experiences Yidong Huang Jacob Sansom Ziqiao Ma Felix Gervits Joyce Chai 44 17 0 05 Jun 2024
Agent Planning with World Knowledge Model Shuofei Qiao Runnan Fang Ningyu Zhang Yuqi Zhu Xiang Chen Shumin Deng Yong-jia Jiang Pengjun Xie Fei Huang Huajun Chen LLMAG LM&Ro 83 14 0 23 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 74 42 0 23 May 2024
WorldGPT: Empowering LLM as Multimodal World Model Zhiqi Ge Hongzhe Huang Mingze Zhou Juncheng Li Guoming Wang Siliang Tang Yueting Zhuang 35 26 0 28 Apr 2024
Logic Learning from Demonstrations for Multi-step Manipulation Tasks in Dynamic Environments Yan Zhang Teng Xue Amirreza Razmjoo Sylvain Calinon 29 2 0 24 Apr 2024
LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Models Shibo Hao Yi Gu Haotian Luo Tianyang Liu Xiyan Shao ... Haodi Ma Adithya Samavedhi Qiyue Gao Zhen Wang Zhiting Hu LRM ELM 89 1 0 08 Apr 2024
A Survey on Large Language Model-Based Game Agents Sihao Hu Tiansheng Huang Gaowen Liu Ramana Rao Kompella Gaowen Liu Selim Furkan Tekin Yichang Xu Zachary Yahn Ling Liu LLMAG LM&Ro AI4CE LM&MA 69 51 0 02 Apr 2024
MLDT: Multi-Level Decomposition for Complex Long-Horizon Robotic Task Planning with Open-Source Large Language Model Yike Wu Jiatao Zhang Nan Hu LanLing Tang Guilin Qi Jun Shao Jie Ren Wei Song 59 10 0 27 Mar 2024
AIOS: LLM Agent Operating System Kai Mei Zelong Li Wujiang Xu Wenyue Hua Mingyu Jin Yongfeng Zhang Shuyuan Xu Ruosong Ye Yingqiang Ge Yongfeng Zhang LLMAG 26 17 0 25 Mar 2024
Few-shot Dialogue Strategy Learning for Motivational Interviewing via Inductive Reasoning Zhouhang Xie Bodhisattwa Prasad Majumder Mengjie Zhao Yoshinori Maeda Keiichi Yamada Hiromi Wakaki Julian McAuley 40 3 0 23 Mar 2024
SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priors Chenyang Ma Kai Lu Ta-Ying Cheng Niki Trigoni Andrew Markham LRM 35 7 0 18 Mar 2024
LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning Shu Wang Muzhi Han Ziyuan Jiao Zeyu Zhang Yingnian Wu Song-Chun Zhu Hangxin Liu LRM 31 32 0 18 Mar 2024
Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoning Rao Fu Jingyu Liu Xilun Chen Yixin Nie Wenhan Xiong LM&Ro LRM 47 50 0 18 Mar 2024