MineRL: A Large-Scale Dataset of Minecraft Demonstrations

29 July 2019

Papers citing "MineRL: A Large-Scale Dataset of Minecraft Demonstrations"

50 / 146 papers shown

Title
PLAICraft: Large-Scale Time-Aligned Vision-Speech-Action Dataset for Embodied AI Yingchen He Christian D. Weilbach Martyna E. Wojciechowska Yuxuan Zhang Frank Wood LM&Ro VGen 7 0 0 19 May 2025
CrafText Benchmark: Advancing Instruction Following in Complex Multimodal Open-Ended World Zoya Volovikova G. Gorbov Petr Kuderov Aleksandr I. Panov A. Skrynnik 7 0 0 17 May 2025
A Survey of Interactive Generative Video Jiwen Yu Yiran Qin Haoxuan Che Quande Liu Xinyu Wang Pengfei Wan Di Zhang Kun Gai Hao Chen Xihui Liu VGen 67 0 0 30 Apr 2025
Cultivating Game Sense for Yourself: Making VLMs Gaming Experts Wenxuan Lu Jiangyang He Zhanqiu Zhang Yiwen Guo Tianning Zang 55 0 0 27 Mar 2025
Position: Interactive Generative Video as Next-Generation Game Engine Jiwen Yu Yiran Qin Haoxuan Che Quande Liu Xintao Wang Pengfei Wan Di Zhang Xihui Liu VGen 47 1 0 21 Mar 2025
VisEscape: A Benchmark for Evaluating Exploration-driven Decision-making in Virtual Escape Rooms Seungwon Lim Sungwoong Kim Jihwan Yu Sungjae Lee Jiwan Chung Youngjae Yu 73 1 0 18 Mar 2025
Uncertainty in Action: Confidence Elicitation in Embodied Agents Tianjiao Yu Vedant Shah Muntasir Wahed Kiet A. Nguyen Adheesh Sunil Juvekar Tal August Ismini Lourentzou 51 0 0 13 Mar 2025
How Do Multimodal Large Language Models Handle Complex Multimodal Reasoning? Placing Them in An Extensible Escape Game Zehua Wang Yurui Dong Ziyue Wang Minyuan Ruan Zhili Cheng Chong Chen Ziwei Sun Yang Liu LRM 89 0 0 13 Mar 2025
Open-World Skill Discovery from Unsegmented Demonstrations Jingwen Deng Zihao Wang Shaofei Cai Guy Van den Broeck Yitao Liang 41 1 0 11 Mar 2025
Factorio Learning Environment Jack Hopkins Mart Bakler Akbir Khan LRM AI4CE LLMAG 55 1 0 06 Mar 2025
ROCKET-2: Steering Visuomotor Policy via Cross-View Goal Alignment Shaofei Cai Zhancun Mu Guy Van den Broeck Yitao Liang 56 2 0 04 Mar 2025
A2Perf: Real-World Autonomous Agents Benchmark Ikechukwu Uchendu Jason J. Jabbour Korneel Van den Berghe Joel Runevic Matthew P. Stewart ... S. Guadarrama Jie Tan Jordan K. Terry Aleksandra Faust Vijay Janapa Reddi 39 0 0 04 Mar 2025
Plancraft: an evaluation dataset for planning with LLM agents Gautier Dagan Frank Keller A. Lascarides LLMAG 41 0 0 31 Dec 2024
STEVE-Audio: Expanding the Goal Conditioning Modalities of Embodied Agents in Minecraft Nicholas Lenzen Amogh Raut Andrew Melnik VGen 74 0 0 01 Dec 2024
BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games Davide Paglieri Bartłomiej Cupiał Samuel Coward Ulyana Piterbarg Maciej Wolczyk ... Lerrel Pinto Rob Fergus Jakob Foerster Jack Parker-Holder Tim Rocktaschel LLMAG LRM 119 12 0 20 Nov 2024
Project Sid: Many-agent simulations toward AI civilization Altera. AL Andrew Ahn Nic Becker Stephanie Carroll Nico Christie ... Shuying Luo Peter Y Wang Mathew Willows Feitong Yang Guangyu Robert Yang LLMAG LM&Ro AI4CE 63 13 0 31 Oct 2024
WorldSimBench: Towards Video Generation Models as World Simulators Yiran Qin Zhelun Shi Jiwen Yu Xijun Wang Enshen Zhou ... Lu Sheng Jing Shao Junlin Wu Wanli Ouyang Ruimao Zhang EGVM VGen 126 387 0 23 Oct 2024
Contrastive Abstraction for Reinforcement Learning Vihang Patil M. Hofmarcher Elisabeth Rumetshofer Sepp Hochreiter OffRL SSL 26 2 0 01 Oct 2024
Unsupervised Cognition Alfredo Ibias Hector Antona Guillem Ramirez-Miranda Enric Guinovart Eduard Alarcon SSL 24 2 0 27 Sep 2024
CLSP: High-Fidelity Contrastive Language-State Pre-training for Agent State Representation Fuxian Huang Qi Zhang Shaopeng Zhai Jie Wang Tianyi Zhang Haoran Zhang Ming Zhou Yu Liu Yu Qiao CLIP AI4TS 38 0 0 24 Sep 2024
Learning Keypoints for Multi-Agent Behavior Analysis using Self-Supervision Daniel Khalil Christina Liu Pietro Perona Jennifer J. Sun Markus Marks 22 1 0 14 Sep 2024
Learning to Move Like Professional Counter-Strike Players David Durst Feng Xie Vishnu Sarukkai Brennan Shacklett I. Frosio ... Carly Taylor Gilbert Bernstein Sanjiban Choudhury Pat Hanrahan Kayvon Fatahalian 44 0 0 25 Aug 2024
VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agents Xiao-Yang Liu Tianjie Zhang Yu Gu Iat Long Iong Yifan Xu ... Zhengxiao Du Chan Hee Song Yu Su Yuxiao Dong Jie Tang VLM LLMAG 55 23 0 12 Aug 2024
Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks Zaijing Li Yuquan Xie Rui Shao Gongwei Chen Dongmei Jiang Liqiang Nie 56 19 0 07 Aug 2024
Visual Grounding for Object-Level Generalization in Reinforcement Learning Haobin Jiang Zongqing Lu LM&Ro 42 2 0 04 Aug 2024
Interpretability in Action: Exploratory Analysis of VPT, a Minecraft Agent Karolis Jucys George Adamopoulos Mehrab Hamidi Stephanie Milani Mohammad Reza Samsami Artem Zholus Sonia Joseph Blake A. Richards Irina Rish Özgür Simsek 42 2 0 16 Jul 2024
IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents Shrestha Mohanty Negar Arabzadeh Andrea Tupini Yuxuan Sun Alexey Skrynnik Artem Zholus Marc-Alexandre Côté Julia Kiseleva 46 0 0 12 Jul 2024
Craftium: An Extensible Framework for Creating Reinforcement Learning Environments Mikel Malagón Josu Ceberio Jose A. Lozano 52 0 0 04 Jul 2024
OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents Zihao Wang Shaofei Cai Zhancun Mu Haowei Lin Ceyao Zhang Xuejie Liu Qing Li Guy Van den Broeck Xiaojian Ma Yitao Liang LM&Ro 57 12 0 27 Jun 2024
IWISDM: Assessing instruction following in multimodal models at scale Xiaoxuan Lei Lucas Gomez Hao Yuan Bai P. Bashivan VLM 33 1 0 20 Jun 2024
STEVE Series: Step-by-Step Construction of Agent Systems in Minecraft Zhonghan Zhao Wenhao Chai Xuan Wang Ke Ma Kewei Chen Dongxu Guo Tian Ye Yanting Zhang Hongwei Wang Gaoang Wang LLMAG LM&Ro 39 6 0 17 Jun 2024
World Models with Hints of Large Language Models for Goal Achieving Zeyuan Liu Ziyu Huan Xiyao Wang Jiafei Lyu Jian Tao Xiu Li Furong Huang Huazhe Xu LM&Ro LRM AI4CE 48 1 0 11 Jun 2024
What Matters in Hierarchical Search for Combinatorial Reasoning Problems? Michał Zawalski Gracjan Góral Michał Tyrolski Emilia Wisnios Franciszek Budrowski Marek Cygan Łukasz Kuciński Piotr Miłoś 47 0 0 05 Jun 2024
Learning to Play Atari in a World of Tokens Pranav Agarwal Sheldon Andrews Samira Ebrahimi Kahou OffRL 38 1 0 03 Jun 2024
LARM: Large Auto-Regressive Model for Long-Horizon Embodied Intelligence Zhuoling Li Xiaogang Xu Zhenhua Xu Sernam Lim Hengshuang Zhao LM&Ro 51 2 0 27 May 2024
Embedding-Aligned Language Models Guy Tennenholtz Yinlam Chow Chih-Wei Hsu Lior Shani Ethan Liang Craig Boutilier AIFin 37 1 0 24 May 2024
MineLand: Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs Xianhao Yu Jiaqi Fu Renjia Deng Wenjuan Han 41 5 0 28 Mar 2024
MineDreamer: Learning to Follow Instructions via Chain-of-Imagination for Simulated-World Control Enshen Zhou Yiran Qin Zhen-fei Yin Yuzhou Huang Ruimao Zhang Lu Sheng Yu Qiao Jing Shao LM&Ro AI4CE 50 34 0 18 Mar 2024
EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents Abhaysinh Zala Jaemin Cho Han Lin Jaehong Yoon Mohit Bansal 41 13 0 18 Mar 2024
Scaling Instructable Agents Across Many Simulated Worlds Sima Team Maria Abi Raad Arun Ahuja Catarina Barros F. Besse ... Daan Wierstra Duncan Williams Nathaniel Wong Sarah York Nick Young LM&Ro 115 39 0 13 Mar 2024
SSM Meets Video Diffusion Models: Efficient Video Generation with Structured State Spaces Yuta Oshima Shohei Taniguchi Masahiro Suzuki Yutaka Matsuo 45 2 0 12 Mar 2024
RL-GPT: Integrating Reinforcement Learning and Code-as-policy Shaoteng Liu Haoqi Yuan Minda Hu Yanwei Li Yukang Chen Shu Liu Zongqing Lu Jiaya Jia LLMAG 48 16 0 29 Feb 2024
Dr. Strategy: Model-Based Generalist Agents with Strategic Dreaming Hany Hamed Subin Kim Dongyeong Kim Jaesik Yoon Sungjin Ahn 47 4 0 29 Feb 2024
Spatially-Aware Transformer for Embodied Agents Junmo Cho Jaesik Yoon Sungjin Ahn 41 0 0 23 Feb 2024
S-Agents: Self-organizing Agents in Open-ended Environments Jia-Qing Chen Yu-Gang Jiang Jiachen Lu Li Zhang AIFin LLMAG LM&Ro 60 15 0 07 Feb 2024
Assessing the Impact of Distribution Shift on Reinforcement Learning Performance Ted Fujimoto Joshua Suetterlein Samrat Chatterjee A. Ganguly OffRL 30 3 0 05 Feb 2024
Distilling LLMs' Decomposition Abilities into Compact Language Models Denis Tarasov Kumar Shridhar SyDa OffRL LRM 48 2 0 02 Feb 2024
Human-Centric Resource Allocation for the Metaverse With Multiaccess Edge Computing Zijian Long Haiwei Dong Abdulmotaleb El Saddik 13 18 0 23 Dec 2023
MinePlanner: A Benchmark for Long-Horizon Planning in Large Minecraft Worlds William Hill Ireton Liu Anita De Mello Koch Damion Harvey Nishanth Kumar George Konidaris Steven D. James LM&Ro 32 0 0 20 Dec 2023
Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft Hao Li Xue Yang Zhaokai Wang Xizhou Zhu Jie Zhou Yu Qiao Xiaogang Wang Hongsheng Li Lewei Lu Jifeng Dai 43 32 0 14 Dec 2023