DreamCraft: Text-Guided Generation of Functional 3D Environments in Minecraft

23 April 2024

Papers citing "DreamCraft: Text-Guided Generation of Functional 3D Environments in Minecraft"

49 / 49 papers shown

Title
Grammar-based Game Description Generation using Large Language Models Tsunehiko Tanaka Edgar Simo-Serra 72 2 0 24 Jul 2024
Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack Xiaoliang Dai Ji Hou Chih-Yao Ma Sam S. Tsai Jialiang Wang ... Roshan Sumbaly Vignesh Ramanathan Zijian He Peter Vajda Devi Parikh VLM 42 202 0 27 Sep 2023
The Five-Dollar Model: Generating Game Maps and Sprites from Sentence Embeddings Timothy Merino Roman Negri Dipika Rajesh M. Charity Julian Togelius DiffM VLM 42 15 0 08 Aug 2023
$F$^{2}$-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories$ F $^{2}$ -NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories Peng Wang Yuan Liu Zhaoxi Chen Lingjie Liu Ziwei Liu Taku Komura Christian Theobalt Wenping Wang 42 128 0 28 Mar 2023
Level Generation Through Large Language Models Graham Todd Sam Earle Muhammad Umair Nasir M. Green Julian Togelius 40 76 0 11 Feb 2023
Evolving Flying Machines in Minecraft Using Quality Diversity Alejandro Medina Melanie Richey Mark Mueller Jacob Schrum 51 2 0 01 Feb 2023
Human-Timescale Adaptation in an Open-Ended Task Space Adaptive Agent Team Jakob Bauer Kate Baumli Satinder Baveja Feryal M. P. Behbahani ... Jakub Sygnowski K. Tuyls Sarah York Alexander Zacherl Lei Zhang LM&Ro OffRL AI4CE LRM 53 112 0 18 Jan 2023
Understanding Pure CLIP Guidance for Voxel Grid NeRF Models Han-Hung Lee Angel X. Chang 38 63 0 30 Sep 2022
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 97 2,359 0 29 Sep 2022
Make-A-Video: Text-to-Video Generation without Text-Video Data Uriel Singer Adam Polyak Thomas Hayes Xiaoyue Yin Jie An ... Oron Ashual Oran Gafni Devi Parikh Sonal Gupta Yaniv Taigman DiffM VGen 59 1,373 0 29 Sep 2022
Is Attention All That NeRF Needs? T. MukundVarma Peihao Wang Xuxi Chen Tianlong Chen Subhashini Venugopalan Zhangyang Wang ViT 57 111 0 27 Jul 2022
Learning Controllable 3D Level Generators Zehua Jiang Sam Earle M. Green Julian Togelius 35 22 0 27 Jun 2022
Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videos Bowen Baker Ilge Akkaya Peter Zhokhov Joost Huizinga Jie Tang Adrien Ecoffet Brandon Houghton Raul Sampedro Jeff Clune OffRL 68 293 0 23 Jun 2022
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge Linxi Fan Guanzhi Wang Yunfan Jiang Ajay Mandlekar Yuncong Yang Haoyi Zhu Andrew Tang De-An Huang Yuke Zhu Anima Anandkumar LM&Ro 86 366 0 17 Jun 2022
Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesis Xiang Guo Guanying Chen Yuchao Dai Xiaoqing Ye Jiadai Sun Xiao Tan Errui Ding 46 44 0 15 Jun 2022
CLIP-Mesh: Generating textured meshes from text using pretrained image-text models N. Khalid Tianhao Xie Eugene Belilovsky Tiberiu Popa CLIP 50 294 0 24 Mar 2022
Evolving Curricula with Regret-Based Environment Design Jack Parker-Holder Minqi Jiang Michael Dennis Mikayel Samvelyan Jakob N. Foerster Edward Grefenstette Tim Rocktaschel 47 124 0 02 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 85 30,021 0 01 Mar 2022
Path of Destruction: Learning an Iterative Level Generator Using a Small Dataset Matthew Siper Ahmed Khalifa Julian Togelius GAN 27 16 0 21 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 192 15,081 0 20 Dec 2021
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction Cheng Sun Min Sun Hwann-Tzong Chen 81 1,063 0 22 Nov 2021
MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Research Mikayel Samvelyan Robert Kirk Vitaly Kurin Jack Parker-Holder Minqi Jiang Eric Hambro Fabio Petroni Heinrich Küttler Edward Grefenstette Tim Rocktaschel OffRL 259 89 0 27 Sep 2021
Illuminating Diverse Neural Cellular Automata for Level Generation Sam Earle J. Snider Matthew C. Fontaine Stefanos Nikolaidis Julian Togelius 61 37 0 12 Sep 2021
Open-Ended Learning Leads to Generally Capable Agents Open-Ended Learning Team Adam Stooke Anuj Mahajan Catarina Barros Charlie Deck ... Nicolas Porcel Roberta Raileanu Steph Hughes-Fitt Valentin Dalibard Wojciech M. Czarnecki 62 184 0 27 Jul 2021
World-GAN: a Generative Model for Minecraft Worlds Maren Awiszus Frederik Schubert Bodo Rosenhahn SyDa GAN 33 19 0 18 Jun 2021
GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worlds Jinwei Gu Arun Mallya Serge Belongie Ming-Yuan Liu 46 120 0 15 Apr 2021
Growing 3D Artefacts and Functional Machines with Neural Cellular Automata Shyam Sudhakaran Djordje Grbic Siyan Li Adam Katona Elias Najarro Claire Glanois S. Risi 28 44 0 15 Mar 2021
Adversarial Reinforcement Learning for Procedural Content Generation Linus Gisslén Andy Eakins Camilo Gordillo Joakim Bergdahl Konrad Tollmar 39 48 0 08 Mar 2021
The MineRL 2020 Competition on Sample Efficient Reinforcement Learning using Human Priors William H. Guss Cayden R. Codel Katja Hofmann Brandon Houghton Noburu Kuno ... John Schulman Manuela Veloso Nicholay Topin Avinash Ummadisingu Phillip Wang OffRL 35 64 0 26 Jan 2021
EvoCraft: A New Challenge for Open-Endedness Djordje Grbic Rasmus Berg Palm Elias Najarro Claire Glanois S. Risi 32 30 0 08 Dec 2020
Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Design Michael Dennis Natasha Jaques Eugene Vinitsky Alexandre M. Bayen Stuart J. Russell Andrew Critch Sergey Levine 35 228 0 03 Dec 2020
Video Game Level Repair via Mixed Integer Linear Programming Hejia Zhang Matthew C. Fontaine Amy K. Hoover Julian Togelius B. Dilkina Stefanos Nikolaidis GAN 39 30 0 13 Oct 2020
Conditional Level Generation and Game Blending Anurag Sarkar Zhihan Yang Seth Cooper 22 20 0 13 Oct 2020
Deep Learning for Procedural Content Generation Jialin Liu Sam Snodgrass Ahmed Khalifa S. Risi Georgios N. Yannakakis Julian Togelius 3DV 31 137 0 09 Oct 2020
Prioritized Level Replay Minqi Jiang Edward Grefenstette Tim Rocktaschel OffRL 26 154 0 08 Oct 2020
Sequential Segment-based Level Generation and Blending using Variational Autoencoders Anurag Sarkar Seth Cooper 3DV 37 26 0 17 Jul 2020
The NetHack Learning Environment Heinrich Küttler Nantas Nardelli Alexander H. Miller Roberta Raileanu Marco Selvatici Edward Grefenstette Tim Rocktaschel 45 179 0 24 Jun 2020
Learning to Generate Levels From Nothing Philip Bontrager Julian Togelius GAN 25 21 0 12 Feb 2020
Mario Level Generation From Mechanics Using Scene Stitching M. Green Luvneesh Mugrai Ahmed Khalifa Julian Togelius 37 23 0 07 Feb 2020
PCGRL: Procedural Content Generation via Reinforcement Learning Ahmed Khalifa Philip Bontrager Sam Earle Julian Togelius 26 143 0 24 Jan 2020
Increasing Generality in Machine Learning through Procedural Content Generation S. Risi Julian Togelius 33 125 0 29 Nov 2019
Bootstrapping Conditional GANs for Video Game Level Generation R. Torrado Geetanjali Sharma M. Green Gaurav Jaswal S. Risi Julian Togelius GAN 31 86 0 03 Oct 2019
Procedural Content Generation through Quality Diversity Daniele Gravina Ahmed Khalifa Antonios Liapis Julian Togelius Georgios N. Yannakakis 26 129 0 09 Jul 2019
Obstacle Tower: A Generalization Challenge in Vision, Control, and Planning Arthur Juliani Ahmed Khalifa Vincent-Pierre Berges Jonathan Harper Ervin Teng Hunter Henry A. Crespi Julian Togelius Danny Lange 29 143 0 04 Feb 2019
Addressing the Fundamental Tension of PCGML with Discriminative Learning Isaac Karth Adam M. Smith 34 34 0 10 Sep 2018
Illuminating Generalization in Deep Reinforcement Learning through Procedural Level Generation Niels Justesen R. Torrado Philip Bontrager Ahmed Khalifa Julian Togelius S. Risi 97 181 0 28 Jun 2018
Generative Design in Minecraft (GDMC), Settlement Generation Competition Christoph Salge M. Green Rodrigo Canaan Julian Togelius 16 50 0 27 Mar 2018
Procedural Content Generation via Machine Learning (PCGML) A. Summerville Sam Snodgrass Matthew J. Guzdial Christoffer Holmgård Amy K. Hoover Aaron Isaksen Andy Nealen Julian Togelius 3DV 49 389 0 02 Feb 2017
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 154 43,290 0 01 May 2014