Transformers are Sample-Efficient World Models

1 September 2022

Papers citing "Transformers are Sample-Efficient World Models"

50 / 134 papers shown

Title
RLVR-World: Training World Models with Reinforcement Learning Jialong Wu Shaofeng Yin Ningya Feng Mingsheng Long OffRL VGen 17 0 0 20 May 2025
Building spatial world models from sparse transitional episodic memories Zizhan He Maxime Daigle Pouya Bashivan KELM 12 0 0 19 May 2025
SAINT: Attention-Based Modeling of Sub-Action Dependencies in Multi-Action Policies Matthew Landers Taylor W. Killian Thomas Hartvigsen Afsaneh Doryab 24 0 0 17 May 2025
FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation Jun Guo Xiaojian Ma Yikai Wang Min Yang Huaping Liu Qing Li VGen 39 0 0 15 May 2025
Scaling Multi Agent Reinforcement Learning for Underwater Acoustic Tracking via Autonomous Vehicles Matteo Gallici Ivan Masmitja Mario Martin OffRL 29 0 0 13 May 2025
LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation Yuhang Huang JIazhao Zhang SHilong Zou Xinwang Liu Ruizhen Hu Kai Xu 19 0 0 13 May 2025
Learning Local Causal World Models with State Space Models and Attention Francesco Petri Luigi Asprino Aldo Gangemi CML 40 0 0 04 May 2025
Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures Junwon Seo Kensuke Nakamura Andrea V. Bajcsy 56 0 0 01 May 2025
Adapting a World Model for Trajectory Following in a 3D Game Marko Tot Shu Ishida Abdelhak Lemkhenter David Bignell Pallavi Choudhury ... Tarun Gupta Darren Gehring Sam Devlin Sergio Valcarcel Macua Raluca Georgescu 48 0 0 16 Apr 2025
Exploration-Driven Generative Interactive Environments N. Savov Naser Kazemi Mohammad Mahdi Danda Pani Paudel Xi Wang Luc Van Gool VGen 3DV 43 0 0 03 Apr 2025
AdaWorld: Learning Adaptable World Models with Latent Actions Shenyuan Gao Siyuan Zhou Yilun Du Jun Zhang Chuang Gan VGen 73 4 0 24 Mar 2025
Learning Transformer-based World Models with Contrastive Predictive Coding Maxime Burchi Radu Timofte 72 0 0 06 Mar 2025
Four Principles for Physically Interpretable World Models Jordan Peper Zhenjiang Mao Yuang Geng Siyuan Pan Ivan Ruchkin 110 1 0 04 Mar 2025
Discrete Codebook World Models for Continuous Control Aidan Scannell Mohammadreza Nakhaei Kalle Kujanpää Yi Zhao Kevin Sebastian Luck Dieter Büchler Joni Pajarinen OffRL 50 1 0 01 Mar 2025
Accelerating Model-Based Reinforcement Learning with State-Space World Models Maria Krinner Elie Aljalbout Angel Romero Davide Scaramuzza OffRL 79 1 0 27 Feb 2025
Zero-shot Model-based Reinforcement Learning using Large Language Models Abdelhakim Benechehab Youssef Attia El Hili Ambroise Odonnat Oussama Zekri Albert Thomas Giuseppe Paolo Maurizio Filippone I. Redko Balázs Kégl OffRL 75 1 0 17 Feb 2025
Task Aware Dreamer for Task Generalization in Reinforcement Learning Chengyang Ying Zhongkai Hao Xinning Zhou Hang Su Songming Liu Dong Yan Jun Zhu 77 3 0 17 Feb 2025
Learning Versatile Optimizers on a Compute Diet A. Moudgil Boris Knyazev Guillaume Lajoie Eugene Belilovsky 238 0 0 22 Jan 2025
Deterministic Uncertainty Propagation for Improved Model-Based Offline Reinforcement Learning Abdullah Akgul Manuel Haußmann M. Kandemir OffRL 80 1 0 17 Jan 2025
Advances in Transformers for Robotic Applications: A Review Nikunj Sanghai Nik Bear Brown AI4CE 86 0 0 13 Dec 2024
Personalized and Sequential Text-to-Image Generation Ofir Nabati Guy Tennenholtz ChihWei Hsu Moonkyung Ryu Deepak Ramachandran Yinlam Chow Xiang Li Craig Boutilier MLLM 87 0 0 10 Dec 2024
Metacognition for Unknown Situations and Environments (MUSE) Rodolfo Valiente Praveen K. Pilly 74 0 0 20 Nov 2024
World Models: The Safety Perspective Zifan Zeng Chongzhe Zhang Feng Liu Joseph Sifakis Qunli Zhang Shiming Liu Peng Wang KELM LLMAG 47 1 0 12 Nov 2024
SPARTAN: A Sparse Transformer Learning Local Causation Anson Lei Bernhard Schölkopf Ingmar Posner 54 2 0 11 Nov 2024
Autoregressive Models in Vision: A Survey Jing Xiong Gongye Liu Lun Huang Chengyue Wu Taiqiang Wu ... Hao Fei Guillermo Sapiro Jiebo Luo Ping Luo Ngai Wong VGen 53 9 0 08 Nov 2024
Scaling Laws for Pre-training Agents and World Models Tim Pearce Tabish Rashid Dave Bignell Raluca Georgescu Sam Devlin Katja Hofmann LM&Ro 47 7 0 07 Nov 2024
DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning G. Zhou Hengkai Pan Yann LeCun Lerrel Pinto VGen LM&Ro OffRL 35 16 0 07 Nov 2024
Exploring the Edges of Latent State Clusters for Goal-Conditioned Reinforcement Learning Yuanlin Duan Guofeng Cui He Zhu OffRL 41 0 0 03 Nov 2024
Reinforcement Learning Gradients as Vitamin for Online Finetuning Decision Transformers Kai Yan Alex Schwing Yu-xiong Wang OffRL OnRL 41 0 0 31 Oct 2024
Robot Policy Learning with Temporal Optimal Transport Reward Yuwei Fu Haichao Zhang Di Wu Wei Xu Benoit Boulet OffRL 45 1 0 29 Oct 2024
FACTS: A Factored State-Space Framework For World Modelling Li Nanbo Firas Laakom Yucheng Xu Wenyi Wang Jürgen Schmidhuber AI4TS 244 0 0 28 Oct 2024
Uncovering RL Integration in SSL Loss: Objective-Specific Implications for Data-Efficient RL Ömer Veysel Çağatan Barış Akgün OffRL 44 0 0 22 Oct 2024
Words as Beacons: Guiding RL Agents with High-Level Language Prompts Unai Ruiz-Gonzalez Alain Andres Pedro G. Bascoy Javier Del Ser 30 0 0 11 Oct 2024
Drama: Mamba-Enabled Model-Based Reinforcement Learning Is Sample and Parameter Efficient Wenlong Wang Ivana Dusparic Yucheng Shi Ke Zhang Vinny Cahill Mamba 239 0 0 11 Oct 2024
Masked Generative Priors Improve World Models Sequence Modelling Capabilities Cristian Meo Mircea Lica Zarif Ikram Akihiro Nakano Vedant Shah Aniket Didolkar Dianbo Liu Anirudh Goyal Justin Dauwels OffRL 90 0 0 10 Oct 2024
Open-World Reinforcement Learning over Long Short-Term Imagination Jiajian Li Q. Wang Yunbo Wang Xin Jin Yang Li Wenjun Zeng Xiaokang Yang OCL VLM 69 1 0 04 Oct 2024
From Reward Shaping to Q-Shaping: Achieving Unbiased Learning with LLM-Guided Knowledge Xiefeng Wu OffRL 34 1 0 02 Oct 2024
Scaling Offline Model-Based RL via Jointly-Optimized World-Action Model Pretraining Jie Cheng Ruixi Qiao Gang Xiong Binhua Li Yingwei Ma Binhua Li Yongbin Li Yisheng Lv OffRL OnRL LM&Ro 50 3 0 01 Oct 2024
One-shot World Models Using a Transformer Trained on a Synthetic Prior Fabio Ferreira Moreno Schlageter Raghu Rajan André Biedenkapp Frank Hutter 41 0 0 21 Sep 2024
Planning Transformer: Long-Horizon Offline Reinforcement Learning with Planning Tokens Joseph Clinton Robert Lieck OffRL 54 4 0 14 Sep 2024
Learning Generative Interactive Environments By Trained Agent Exploration Naser Kazemi N. Savov Danda Paudel Luc Van Gool 45 2 0 10 Sep 2024
Can Transformers Do Enumerative Geometry? Baran Hashemi Roderic G. Corominas Alessandro Giacchetto 49 2 0 27 Aug 2024
The Interpretability of Codebooks in Model-Based Reinforcement Learning is Limited Kenneth Eaton Jonathan C. Balloch Julia Kim Mark O. Riedl FAtt OffRL 36 0 0 28 Jul 2024
QT-TDM: Planning with Transformer Dynamics Model and Autoregressive Q-Learning Mostafa Kotb C. Weber Muhammad Burhan Hafez Stefan Wermter 41 1 0 26 Jul 2024
CarFormer: Self-Driving with Learned Object-Centric Representations Shadi S. Hamdan Fatma Guney 3DPC OCL 51 3 0 22 Jul 2024
LIMT: Language-Informed Multi-Task Visual World Models Elie Aljalbout Nikolaos Sotirakis Patrick van der Smagt Maximilian Karl Nutan Chen 52 5 0 18 Jul 2024
Generalizing soft actor-critic algorithms to discrete action spaces Le Zhang Yong Gu Xin Zhao Yanshuo Zhang Shu Zhao Yifei Jin Xinxin Wu 34 0 0 08 Jul 2024
Residual-MPPI: Online Policy Customization for Continuous Control Pengcheng Wang Chenran Li Catherine Weaver Kenta Kawamoto Masayoshi Tomizuka Chen Tang Wei Zhan OffRL 37 3 0 01 Jul 2024
Efficient World Models with Context-Aware Tokenization Vincent Micheli Eloi Alonso François Fleuret OffRL VLM 34 6 0 27 Jun 2024
Decentralized Transformers with Centralized Aggregation are Sample-Efficient Multi-Agent World Models Yang Zhang Chenjia Bai Bin Zhao Junchi Yan Xiu Li Xuelong Li OffRL 27 0 0 22 Jun 2024