DayDreamer: World Models for Physical Robot Learning

28 June 2022

Pieter Abbeel

Papers citing "DayDreamer: World Models for Physical Robot Learning"

50 / 221 papers shown

Title
An Efficient Occupancy World Model via Decoupled Dynamic Flow and Image-assisted Training Haiming Zhang Ying Xue Xu Yan Jiacheng Zhang Weichao Qiu Dongfeng Bai Bingbing Liu Shuguang Cui Zehan Li 137 7 0 18 Dec 2024
BaB-ND: Long-Horizon Motion Planning with Branch-and-Bound and Neural Dynamics Keyi Shen Jiangwei Yu Huan Zhang Yunzhu Li Yunzhu Li 174 1 0 12 Dec 2024
The Matrix: Infinite-Horizon World Generation with Real-Time Moving Control Ruili Feng Han Zhang Zhantao Yang Jie Xiao Zhilei Shu Zhiheng Liu Andy Zheng Yukun Huang Yu Liu Han Zhang VGen 154 20 0 04 Dec 2024
Navigation World Models Amir Bar G. Zhou Danny Tran Trevor Darrell Yann LeCun VGen EgoV 212 33 0 04 Dec 2024
Understanding World or Predicting Future? A Comprehensive Survey of World Models Jingtao Ding Yunke Zhang Yu Shang Yuheng Zhang Zefang Zong ... Hongyuan Su Nian Li Nicholas Sukiennik Fengli Xu Yong Li VGen SyDa 156 16 0 21 Nov 2024
Variable-Frequency Imitation Learning for Variable-Speed Motion Nozomu Masuya S. Sakaino T. Tsuji 112 0 0 19 Nov 2024
EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation Xiaofeng Wang Kang Zhao Fan Liu Jiayu Wang Guosheng Zhao Xiaoyi Bao Zheng Hua Zhu Yingya Zhang Xingang Wang VGen 119 10 0 13 Nov 2024
World Models: The Safety Perspective Zifan Zeng Chongzhe Zhang Feng Liu Joseph Sifakis Qunli Zhang Shiming Liu Peng Wang KELM LLMAG 78 2 0 12 Nov 2024
Multi-Task Interactive Robot Fleet Learning with Visual World Models Huihan Liu Yu Zhang Vaarij Betala Evan Zhang James Liu Crystal Ding Yinlin Zhu 129 9 0 30 Oct 2024
Self-Improving Autonomous Underwater Manipulation Ruoshi Liu Huy Ha Mengxue Hou Shuran Song Carl Vondrick 83 1 0 24 Oct 2024
Multimodal Information Bottleneck for Deep Reinforcement Learning with Multiple Sensors Bang You Huaping Liu SSL 72 6 0 23 Oct 2024
Traversability-Aware Legged Navigation by Learning from Real-World Visual Data Hongbo Zhang Zhongyu Li Xuanqi Zeng Laura Smith Kyle Stachowicz ... Zhitao Song Weipeng Xia Sergey Levine Koushil Sreenath Yun-Hui Liu 84 3 0 14 Oct 2024
Reinforcement Learning For Quadrupedal Locomotion: Current Advancements And Future Perspectives Maurya Gurram Prakash Kumar Uttam Shantipal S. Ohol OffRL 112 0 0 14 Oct 2024
PIVOT-R: Primitive-Driven Waypoint-Aware World Model for Robotic Manipulation Kai Zhang Pengzhen Ren Bingqian Lin Junfan Lin Shikui Ma Hang Xu Xiaodan Liang 61 2 0 14 Oct 2024
Asymptotic Analysis of Sample-averaged Q-learning Saunak Kumar Panda Ruiqi Liu Yisha Xiang OnRL 131 11 0 14 Oct 2024
Physical Simulation for Multi-agent Multi-machine Tending Abdalwhab Abdalwhab Giovanni Beltrame David St-Onge OffRL AI4CE 66 0 0 11 Oct 2024
Disturbance Observer-based Control Barrier Functions with Residual Model Learning for Safe Reinforcement Learning Dvij Kalaria Qin Lin John M. Dolan OffRL 97 0 0 09 Oct 2024
Sampling from Energy-based Policies using Diffusion V. Jain Tara Akhound-Sadegh Siamak Ravanbakhsh DiffM 149 2 0 02 Oct 2024
Continuously Improving Mobile Manipulation with Autonomous Real-World RL Russell Mendonca Emmanuel Panov Bernadette Bucher Jiuguang Wang Deepak Pathak OffRL 91 7 0 30 Sep 2024
Learning to Swim: Reinforcement Learning for 6-DOF Control of Thruster-driven Autonomous Underwater Vehicles Levi Cai Kevin Chang Yogesh A. Girdhar 149 3 0 30 Sep 2024
LoopSR: Looping Sim-and-Real for Lifelong Policy Adaptation of Legged Robots Peilin Wu Weiji Xie Jiahang Cao H. Lai Weinan Zhang 88 2 0 26 Sep 2024
World Model-based Perception for Visual Legged Locomotion Hang Lai Jiahang Cao Jiafeng Xu Hongtao Wu Yunfeng Lin Tao Kong Yong Yu Weinan Zhang VGen 91 2 0 25 Sep 2024
Mitigating Covariate Shift in Imitation Learning for Autonomous Vehicles Using Latent Space Generative World Models A. Popov Alperen Degirmenci David Wehr Shashank Hegde Ryan Oldja ... David Nistér Urs Muller Ruchi Bhargava Stan Birchfield Nikolai Smolyanskiy 153 11 0 25 Sep 2024
One-shot World Models Using a Transformer Trained on a Synthetic Prior Fabio Ferreira Moreno Schlageter Raghu Rajan André Biedenkapp Frank Hutter 92 0 0 21 Sep 2024
SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience Elliot Chane-Sane Joseph Amigo Thomas Flayols Ludovic Righetti Nicolas Mansard 112 7 0 20 Sep 2024
No Saved Kaleidosope: an 100% Jitted Neural Network Coding Language with Pythonic Syntax Augusto Seben da Rosa Marlon Daniel Angeli Jorge Aikes Junior Alef Iury Ferreira L. Gris Anderson da Silva Soares Arnaldo Candido Junior Frederico Santos de Oliveira Gabriel Trevisan Damke Rafael Teixeira Sousa 53 0 0 17 Sep 2024
Critic as Lyapunov function (CALF): a model-free, stability-ensuring agent Pavel Osinenko Grigory Yaremenko Roman Zashchitin Anton Bolychev Sinan Ibrahim D. Dobriborsci 52 4 0 15 Sep 2024
PIP-Loco: A Proprioceptive Infinite Horizon Planning Framework for Quadrupedal Robot Locomotion Aditya Shirwatkar Naman Saxena Kishore Chandra Shishir Kolathaya 128 4 0 14 Sep 2024
$DexSim2Real$^{2}$: Building Explicit World Model for Precise Articulated Object Dexterous Manipulation$ DexSim2Real $^{2}$ : Building Explicit World Model for Precise Articulated Object Dexterous Manipulation Taoran Jiang Liqian Ma Yixuan Guan Jiaojiao Meng Weihang Chen Zecui Zeng Lusong Li Dan Wu Jing Xu Rui Chen 99 0 0 13 Sep 2024
Online Decision MetaMorphFormer: A Casual Transformer-Based Reinforcement Learning Framework of Universal Embodied Intelligence Luo Ji Runji Lin OffRL AI4CE LM&Ro 76 0 0 11 Sep 2024
Autonomous Iterative Motion Learning (AI-MOLE) of a SCARA Robot for Automated Myocardial Injection Michael Meindl Raphael Monkemoller Thomas Seel 46 0 0 10 Sep 2024
Learning Multi-agent Multi-machine Tending by Mobile Robots Abdalwhab Abdalwhab Giovanni Beltrame Samira Ebrahimi Kahou David St-Onge 160 1 0 29 Aug 2024
Controlling the World by Sleight of Hand Sruthi Sudhakar Ruoshi Liu Basile Van Hoorick Carl Vondrick Richard Zemel 98 4 0 13 Aug 2024
Body Transformer: Leveraging Robot Embodiment for Policy Learning Carmelo Sferrazza Dun-Ming Huang Fangchen Liu Jongmin Lee Pieter Abbeel LM&Ro 88 14 0 12 Aug 2024
Navigating the Human Maze: Real-Time Robot Pathfinding with Generative Imitation Learning Martin Moder Stephen Adhisaputra Josef Pauli 67 0 0 07 Aug 2024
Automatic Environment Shaping is the Next Frontier in RL Younghyo Park G. Margolis Pulkit Agrawal OffRL 98 3 0 23 Jul 2024
APriCoT: Action Primitives based on Contact-state Transition for In-Hand Tool Manipulation Daichi Saito Atsushi Kanehira Kazuhiro Sasabuchi Naoki Wake Jun Takamatsu Hideki Koike Katsushi Ikeuchi 73 1 0 16 Jul 2024
Over the Edge of Chaos? Excess Complexity as a Roadblock to Artificial General Intelligence Teo Susnjak Timothy R. McIntosh A. Barczak N. Reyes Tong Liu Paul Watters Malka N. Halgamuge 53 3 0 04 Jul 2024
DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabrics Tyler Ga Wei Lum Martin Matak Viktor Makoviychuk Ankur Handa Arthur Allshire Tucker Hermans Nathan D. Ratliff Karl Van Wyk 124 18 0 02 Jul 2024
RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packing Bo Ai Stephen Tian Haochen Shi Yixuan Wang Cheston Tan Yunzhu Li Jiajun Wu 101 15 0 01 Jul 2024
Non-Prehensile Aerial Manipulation using Model-Based Deep Reinforcement Learning Cora A. Dimmig Marin Kobilarov 72 1 0 01 Jul 2024
BricksRL: A Platform for Democratizing Robotics and Reinforcement Learning Research and Education with LEGO Sebastian Dittert Vincent Moens Gianni De Fabritiis 82 1 0 25 Jun 2024
KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty P. Becker Niklas Freymuth Gerhard Neumann Mamba 81 2 0 21 Jun 2024
IRASim: Learning Interactive Real-Robot Action Simulators Fangqi Zhu Hongtao Wu Song Guo Yuxiao Liu Chilam Cheang Tao Kong 127 22 0 20 Jun 2024
Act Better by Timing: A timing-Aware Reinforcement Learning for Autonomous Driving Guanzhou Li Jianping Wu Yujing He 61 0 0 19 Jun 2024
Demonstrating Agile Flight from Pixels without State Estimation Ismail Geles L. Bauersfeld Angel Romero Jiaxu Xing Davide Scaramuzza 90 23 0 18 Jun 2024
Learning-based legged locomotion; state of the art and future perspectives Sehoon Ha Joonho Lee M. van de Panne Zhaoming Xie Wenhao Yu Majid Khadiv 144 20 0 03 Jun 2024
Transformers and Slot Encoding for Sample Efficient Physical World Modelling Francesco Petri Luigi Asprino Aldo Gangemi OCL ViT 70 0 0 30 May 2024
Empowering Embodied Manipulation: A Bimanual-Mobile Robot Manipulation Dataset for Household Tasks Tianle Zhang Dongjiang Li Yihang Li Zecui Zeng Lin Zhao ... Yue Chen Xuelong Wei Yibing Zhan Lusong Li Xiaodong He 94 7 0 29 May 2024
World Models for General Surgical Grasping Hongbin Lin Bin Li Chun Wai Wong Juan Rojas Xiangyu Chu K. W. S. Au 58 3 0 28 May 2024