DayDreamer: World Models for Physical Robot Learning

28 June 2022

Pieter Abbeel

Papers citing "DayDreamer: World Models for Physical Robot Learning"

50 / 221 papers shown

Title
Ego-Foresight: Self-supervised Learning of Agent-Aware Representations for Improved RL Manuel S. Nunes Atabak Dehban Y. Demiris J. Santos-Victor 97 0 0 27 May 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 333 54 0 23 May 2024
Diffusion for World Modeling: Visual Details Matter in Atari Eloi Alonso Adam Jelley Vincent Micheli Anssi Kanervisto Amos Storkey Tim Pearce Franccois Fleuret 112 69 0 20 May 2024
vMFER: Von Mises-Fisher Experience Resampling Based on Uncertainty of Gradient Directions for Policy Improvement Yiwen Zhu Jinyi Liu Wenya Wei Qianyi Fu Yujing Hu Zhou Fang Bo An Jianye Hao Tangjie Lv Changjie Fan 85 4 0 14 May 2024
RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigation Sourav Garg Krishan Rana M. Hosseinzadeh Lachlan Mares Niko Sünderhauf Feras Dayoub Ian Reid 125 20 0 09 May 2024
Information-driven Affordance Discovery for Efficient Robotic Manipulation Pietro Mazzaglia Taco Cohen Daniel Dijkman 125 2 0 06 May 2024
Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond Zheng Zhu Xiaofeng Wang Wangbo Zhao Chen Min Nianchen Deng ... Dawei Zhao Liang Xiao Jian-jun Zhao Jiwen Lu Guan Huang VGen LM&Ro 176 48 0 06 May 2024
Learning Tactile Insertion in the Real World Daniel Palenicek Theo Gruner Tim Schneider Alina Böhm Janis Lenz Inga Pfenning Eric Krämer Jan Peters 82 2 0 01 May 2024
WorldGPT: Empowering LLM as Multimodal World Model Zhiqi Ge Hongzhe Huang Mingze Zhou Juncheng Li Guoming Wang Siliang Tang Yueting Zhuang 77 29 0 28 Apr 2024
Deep Reinforcement Learning for Bipedal Locomotion: A Brief Survey Lingfan Bao Josephine N. Humphreys Tianhu Peng Chengxu Zhou 121 9 0 25 Apr 2024
Continuous Control Reinforcement Learning: Distributed Distributional DrQ Algorithms Zehao Zhou OffRL 31 0 0 16 Apr 2024
AI-MOLE: Autonomous Iterative Motion Learning for Unknown Nonlinear Dynamics with Extensive Experimental Validation Michael Meindl Simon Bachhuber Thomas Seel 45 5 0 09 Apr 2024
InterDreamer: Zero-Shot Text to 3D Dynamic Human-Object Interaction Sirui Xu Ziyin Wang Yu Wang Liangyan Gui 107 31 0 28 Mar 2024
CaT: Constraints as Terminations for Legged Locomotion Reinforcement Learning Elliot Chane-Sane Pierre-Alexandre Leziart T. Flayols O. Stasse Philippe Souères Nicolas Mansard 131 10 0 27 Mar 2024
Bridging the Sim-to-Real Gap with Bayesian Inference Jonas Rothfuss Bhavya Sukhija Lenart Treven Florian Dorfler Stelian Coros Andreas Krause AI4CE 90 4 0 25 Mar 2024
Learning Quadruped Locomotion Using Differentiable Simulation Yunlong Song Sangbae Kim Davide Scaramuzza 119 16 0 21 Mar 2024
Constrained Reinforcement Learning with Smoothed Log Barrier Function Baohe Zhang Yuan Zhang Lilli Frison Thomas Brox Joschka Bödecker 98 8 0 21 Mar 2024
Tell Me What You Want (What You Really, Really Want): Addressing the Expectation Gap for Goal Conveyance from Humans to Robots Kevin J. Leahy H. Siu 37 2 0 21 Mar 2024
A Contact Model based on Denoising Diffusion to Learn Variable Impedance Control for Contact-rich Manipulation Masashi Okada Mayumi Komatsu Tadahiro Taniguchi DiffM 67 1 0 20 Mar 2024
Dreaming of Many Worlds: Learning Contextual World Models Aids Zero-Shot Generalization Sai Prasanna Karim Farid Raghu Rajan André Biedenkapp 123 6 0 16 Mar 2024
ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation Guanxing Lu Shiyi Zhang Ziwei Wang Changliu Liu Jiwen Lu Yansong Tang 117 57 0 13 Mar 2024
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation Guosheng Zhao Xiaofeng Wang Zheng Zhu Xinze Chen Guan Huang Xiaoyi Bao Xingang Wang VGen 62 14 0 11 Mar 2024
World Models for Autonomous Driving: An Initial Survey Yanchen Guan Haicheng Liao Zhenning Li Jia Hu Runze Yuan Yunjian Li Guohui Zhang Chengzhong Xu 160 43 0 05 Mar 2024
An Efficient Model-Based Approach on Learning Agile Motor Skills without Reinforcement Hao-bin Shi Tingguang Li Qing Zhu Jiapeng Sheng Lei Han Max Q.-H. Meng 63 1 0 04 Mar 2024
Think2Drive: Efficient Reinforcement Learning by Thinking in Latent World Model for Quasi-Realistic Autonomous Driving (in CARLA-v2) Qifeng Li Xiaosong Jia Shaobo Wang Junchi Yan 124 34 0 26 Feb 2024
Revisiting Experience Replayable Conditions Taisuke Kobayashi 102 3 0 15 Feb 2024
Learning Interpretable Policies in Hindsight-Observable POMDPs through Partially Supervised Reinforcement Learning Michael Lanier Ying Xu Nathan Jacobs Chongjie Zhang Yevgeniy Vorobeychik 64 2 0 14 Feb 2024
Exploration Without Maps via Zero-Shot Out-of-Distribution Deep Reinforcement Learning Shathushan Sivashangaran Apoorva Khairnar A. Eskandarian OffRL 71 0 0 07 Feb 2024
Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control Zhongyu Li Xue Bin Peng Pieter Abbeel Sergey Levine Glen Berseth Koushil Sreenath 97 86 0 30 Jan 2024
SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning Jianlan Luo Zheyuan Hu Charles Xu You Liang Tan Jacob Berg Archit Sharma S. Schaal Chelsea Finn Abhishek Gupta Sergey Levine OffRL OnRL 172 49 0 29 Jan 2024
WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens Xiaofeng Wang Zheng Zhu Guan Huang Boyuan Wang Xinze Chen Jiwen Lu VGen 76 41 0 18 Jan 2024
Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities Xu Yan Haiming Zhang Yingjie Cai Jingming Guo Weichao Qiu ... Lihui Jiang Wei Zhang Hongbo Zhang Dengxin Dai Bingbing Liu 171 20 0 16 Jan 2024
Task-Oriented Active Learning of Model Preconditions for Inaccurate Dynamics Models A. LaGrassa Moonyoung Lee Oliver Kroemer 82 5 0 08 Jan 2024
Model-Based Control with Sparse Neural Dynamics Ziang Liu Genggeng Zhou Jeff He Tobia Marcucci Fei-Fei Li Jiajun Wu Yunzhu Li AI4CE 92 18 0 20 Dec 2023
Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response Junfeng Long Zirui Wang Quanyi Li Jiawei Gao Liu Cao Jiangmiao Pang 146 29 0 18 Dec 2023
Sample-Efficient Learning to Solve a Real-World Labyrinth Game Using Data-Augmented Model-Based Reinforcement Learning Thomas Bi Raffaello DÁndrea 35 6 0 15 Dec 2023
Small Dataset, Big Gains: Enhancing Reinforcement Learning by Offline Pre-Training with Model Based Augmentation Girolamo Macaluso Alessandro Sestini Andrew D. Bagdanov OffRL OnRL 43 3 0 15 Dec 2023
ReCoRe: Regularized Contrastive Representation Learning of World Model Rudra P. K. Poudel Harit Pandya Stephan Liwicki Roberto Cipolla DRL OffRL 72 7 0 14 Dec 2023
Pearl: A Production-ready Reinforcement Learning Agent Zheqing Zhu Rodrigo de Salvo Braz Jalaj Bhandari Daniel Jiang Yi Wan ... D. Korenkevych Ürün Dogan Frank Cheng Zheng Wu Wanqiao Xu VLM OffRL OnRL 120 7 0 06 Dec 2023
Building Ears for Robots: Machine Hearing in the Age of Autonomy Xuan Zhong 17 0 0 04 Dec 2023
Spacewalk-18: A Benchmark for Multimodal and Long-form Procedural Video Understanding in Novel Domains Rohan Myer Krishnan Zitian Tang Zhiqiu Yu Chen Sun 152 2 0 30 Nov 2023
Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving Yu-Quan Wang Jiawei He Lue Fan Hongxin Li Yuntao Chen Zhaoxiang Zhang VGen 147 144 0 29 Nov 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 152 29 0 24 Nov 2023
ADriver-I: A General World Model for Autonomous Driving Fan Jia Weixin Mao Yingfei Liu Yucheng Zhao Yuqing Wen Chi Zhang Xiangyu Zhang Tiancai Wang 115 70 0 22 Nov 2023
Towards Continual Reinforcement Learning for Quadruped Robots G. Minelli V. Vassiliades CLL 78 1 0 12 Nov 2023
TWIST: Teacher-Student World Model Distillation for Efficient Sim-to-Real Transfer Jun Yamada Marc Rigter Jack Collins Ingmar Posner 65 5 0 07 Nov 2023
Autonomous Robotic Reinforcement Learning with Asynchronous Human Feedback Max Balsells M. Torné Zihan Wang Samedh Desai Pulkit Agrawal Abhishek Gupta 97 10 0 31 Oct 2023
Grow Your Limits: Continuous Improvement with Real-World RL for Robotic Locomotion Laura M. Smith Yunhao Cao Sergey Levine OffRL 54 19 0 26 Oct 2023
Model-Based Runtime Monitoring with Interactive Imitation Learning Huihan Liu Shivin Dass Roberto Martín-Martín Yuke Zhu 93 23 0 26 Oct 2023
Finetuning Offline World Models in the Real World Yunhai Feng Nicklas Hansen Ziyan Xiong Chandramouli Rajagopalan Xiaolong Wang OffRL OnRL 73 22 0 24 Oct 2023