DayDreamer: World Models for Physical Robot Learning

28 June 2022

Pieter Abbeel

Papers citing "DayDreamer: World Models for Physical Robot Learning"

50 / 221 papers shown

Title
Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models Kevin Black Mitsuhiko Nakamoto P. Atreya Homer Walke Chelsea Finn Aviral Kumar Sergey Levine DiffM LM&Ro 133 143 0 16 Oct 2023
Learning Object Permanence from Videos via Latent Imaginations Manuel Traub Frederic Becker S. Otte Martin Volker Butz 57 1 0 16 Oct 2023
DexCatch: Learning to Catch Arbitrary Objects with Dexterous Hands Fengbo Lan Shengjie Wang Yunzhe Zhang Haotian Xu Oluwatosin Oseni Yang Gao Tao Zhang 79 5 0 13 Oct 2023
Unifying Foundation Models with Quadrotor Control for Visual Tracking Beyond Object Categories Alessandro Saviolo P. Rao Vivek Radhakrishnan Jiuhong Xiao Giuseppe Loianno 93 6 0 07 Oct 2023
Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models Xiaoxiao Sun Yang Yang Michal Shlapentokh-Rothman Haohan Wang Yu-Xiong Wang LRM AI4CE LM&Ro LLMAG 115 223 0 06 Oct 2023
Differentially Encoded Observation Spaces for Perceptive Reinforcement Learning Lev Grossman Brian Plancher OffRL 47 0 0 03 Oct 2023
HarmonyDream: Task Harmonization Inside World Models Haoyu Ma Jialong Wu Ningya Feng Chenjun Xiao Dong Li Jianye Hao Jianmin Wang Mingsheng Long 78 8 0 30 Sep 2023
GAIA-1: A Generative World Model for Autonomous Driving Masane Fuchi Lloyd Russell Hudson Yeo Zak Murez Hiroto Minami Alex Kendall Tomohiro Takagi Gianluca Corrado VGen 130 252 0 29 Sep 2023
Extreme Parkour with Legged Robots Xuxin Cheng Kexin Shi Ananye Agarwal Deepak Pathak 81 168 0 25 Sep 2023
MoDem-V2: Visuo-Motor World Models for Real-World Robot Manipulation Patrick E. Lancaster Nicklas Hansen Aravind Rajeswaran Vikash Kumar LM&Ro 91 16 0 25 Sep 2023
Prompt a Robot to Walk with Large Language Models Yen-Jen Wang Bike Zhang Jianyu Chen Koushil Sreenath LM&Ro LLMAG 111 53 0 18 Sep 2023
DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving Xiaofeng Wang Zheng Hua Zhu Guan Huang Xinze Chen Jiagang Zhu Jiwen Lu VGen 116 167 0 18 Sep 2023
From Knowing to Doing: Learning Diverse Motor Skills through Instruction Learning Linqi Ye Jiayi Li Yi Cheng Xianhao Wang Bin Liang Yan Peng 60 7 0 17 Sep 2023
Predicting Routine Object Usage for Proactive Robot Assistance Maithili Patel Aswin Prakash Sonia Chernova AI4TS 71 9 0 12 Sep 2023
RePo: Resilient Model-Based Reinforcement Learning by Regularizing Posterior Predictability Chuning Zhu Max Simchowitz Siri Gadipudi Abhishek Gupta 98 14 0 31 Aug 2023
Learning to Navigate from Scratch using World Models and Curiosity: the Good, the Bad, and the Ugly Daria de Tinguy Sven Remmery Pietro Mazzaglia Tim Verbelen Bart Dhoedt 105 0 0 30 Aug 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 106 102 0 21 Aug 2023
Robust Quadrupedal Locomotion via Risk-Averse Policy Learning Jiyuan Shi Chenjia Bai Haoran He Lei Han Dong Wang Bin Zhao Mingguo Zhao Xiuyang Li Xuelong Li OffRL OOD 80 9 0 18 Aug 2023
Consciousness in Artificial Intelligence: Insights from the Science of Consciousness Patrick Butlin R. Long Eric Elmoznino Yoshua Bengio Jonathan C. P. Birch ... L. Mudrik Megan A. K. Peters Eric Schwitzgebel Jonathan Simon Rufin VanRullen LLMAG 85 107 0 17 Aug 2023
On-Robot Bayesian Reinforcement Learning for POMDPs Hai V. Nguyen Sammie Katt Yuchen Xiao Chris Amato OffRL 67 1 0 22 Jul 2023
Meta-Policy Learning over Plan Ensembles for Robust Articulated Object Manipulation Constantinos Chamzas Caelan Reed Garrett Balakumar Sundaralingam Lydia E. Kavraki Dieter Fox 35 1 0 08 Jul 2023
FOCUS: Object-Centric World Models for Robotics Manipulation Stefano Ferraro Pietro Mazzaglia Tim Verbelen Bart Dhoedt OCL LM&Ro 95 13 0 05 Jul 2023
Facing Off World Model Backbones: RNNs, Transformers, and S4 Fei Deng Junyeong Park Sungjin Ahn 99 32 0 05 Jul 2023
Dynamic-Resolution Model Learning for Object Pile Manipulation Yixuan Wang Yunzhu Li Katherine Driggs-Campbell Li Fei-Fei Jiajun Wu 99 24 0 29 Jun 2023
Learning Continuous Control with Geometric Regularity from Robot Intrinsic Symmetry Shengchao Yan Baohe Zhang Yuan Zhang Joschka Boedecker Wolfram Burgard 96 2 0 28 Jun 2023
Curious Replay for Model-based Adaptation Isaac Kauvar Christopher Doyle Linqi Zhou Nick Haber 62 12 0 28 Jun 2023
Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perception Junwon Seo Jungwi Mun Taekyung Kim 73 4 0 26 Jun 2023
SoftGPT: Learn Goal-oriented Soft Object Manipulation Skills by Generative Pre-trained Heterogeneous Graph Transformer Junjia Liu Zhihao Li Wanyu Lin Sylvain Calinon Kay Chen Tan Fei Chen 87 9 0 22 Jun 2023
Simplified Temporal Consistency Reinforcement Learning Yi Zhao Wenshuai Zhao Rinu Boney Arno Solin Joni Pajarinen OffRL 72 13 0 15 Jun 2023
Multi-Object Manipulation via Object-Centric Neural Scattering Functions Stephen Tian Yancheng Cai Hong-Xing Yu Sergey Zakharov Katherine Liu Adrien Gaidon Yunzhu Li Jiajun Wu OCL 69 12 0 14 Jun 2023
Bridging the Gap Between Multi-Step and One-Shot Trajectory Prediction via Self-Supervision Faris Janjos Max Keller Maxim Dolgov J. Marius Zöllner 77 7 0 06 Jun 2023
SelFLoc: Selective Feature Fusion for Large-scale Point Cloud-based Place Recognition Qibo Qiu Haiming Gao Wenxiao Wang Zhiyi Su Tian Xie Wei Hua Xiaofei He 3DPC 58 2 0 01 Jun 2023
TorchRL: A data-driven decision-making library for PyTorch Albert Bou Matteo Bettini Sebastian Dittert Vikash Kumar Shagun Sodhani Xiaomeng Yang Gianni De Fabritiis Vincent Moens OffRL AI4CE 126 41 0 01 Jun 2023
Learning Better with Less: Effective Augmentation for Sample-Efficient Visual Reinforcement Learning Guozheng Ma Linrui Zhang Haoyu Wang Lu Li Zilin Wang Zhen Wang Li Shen Xueqian Wang Dacheng Tao 102 13 0 25 May 2023
Reasoning with Language Model is Planning with World Model Shibo Hao Yi Gu Haodi Ma Joshua Jiahua Hong Zhen Wang D. Wang Zhiting Hu ReLM LRM LLMAG 170 604 0 24 May 2023
M-EMBER: Tackling Long-Horizon Mobile Manipulation via Factorized Domain Transfer Bohan Wu Roberto Martin-Martin Li Fei-Fei 87 12 0 23 May 2023
TOM: Learning Policy-Aware Models for Model-Based Reinforcement Learning via Transition Occupancy Matching Yecheng Jason Ma K. Sivakumar Jason Yan Osbert Bastani Dinesh Jayaraman OffRL MU 82 6 0 22 May 2023
Bridging Active Exploration and Uncertainty-Aware Deployment Using Probabilistic Ensemble Neural Network Dynamics Taekyung Kim Jungwi Mun Junwon Seo Beomsu Kim S. Hong 88 12 0 20 May 2023
Language Models Meet World Models: Embodied Experiences Enhance Language Models Jiannan Xiang Tianhua Tao Yi Gu Tianmin Shu Zirui Wang Zichao Yang Zhiting Hu ALM LLMAG LM&Ro CLL 121 106 0 18 May 2023
Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racing Elena Shrestha C. Reddy Hanxi Wan Yulun Zhuang Ram Vasudevan 66 1 0 08 May 2023
Behavior Contrastive Learning for Unsupervised Skill Discovery Rushuai Yang Chenjia Bai Hongyi Guo Siyuan Li Bin Zhao Zhen Wang Peng Liu Xuelong Li SSL 77 18 0 08 May 2023
Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning Tuomas Haarnoja Ben Moran Guy Lever Sandy H. Huang Dhruva Tirumala ... Andrea Huber N. Hurley F. Nori R. Hadsell N. Heess 136 153 0 26 Apr 2023
Quality-Diversity Optimisation on a Physical Robot Through Dynamics-Aware and Reset-Free Learning Simón C. Smith Bryan Lim Hannah Janmohamed Antoine Cully 82 0 0 24 Apr 2023
Approximate Shielding of Atari Agents for Safe Exploration Alexander W. Goodall Francesco Belardinelli 40 2 0 21 Apr 2023
Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild Yikai Wang Zheyuan Jiang Jianyu Chen 79 8 0 21 Apr 2023
Continuous Versatile Jumping Using Learned Action Residuals Yuxiang Yang Xiang Meng Wenhao Yu Tingnan Zhang Jie Tan Byron Boots 99 11 0 17 Apr 2023
Learning Robot Manipulation from Cross-Morphology Demonstration G. Salhotra Isabella Liu Gaurav Sukhatme LM&Ro 66 9 0 07 Apr 2023
Tracker: Model-based Reinforcement Learning for Tracking Control of Human Finger Attached with Thin McKibben Muscles Daichi Saito Eri Nagatomo Jefferson Pardomuan Hideki Koike 46 0 0 01 Apr 2023
ConBaT: Control Barrier Transformer for Safe Policy Learning Yue Meng Sai H. Vemprala Rogerio Bonatti Chuchu Fan Ashish Kapoor OffRL 78 3 0 07 Mar 2023
End-to-End Learning of Deep Visuomotor Policy for Needle Picking Hongbin Lin Bin Li Xiangyu Chu Qi Dou Yunhui Liu K. W. S. Au OffRL 85 5 0 07 Mar 2023