Deep Visual Foresight for Planning Robot Motion

3 October 2016

Papers citing "Deep Visual Foresight for Planning Robot Motion"

50 / 181 papers shown

Title
FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation Jun Guo Xiaojian Ma Yikai Wang Min Yang Huaping Liu Qing Li VGen 34 0 0 15 May 2025
Pixel Motion as Universal Representation for Robot Control Kanchana Ranasinghe Xiang Li Cristina Mata J. Park Michael S. Ryoo VGen 34 0 0 12 May 2025
Generative Artificial Intelligence in Robotic Manipulation: A Survey Kun Zhang Peng Yun Jun Cen Junhao Cai DiDi Zhu ... Qifeng Chen Jia Pan Wei Zhang Bo Yang Hua Chen 61 1 0 05 Mar 2025
Steganography Beyond Space-Time with Chain of Multimodal AI Ching-Chun Chang Isao Echizen 74 0 0 25 Feb 2025
DHP: Discrete Hierarchical Planning for Hierarchical Reinforcement Learning Agents Shashank Sharma Janina Hoffmann Vinay P. Namboodiri 96 0 0 04 Feb 2025
Strengthening Generative Robot Policies through Predictive World Modeling Han Qi Haocheng Yin Yilun Du Yilun Du Heng Yang 69 2 0 02 Feb 2025
BaB-ND: Long-Horizon Motion Planning with Branch-and-Bound and Neural Dynamics Keyi Shen Jiangwei Yu Huan Zhang Yunzhu Li Yunzhu Li 103 1 0 12 Dec 2024
Navigation World Models Amir Bar G. Zhou Danny Tran Trevor Darrell Yann LeCun VGen EgoV 84 15 0 04 Dec 2024
VideoAgent: Self-Improving Video Generation Achint Soni Sreyas Venkataraman Abhranil Chandra Sebastian Fischmeister Percy Liang Bo Dai Sherry Yang LM&Ro VGen 60 8 0 14 Oct 2024
StackGen: Generating Stable Structures from Silhouettes via Diffusion Luzhe Sun Takuma Yoneda Samuel Wheeler Tianchong Jiang Matthew R. Walter DiffM 42 0 0 26 Sep 2024
DiSPo: Diffusion-SSM based Policy Learning for Coarse-to-Fine Action Discretization Nayoung Oh Jaehyeong Jang Moonkyeong Jung Daehyung Park 226 0 0 23 Sep 2024
Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulators Fabian Baumeister Lukas Mack Joerg Stueckler 42 2 0 20 Sep 2024
Embodiment-Agnostic Action Planning via Object-Part Scene Flow Weiliang Tang Jia-Hui Pan Wei Zhan Jianshu Zhou Huaxiu Yao Yun-Hui Liu Masayoshi Tomizuka Mingyu Ding Chi-Wing Fu 63 0 0 16 Sep 2024
VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation Wentao Zhao Jiaming Chen Ziyu Meng Donghui Mao Ran Song Wei Zhang 45 8 0 13 Jul 2024
Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability Shenyuan Gao Jiazhi Yang Li Chen Kashyap Chitta Yihang Qiu Andreas Geiger Jun Zhang Hongyang Li 71 75 0 27 May 2024
iVideoGPT: Interactive VideoGPTs are Scalable World Models Jialong Wu Shaofeng Yin Ningya Feng Xu He Dong Li Haifeng Zhang Mingsheng Long VGen 51 26 0 24 May 2024
Action-conditioned video data improves predictability Meenakshi Sarkar Debasish Ghose VGen 51 0 0 08 Apr 2024
On Bringing Robots Home Nur Muhammad (Mahi) Shafiullah Anant Rai Haritheja Etukuru Yiqian Liu Ishan Misra Soumith Chintala Lerrel Pinto 41 77 0 27 Nov 2023
Structured World Models from Human Videos Russell Mendonca Shikhar Bahl Deepak Pathak LM&Ro 51 87 0 21 Aug 2023
DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation Hanqing Wang Wei Liang Luc Van Gool Wenguan Wang LM&Ro 37 28 0 14 Aug 2023
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control Anthony Brohan Noah Brown Justice Carbajal Yevgen Chebotar Xi Chen ... Ted Xiao Peng Xu Sichun Xu Tianhe Yu Brianna Zitkovich LM&Ro LRM 35 1,116 0 28 Jul 2023
TOM: Learning Policy-Aware Models for Model-Based Reinforcement Learning via Transition Occupancy Matching Yecheng Jason Ma K. Sivakumar Jason Yan Osbert Bastani Dinesh Jayaraman OffRL MU 32 6 0 22 May 2023
3D-IntPhys: Towards More Generalized 3D-grounded Visual Intuitive Physics under Challenging Scenes Haotian Xue Antonio Torralba J. Tenenbaum Daniel L. K. Yamins Yunzhu Li H. Tung PINN VGen AI4CE 66 8 0 22 Apr 2023
Towards Autonomous Selective Harvesting: A Review of Robot Perception, Robot Design, Motion Planning and Control S. VishnuRajendran Bappaditya Debnath Bappaditya Debnath Sariah Mghames Willow Mandil Soran Parsa Simon Parsons Amir M. Ghalamzan-E. 32 26 0 19 Apr 2023
Ensemble Latent Space Roadmap for Improved Robustness in Visual Action Planning M. Lippi Michael C. Welle Andrea Gasparri Danica Kragic 35 0 0 27 Mar 2023
Model-Based Reinforcement Learning with Isolated Imaginations Minting Pan Xiangming Zhu Yitao Zheng Yunbo Wang Xiaokang Yang 34 0 0 27 Mar 2023
PDPP: Projected Diffusion for Procedure Planning in Instructional Videos Hanlin Wang Yilu Wu Sheng Guo Limin Wang VGen DiffM 78 30 0 26 Mar 2023
Recent Advances of Deep Robotic Affordance Learning: A Reinforcement Learning Perspective Xintong Yang Ze Ji Jing Wu Yunyu Lai 46 12 0 09 Mar 2023
Self-Improving Robots: End-to-End Autonomous Visuomotor Reinforcement Learning Archit Sharma Ahmed M. Ahmed Rehaan Ahmad Chelsea Finn SSL 59 17 0 02 Mar 2023
Open-World Object Manipulation using Pre-trained Vision-Language Models Austin Stone Ted Xiao Yao Lu K. Gopalakrishnan Kuang-Huei Lee ... Sean Kirmani Brianna Zitkovich F. Xia Chelsea Finn Karol Hausman LM&Ro 156 145 0 02 Mar 2023
DeFNet: Deconstructed Strategy for Multi-step Fabric Folding Tasks Ningquan Gu R. He Lianqing Yu 39 1 0 01 Mar 2023
Failure-aware Policy Learning for Self-assessable Robotics Tasks Kechun Xu Runjian Chen Shuqing Zhao Zizhang Li Hongxiang Yu Ci Chen Yue Wang R. Xiong 20 1 0 25 Feb 2023
A Simple Decentralized Cross-Entropy Method Zichen Zhang Jun Jin Martin Jägersand Jun Luo Dale Schuurmans 15 8 0 16 Dec 2022
CACTI: A Framework for Scalable Multi-Task Multi-Scene Visual Imitation Learning Zhao Mandi Homanga Bharadhwaj Vincent Moens Shuran Song Aravind Rajeswaran Vikash Kumar LM&Ro 28 70 0 12 Dec 2022
Learning to Optimize in Model Predictive Control Jacob Sacks Byron Boots 29 22 0 05 Dec 2022
Learning Sampling Distributions for Model Predictive Control Jacob Sacks Byron Boots 13 21 0 05 Dec 2022
Robotic Table Wiping via Reinforcement Learning and Whole-body Trajectory Optimization T. Lew Sumeet Singh M. Prats Jeffrey Bingham Jonathan Weisz ... Fei Xia Peng Xu Tingnan Zhang Jie Tan Montserrat Gonzalez 35 15 0 19 Oct 2022
On the Feasibility of Cross-Task Transfer with Model-Based Reinforcement Learning Yifan Xu Nicklas Hansen Zirui Wang Yung-Chieh Chan H. Su Zhuowen Tu OffRL 33 16 0 19 Oct 2022
DALL-E-Bot: Introducing Web-Scale Diffusion Models to Robotics Ivan Kapelyukh Vitalis Vosylius Edward Johns LM&Ro DiffM 117 146 0 05 Oct 2022
T3VIP: Transformation-based 3D Video Prediction Iman Nematollahi Erick Rosete-Beas Seyed Mahdi B. Azad Raghunandan Rajan Frank Hutter Wolfram Burgard VGen 68 1 0 19 Sep 2022
HARP: Autoregressive Latent Video Prediction with High-Fidelity Image Generator Younggyo Seo Kimin Lee Fangchen Liu Stephen James Pieter Abbeel VGen 29 28 0 15 Sep 2022
Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation Mohit Shridhar Lucas Manuelli Dieter Fox LM&Ro 175 465 0 12 Sep 2022
Instruction-driven history-aware policies for robotic manipulations Pierre-Louis Guhur Shizhe Chen Ricardo Garcia Pinel Makarand Tapaswi Ivan Laptev Cordelia Schmid LM&Ro 113 102 0 11 Sep 2022
Task-Agnostic Learning to Accomplish New Tasks Xianqi Zhang Xingtao Wang Xu Liu Wenrui Wang Xiaopeng Fan Debin Zhao OffRL 91 0 0 09 Sep 2022
Learning Switching Criteria for Sim2Real Transfer of Robotic Fabric Manipulation Policies Satvik Sharma Ellen R. Novoseller Vainavi Viswanath Zaynah Javed R. Parikh Ryan Hoque Ashwin Balakrishna Daniel S. Brown Ken Goldberg 21 8 0 02 Jul 2022
Masked World Models for Visual Control Younggyo Seo Danijar Hafner Hao Liu Fangchen Liu Stephen James Kimin Lee Pieter Abbeel OffRL 93 147 0 28 Jun 2022
DayDreamer: World Models for Physical Robot Learning Philipp Wu Alejandro Escontrela Danijar Hafner Ken Goldberg Pieter Abbeel 61 277 0 28 Jun 2022
MaskViT: Masked Visual Pre-Training for Video Prediction Agrim Gupta Stephen Tian Yunzhi Zhang Jiajun Wu Roberto Martín-Martín Li Fei-Fei 112 112 0 23 Jun 2022
Diffusion Models for Video Prediction and Infilling Tobias Höppe Arash Mehrjou Stefan Bauer Didrik Nielsen Andrea Dittadi DiffM VGen 38 131 0 15 Jun 2022
Iso-Dream: Isolating and Leveraging Noncontrollable Visual Dynamics in World Models Minting Pan Xiangming Zhu Yunbo Wang Xiaokang Yang 29 39 0 27 May 2022