3D Neural Scene Representations for Visuomotor Control

8 July 2021

Yunzhu Li

Shuang Li

Vincent Sitzmann

Pulkit Agrawal

Antonio Torralba

ArXiv PDF HTML

Papers citing "3D Neural Scene Representations for Visuomotor Control"

34 / 34 papers shown

Title
Gaussian Splatting Visual MPC for Granular Media Manipulation Wei-Cheng Tseng Ellina Zhang Krishna Murthy Jatavallabhula Florian Shkurti 3DGS 31 0 0 13 Oct 2024
DEL: Discrete Element Learner for Learning 3D Particle Dynamics with Neural Rendering Jiaxu Wang Jingkai Sun Junhao He Ziyi Zhang Qiang Zhang Mingyuan Sun Renjing Xu AI4CE 32 0 0 11 Oct 2024
Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interaction Julius Berner Chao Liu Pingchuan Ma John Eastman Daniela Rus Dylan Randle Yuri Ivanov Wojciech Matusik 41 0 0 04 Oct 2024
Points2Plans: From Point Clouds to Long-Horizon Plans with Composable Relational Dynamics Yixuan Huang Christopher Agia Jimmy Wu Tucker Hermans Jeannette Bohg 3DPC 49 1 0 27 Aug 2024
GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstruction Haodong Xiang Xinghui Li Xiansong Lai Wanting Zhang Zhichao Liao Kai Cheng Xueping Liu Xueping Liu 3DV 3DGS 42 10 0 30 May 2024
DNAct: Diffusion Guided Multi-Task 3D Policy Learning Ge Yan Yueh-hua Wu Xiaolong Wang VGen 37 20 0 07 Mar 2024
DyST: Towards Dynamic Neural Scene Representations on Real-World Videos Maximilian Seitzer Sjoerd van Steenkiste Thomas Kipf Klaus Greff Mehdi S. M. Sajjadi VGen ViT 31 8 0 09 Oct 2023
Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases Eugen Šlapak Enric Pardo Matús Dopiriak T. Maksymyuk Juraj Gazda AI4CE 30 12 0 14 Aug 2023
Neural Field Movement Primitives for Joint Modelling of Scenes and Motions Ahmet E. Tekden M. Deisenroth Yasemin Bekiroglu 3DV 37 2 0 09 Aug 2023
3D-IntPhys: Towards More Generalized 3D-grounded Visual Intuitive Physics under Challenging Scenes Haotian Xue Antonio Torralba J. Tenenbaum Daniel L. K. Yamins Yunzhu Li H. Tung PINN VGen AI4CE 61 8 0 22 Apr 2023
NeRF applied to satellite imagery for surface reconstruction Federico Semeraro Yi Zhang Wen-Hao Wu P. Carroll DiffM 11 0 0 09 Apr 2023
NeuSE: Neural SE(3)-Equivariant Embedding for Consistent Spatial Understanding with Objects Jiahui Fu Yilun Du Kurran Singh J. Tenenbaum John J. Leonard 39 8 0 13 Mar 2023
On the effectiveness of neural priors in modeling dynamical systems Sameera Ramasinghe Hemanth Saratchandran Violetta Shevchenko Simon Lucey 29 2 0 10 Mar 2023
Canonical Fields: Self-Supervised Learning of Pose-Canonicalized Neural Fields Rohith Agaram Shaurya Dewan Rahul Sajnani A. Poulenard Madhava Krishna Srinath Sridhar 36 6 0 05 Dec 2022
Neural Grasp Distance Fields for Robot Manipulation Thomas Weng David Held Franziska Meier Mustafa Mukadam 13 45 0 04 Nov 2022
One-Shot Neural Fields for 3D Object Understanding Valts Blukis Taeyeop Lee Jonathan Tremblay Bowen Wen In So Kweon Kuk-Jin Yoon D. Fox Stan Birchfield 32 6 0 21 Oct 2022
RGB-Only Reconstruction of Tabletop Scenes for Collision-Free Manipulator Control Z-H. Tang Balakumar Sundaralingam Jonathan Tremblay Bowen Wen Ye Yuan Stephen Tyree Charles T. Loop A. Schwing Stan Birchfield 37 10 0 21 Oct 2022
Differentiable Physics Simulation of Dynamics-Augmented Neural Objects Simon Le Cleac'h Hong-Xing Yu Michelle Guo Taylor A. Howell Ruohan Gao Jiajun Wu Zachary Manchester Mac Schwager AI4CE 30 39 0 17 Oct 2022
Multi-Object Navigation with dynamically learned neural implicit representations Pierre Marza L. Matignon Olivier Simonin Christian Wolf 32 23 0 11 Oct 2022
Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fields Niko Sünderhauf Jad Abou-Chakra Dimity Miller UQCV 70 53 0 19 Sep 2022
K-VIL: Keypoints-based Visual Imitation Learning Jianfeng Gao Z. Tao Noémie Jaquier Tamim Asfour VGen SSL 47 23 0 07 Sep 2022
NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Hands Ninad Khargonkar Neil Song Zesheng Xu Balakrishnan Prabhakaran Yu Xiang DRL 21 18 0 06 Jul 2022
Neural Neural Textures Make Sim2Real Consistent R. Burgert Jinghuan Shang Xiang Li Michael S. Ryoo 28 6 0 27 Jun 2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation Matt Deitke Eli VanderBilt Alvaro Herrasti Luca Weihs Jordi Salvador ... Winson Han Eric Kolve Ali Farhadi Aniruddha Kembhavi Roozbeh Mottaghi LM&Ro 41 235 0 14 Jun 2022
Rotation-Equivariant Conditional Spherical Neural Fields for Learning a Natural Illumination Prior James A. D. Gardner Bernhard Egger W. Smith 28 13 0 07 Jun 2022
Planning with Diffusion for Flexible Behavior Synthesis Michael Janner Yilun Du J. Tenenbaum Sergey Levine DiffM 202 632 0 20 May 2022
DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools Xingyu Lin Zhiao Huang Yunzhu Li J. Tenenbaum David Held Chuang Gan 30 72 0 31 Mar 2022
Multi-View Dreaming: Multi-View World Model with Contrastive Learning Akira Kinose Masashi Okada Ryogo Okumura T. Taniguchi OffRL 21 10 0 15 Mar 2022
ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation Bokui Shen Zhenyu Jiang Chris Choy Leonidas J. Guibas Silvio Savarese Anima Anandkumar Yuke Zhu AI4CE 14 41 0 14 Mar 2022
Tracking and Planning with Spatial World Models Baris Kayalibay Atanas Mirchev Patrick van der Smagt Justin Bayer 46 2 0 25 Jan 2022
Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation Anthony Simeonov Yilun Du Andrea Tagliasacchi J. Tenenbaum Alberto Rodriguez Pulkit Agrawal Vincent Sitzmann 11 238 0 09 Dec 2021
VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Field Naruya Kondo Yuya Ikeda Andrea Tagliasacchi Y. Matsuo Yoichi Ochiai Shi Gu 21 17 0 25 Nov 2021
Neural Fields in Visual Computing and Beyond Yiheng Xie Towaki Takikawa Shunsuke Saito Or Litany Shiqin Yan Numair Khan Federico Tombari James Tompkin Vincent Sitzmann Srinath Sridhar 3DH 49 615 0 22 Nov 2021
Deep Dynamics Models for Learning Dexterous Manipulation Anusha Nagabandi K. Konolige Sergey Levine Vikash Kumar 157 408 0 25 Sep 2019