StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objects

19 October 2021

Papers citing "StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objects"

50 / 69 papers shown

Title
Slot-Level Robotic Placement via Visual Imitation from Single Human Video Dandan Shan Kaichun Mo Wei Yang Yu-Wei Chao David Fouhey Dieter Fox Arsalan Mousavian 36 0 0 02 Apr 2025
ShapeShift: Towards Text-to-Shape Arrangement Synthesis with Content-Aware Geometric Constraints Vihaan Misra Peter Schaldenbrand Jean Oh DiffM 56 1 0 18 Mar 2025
Tidiness Score-Guided Monte Carlo Tree Search for Visual Tabletop Rearrangement Hogun Kee Wooseok Oh Minjae Kang Hyemin Ahn Songhwai Oh 59 0 0 24 Feb 2025
PACA: Perspective-Aware Cross-Attention Representation for Zero-Shot Scene Rearrangement Shutong Jin Ruiyu Wang Kuangyi Chen Florian T. Pokorny 27 0 0 29 Oct 2024
CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal Dissection Guankun Wang Han Xiao Huxin Gao Renrui Zhang Long Bai Xiaoxiao Yang Zhen Li Hongsheng Li Hongliang Ren 36 4 0 10 Oct 2024
LeLaN: Learning A Language-Conditioned Navigation Policy from In-the-Wild Videos Noriaki Hirose Catherine Glossop A. Sridhar Dhruv Shah Oier Mees Sergey Levine LM&Ro 29 10 0 04 Oct 2024
DAP: Diffusion-based Affordance Prediction for Multi-modality Storage Haonan Chang Kowndinya Boyalakuntla Yuhan Liu Xinyu Zhang Liam Schramm Abdeslam Boularias 29 0 0 31 Aug 2024
LLM-enhanced Scene Graph Learning for Household Rearrangement Wenhao Li Zhiyuan Yu Qijin She Zhinan Yu Yuqing Lan Chenyang Zhu Ruizhen Hu Kai Xu 44 4 0 22 Aug 2024
Stimulating Imagination: Towards General-purpose Object Rearrangement Jianyang Wu Jie Gu Xiaokang Ma Chu Tang Jingmin Chen DiffM LM&Ro OCL 37 0 0 03 Aug 2024
RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics Wentao Yuan Jiafei Duan Valts Blukis Wilbert Pumacay Ranjay Krishna Adithyavairavan Murali Arsalan Mousavian Dieter Fox LM&Ro 42 45 0 15 Jun 2024
RVT-2: Learning Precise Manipulation from Few Demonstrations Ankit Goyal Valts Blukis Jie Xu Yijie Guo Yu-Wei Chao Dieter Fox 32 38 0 12 Jun 2024
A Survey on Vision-Language-Action Models for Embodied AI Yueen Ma Zixing Song Yuzheng Zhuang Jianye Hao Irwin King LM&Ro 74 41 0 23 May 2024
"Set It Up!": Functional Object Arrangement with Compositional Generative Models Yiqing Xu Jiayuan Mao Yilun Du Tomás Lozano-Pérez L. Kaelbling David Hsu LM&Ro 80 5 0 20 May 2024
Composable Part-Based Manipulation Weiyu Liu Jiayuan Mao Joy Hsu Tucker Hermans Animesh Garg Jiajun Wu 43 11 0 09 May 2024
Learning Planning Abstractions from Language Weiyu Liu Geng Chen Joy Hsu Jiayuan Mao Jiajun Wu PINN 43 2 0 06 May 2024
Grasp, See, and Place: Efficient Unknown Object Rearrangement with Policy Structure Prior Kechun Xu Zhongxiang Zhou Jun Wu Haojian Lu Rong Xiong Yue Wang 37 2 0 23 Feb 2024
Robotic Test Tube Rearrangement Using Combined Reinforcement Learning and Motion Planning Hao Chen Weiwei Wan Masaki Matsushita Takeyuki Kotaka Kensuke Harada 33 1 0 18 Jan 2024
Interactive Visual Task Learning for Robots Weiwei Gu Anant Sah N. Gopalan 38 4 0 20 Dec 2023
Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Models Ivan Kapelyukh Yifei Ren Ignacio Alzugaray Edward Johns VLM LM&Ro 20 20 0 07 Dec 2023
SceneScore: Learning a Cost Function for Object Arrangement Ivan Kapelyukh Edward Johns OffRL DiffM OCL 24 4 0 14 Nov 2023
NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities Ruohan Zhang Sharon Lee Minjune Hwang Ayano Hiranaka Chen Wang ... Gabrael Levine Ruohan Gao Anthony Norcia Fei-Fei Li Jiajun Wu LM&Ro 27 17 0 02 Nov 2023
M2T2: Multi-Task Masked Transformer for Object-centric Pick and Place Wentao Yuan Adithyavairavan Murali Arsalan Mousavian Dieter Fox 43 19 0 02 Nov 2023
Knolling bot 2.0: Enhancing Object Organization with Self-supervised Graspability Estimation Yuhang Hu Zhizhuo Zhang Hod Lipson 19 0 0 30 Oct 2023
Knolling Bot: Learning Robotic Object Arrangement from Tidy Demonstrations Yuhang Hu Zhizhuo Zhang Xinyue Zhu Ruibo Liu P. Wyder Hod Lipson LM&Ro SSL 23 0 0 06 Oct 2023
ConSOR: A Context-Aware Semantic Object Rearrangement Framework for Partially Arranged Scenes Kartik Ramachandruni Max Zuo Sonia Chernova 29 6 0 30 Sep 2023
LGMCTS: Language-Guided Monte-Carlo Tree Search for Executable Semantic Object Rearrangement Haonan Chang D. K. Bukovšek T. Kosir Alex Lee Blaz Mojskerc Harish Udhaya Kumar M. Omladič Abdeslam Boularias LM&Ro 20 11 0 27 Sep 2023
Adversarial Object Rearrangement in Constrained Environments with Heterogeneous Graph Neural Networks Xibai Lou Houjian Yu Ross Worobel Yang Yang Changhyun Choi 29 3 0 27 Sep 2023
Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Models Yixuan Huang Jialin Yuan Chanho Kim Pupul Pradhan Bryan Chen Fuxin Li Tucker Hermans 37 7 0 26 Sep 2023
SG-Bot: Object Rearrangement via Coarse-to-Fine Robotic Imagination on Scene Graphs Guangyao Zhai Xiaoni Cai Dianye Huang Yan Di Fabian Manhardt Federico Tombari Nassir Navab Benjamin Busam LM&Ro 24 27 0 21 Sep 2023
Efficient Object Rearrangement via Multi-view Fusion Dehao Huang Chao Tang Hong Zhang OCL 22 4 0 16 Sep 2023
Structural Concept Learning via Graph Attention for Multi-Level Rearrangement Planning Manav Kulshrestha A. H. Qureshi 3DPC 36 6 0 05 Sep 2023
Compositional Diffusion-Based Continuous Constraint Solvers Zhutian Yang Jiayuan Mao Yilun Du Jiajun Wu J. Tenenbaum Tomás Lozano-Pérez L. Kaelbling DiffM 75 32 0 02 Sep 2023
"Tidy Up the Table": Grounding Common-sense Objective for Tabletop Object Rearrangement Yiqing Xu David Hsu LM&Ro LMTD 28 0 0 21 Jul 2023
OBJECT 3DIT: Language-guided 3D-aware Image Editing Oscar Michel Anand Bhattad Eli VanderBilt Ranjay Krishna Aniruddha Kembhavi Tanmay Gupta DiffM 22 39 0 20 Jul 2023
VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models Wenlong Huang Chen Wang Ruohan Zhang Yunzhu Li Jiajun Wu Li Fei-Fei LM&Ro 33 479 0 12 Jul 2023
Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangement Anthony Simeonov Ankit Goyal Lucas Manuelli Lin Yen-Chen Alina Sarmiento Alberto Rodriguez Pulkit Agrawal D. Fox DiffM 41 38 0 10 Jul 2023
Blocks2World: Controlling Realistic Scenes with Editable Primitives Vaibhav Vavilala Seemandhar Jain R. Vasanth Anand Bhattad David A. Forsyth VGen 31 4 0 07 Jul 2023
Goal Representations for Instruction Following: A Semi-Supervised Language Interface to Control Vivek Myers Andre Wang He Kuan Fang Homer Walke Philippe Hansen-Estruch Ching-An Cheng Mihai Jalobeanu Andrey Kolobov Anca Dragan Sergey Levine LM&Ro 22 29 0 30 Jun 2023
RVT: Robotic View Transformer for 3D Object Manipulation Ankit Goyal Jie Xu Yijie Guo Valts Blukis Yu-Wei Chao D. Fox LM&Ro 42 117 0 26 Jun 2023
Language-Conditioned Imitation Learning with Base Skill Priors under Unstructured Data Hongkuan Zhou Zhenshan Bing Xiangtong Yao Xiaojie Su Chenguang Yang Kai-Qi Huang Alois C. Knoll LM&Ro 41 18 0 30 May 2023
Multi-Stage Monte Carlo Tree Search for Non-Monotone Object Rearrangement Planning in Narrow Confined Environments Hanwen Ren A. H. Qureshi 20 1 0 26 May 2023
Latent Space Planning for Multi-Object Manipulation with Environment-Aware Relational Classifiers Yixuan Huang Nichols Crawford Taylor Adam Conkey Weiyu Liu Tucker Hermans 33 7 0 18 May 2023
Energy-based Models are Zero-Shot Planners for Compositional Scene Rearrangement N. Gkanatsios Ayush Jain Zhou Xian Yunchu Zhang C. Atkeson Katerina Fragkiadaki LM&Ro 98 31 0 27 Apr 2023
Spatial-Language Attention Policies for Efficient Robot Learning Priyam Parashar Vidhi Jain Xiaohan Zhang Jay Vakil Sam Powers Yonatan Bisk Chris Paxton LM&Ro 36 5 0 21 Apr 2023
ERRA: An Embodied Representation and Reasoning Architecture for Long-horizon Language-conditioned Manipulation Tasks Chao Zhao Shuai Yuan Chunli Jiang Junhao Cai Hongyu Yu M. Y. Wang Qifeng Chen LM&Ro 26 14 0 05 Apr 2023
Grounding Object Relations in Language-Conditioned Robotic Manipulation with Semantic-Spatial Reasoning Qian Luo Yunfei Li Yi Wu LM&Ro 40 5 0 31 Mar 2023
Task and Motion Planning with Large Language Models for Object Rearrangement Yan Ding Xiaohan Zhang Chris Paxton Shiqi Zhang LM&Ro LRM 27 178 0 10 Mar 2023
Task-Oriented Grasp Prediction with Visual-Language Inputs Chao Tang Dehao Huang Lingxiao Meng Weiyu Liu Hong Zhang 25 33 0 28 Feb 2023
ReorientDiff: Diffusion Model based Reorientation for Object Manipulation Utkarsh Aashu Mishra Yongxin Chen 21 20 0 28 Feb 2023
LEGO-Net: Learning Regular Rearrangements of Objects in Rooms Qiuhong Anna Wei Sijie Ding Jeong Joon Park Rahul Sajnani A. Poulenard Srinath Sridhar Leonidas J. Guibas DiffM 30 61 0 23 Jan 2023