OpenScene: 3D Scene Understanding with Open Vocabularies

28 November 2022

Marc Pollefeys

Papers citing "OpenScene: 3D Scene Understanding with Open Vocabularies"

36 / 286 papers shown

Title
A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future Chaoyang Zhu Long Chen ObjD VLM 31 32 0 18 Jul 2023
Distilling Large Vision-Language Model with Out-of-Distribution Generalizability Xuanlin Li Yunhao Fang Minghua Liu Z. Ling Z. Tu Haoran Su VLM 31 24 0 06 Jul 2023
Towards Open Vocabulary Learning: A Survey Jianzong Wu Xiangtai Li Shilin Xu Haobo Yuan Henghui Ding ... Jiangning Zhang Yu Tong Xudong Jiang Guohao Li Dacheng Tao ObjD VLM 40 136 0 28 Jun 2023
OpenMask3D: Open-Vocabulary 3D Instance Segmentation Ayca Takmaz Elisabetta Fedele R. Sumner Marc Pollefeys F. Tombari Francis Engelmann ISeg VLM 31 164 0 23 Jun 2023
Towards Label-free Scene Understanding by Vision Foundation Models Runnan Chen You-Chen Liu Lingdong Kong Nenglun Chen Xinge Zhu Yuexin Ma Tongliang Liu Wenping Wang VLM 33 42 0 06 Jun 2023
Multi-CLIP: Contrastive Vision-Language Pre-training for Question Answering tasks in 3D Scenes Alexandros Delitzas Maria Parelli Nikolas Hars G. Vlassis Sotiris Anagnostidis Gregor Bachmann Thomas Hofmann CLIP 12 19 0 04 Jun 2023
A Probabilistic Relaxation of the Two-Stage Object Pose Estimation Paradigm Onur Beker 3DV 8 0 0 01 Jun 2023
A Survey of Label-Efficient Deep Learning for 3D Point Clouds Aoran Xiao Xiaoqin Zhang Ling Shao Shijian Lu 3DPC 41 18 0 31 May 2023
OVO: Open-Vocabulary Occupancy Zhiyu Tan Zichao Dong Cheng-Jun Zhang Weikun Zhang Hang Ji Hao Li VLM 21 14 0 25 May 2023
Weakly Supervised 3D Open-vocabulary Segmentation Kunhao Liu Fangneng Zhan Jiahui Zhang Muyu Xu Yingchen Yu Abdulmotaleb El Saddik Christian Theobalt Eric P. Xing Shijian Lu 34 66 0 23 May 2023
VL-Fields: Towards Language-Grounded Neural Implicit Spatial Representations Nikolaos Tsagkas Oisin Mac Aodha Chris Xiaoxuan Lu VLM 30 25 0 21 May 2023
OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding Minghua Liu Ruoxi Shi Kaiming Kuang Yinhao Zhu Xuanlin Li Shizhong Han H. Cai Fatih Porikli Hao Su 3DPC 39 116 0 18 May 2023
Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Models Zhimin Chen Longlong Jing Yingwei Li Bing Li 32 31 0 15 May 2023
Segment Anything in 3D with Radiance Fields Jiazhong Cen Jiemin Fang Zanwei Zhou Chen Yang Lingxi Xie Xiaopeng Zhang Wei-Ming Shen Qi Tian 41 43 0 24 Apr 2023
USA-Net: Unified Semantic and Affordance Representations for Robot Memory Benjamin Bolte Austin S. Wang Jimmy Yang Mustafa Mukadam Mrinal Kalakrishnan Chris Paxton 3DV LM&Ro 19 13 0 24 Apr 2023
RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding Jihan Yang Runyu Ding Weipeng Deng Zhe Wang Xiaojuan Qi 20 62 0 03 Apr 2023
UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenes Dávid Rozenberszki Or Litany Angela Dai 3DPC ISeg 34 23 0 25 Mar 2023
Uni-Fusion: Universal Continuous Mapping Yijun Yuan Andreas Nüchter 43 9 0 22 Mar 2023
Neural Implicit Vision-Language Feature Fields Kenneth Blomqvist Francesco Milano Jen Jen Chung Lionel Ott Roland Siegwart VLM 22 12 0 20 Mar 2023
LERF: Language Embedded Radiance Fields J. Kerr C. Kim Ken Goldberg Angjoo Kanazawa Matthew Tancik 15 352 0 16 Mar 2023
Audio Visual Language Maps for Robot Navigation Chen Huang Oier Mees Andy Zeng Wolfram Burgard VGen 79 33 0 13 Mar 2023
CLIP-FO3D: Learning Free Open-world 3D Scene Representations from 2D Dense CLIP Junbo Zhang Runpei Dong Kaisheng Ma CLIP VLM 32 77 0 08 Mar 2023
Open-Vocabulary Affordance Detection in 3D Point Clouds Toan Ngyen Minh Nhat Vu Annalies Vuong Dzung Nguyen T. Vo Ngan Le A. Nguyen 3DPC 24 32 0 04 Mar 2023
Semantic Mechanical Search with Large Vision and Language Models Satvik Sharma Huang Huang K. Shivakumar A. Imran Ryan Hoque Brian Ichter Ken Goldberg LM&Ro VLM 29 5 0 24 Feb 2023
ConceptFusion: Open-set Multimodal 3D Mapping Krishna Murthy Jatavallabhula Ali Kuwajerwala Qiao Gu Mohd. Omama Tao Chen ... Celso Miguel de Melo Madhava Krishna Liam Paull Florian Shkurti Antonio Torralba 27 231 0 14 Feb 2023
Factor Fields: A Unified Framework for Neural Fields and Beyond Anpei Chen Zexiang Xu Xinyue Wei Siyu Tang Hao Su Andreas Geiger 37 58 0 02 Feb 2023
CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory Nur Muhammad (Mahi) Shafiullah Chris Paxton Lerrel Pinto Soumith Chintala Arthur Szlam VLM LM&Ro CLIP 95 156 0 11 Oct 2022
LidarMultiNet: Towards a Unified Multi-Task Network for LiDAR Perception Dongqiangzi Ye Zixiang Zhou Weijia Chen Yufei Xie Yu Wang Panqu Wang H. Foroosh 3DPC 58 84 0 19 Sep 2022
Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer Su He Taian Guo Tao Dai Ruizhi Qiao Bo Ren Shutao Xia VLM 78 49 0 05 Jul 2022
GroupViT: Semantic Segmentation Emerges from Text Supervision Jiarui Xu Shalini De Mello Sifei Liu Wonmin Byeon Thomas Breuel Jan Kautz Xinyu Wang ViT VLM 192 501 0 22 Feb 2022
PointCLIP: Point Cloud Understanding by CLIP Renrui Zhang Ziyu Guo Wei Zhang Kunchang Li Xupeng Miao Bin Cui Yu Qiao Peng Gao Hongsheng Li VLM 3DPC 175 435 0 04 Dec 2021
Mix3D: Out-of-Context Data Augmentation for 3D Scenes Alexey Nekrasov Jonas Schult Or Litany Bastian Leibe Francis Engelmann 3DPC 164 154 0 05 Oct 2021
Open-vocabulary Object Detection via Vision and Language Knowledge Distillation Xiuye Gu Nayeon Lee Weicheng Kuo Huayu Chen VLM ObjD 225 899 0 28 Apr 2021
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 337 3,708 0 11 Feb 2021
OccuSeg: Occupancy-aware 3D Instance Segmentation Lei Han Tian Zheng Lan Xu Lu Fang 3DPC 160 256 0 14 Mar 2020
Joint 2D-3D-Semantic Data for Indoor Scene Understanding Iro Armeni S. Sax Amir Zamir Silvio Savarese 3DV 3DPC 115 877 0 03 Feb 2017