Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning

4 April 2024

Rui Li

Tobias Fischer

Mattia Segu

Marc Pollefeys

Luc Van Gool

Federico Tombari

ArXiv PDF HTML

Papers citing "Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning"

28 / 28 papers shown

Title
ViPOcc: Leveraging Visual Priors from Vision Foundation Models for Single-View 3D Occupancy Prediction Yi Feng Yu Han Xijing Zhang Tanghui Li Yanting Zhang Rui Fan 239 3 0 15 Dec 2024
Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving JunDa Cheng Wei Yin Kaixuan Wang Xiaozhi Chen Shijie Wang Xin Yang 66 15 0 12 Mar 2024
R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Cameras Aron Schmied Tobias Fischer Martin Danelljan Marc Pollefeys Feng Yu 3DV 46 27 0 28 Aug 2023
OccDepth: A Depth-Aware Method for 3D Semantic Scene Completion Ruihang Miao Weizhou Liu Ming-lei Chen Zheng Gong Weixin Xu Chen Hu Shuchang Zhou 93 85 0 27 Feb 2023
OpenScene: 3D Scene Understanding with Open Vocabularies Songyou Peng Kyle Genova ChiyuMaxJiang Andrea Tagliasacchi Marc Pollefeys Thomas Funkhouser 3DPC VLM 82 361 0 28 Nov 2022
Towards Accurate Reconstruction of 3D Scene Shape from A Single Monocular Image Wei Yin Jianming Zhang Oliver Wang Simon Niklaus Simon Chen Yifan Liu Chunhua Shen MDE 84 45 0 28 Aug 2022
MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction Zehao Yu Songyou Peng Michael Niemeyer Torsten Sattler Andreas Geiger 116 462 0 01 Jun 2022
LocalBins: Improving Depth Estimation by Learning Local Distributions S. Bhat Ibraheem Alhashim Peter Wonka MDE 55 100 0 28 Mar 2022
Attention Concatenation Volume for Accurate and Efficient Stereo Matching Gangwei Xu Junda Cheng Peng Guo Xin Yang 3DV 91 211 0 04 Mar 2022
MonoScene: Monocular 3D Semantic Scene Completion Anh-Quan Cao Raoul de Charette 3DV 89 276 0 01 Dec 2021
KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D Yiyi Liao Jun Xie Andreas Geiger 3DV 3DPC 75 581 0 28 Sep 2021
Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimation Hyun-Joo Jung Eunhyeok Park S. Yoo MDE 56 110 0 19 Aug 2021
NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction Peng Wang Lingjie Liu Yuan Liu Christian Theobalt Taku Komura Wenping Wang 90 1,726 0 20 Jun 2021
EdgeConv with Attention Module for Monocular Depth Estimation Minhyeok Lee Sangwon Hwang Chaewon Park Sangyoun Lee MDE 3DPC 35 17 0 16 Jun 2021
In-Place Scene Labelling and Understanding with Implicit Scene Representation Shuaifeng Zhi Tristan Laidlow Stefan Leutenegger Andrew J. Davison 127 420 0 29 Mar 2021
Vision Transformers for Dense Prediction René Ranftl Alexey Bochkovskiy V. Koltun ViT MDE 130 1,732 0 24 Mar 2021
Learning Depth via Leveraging Semantics: Self-supervised Monocular Depth Estimation with Both Implicit and Explicit Semantic Guidance Rui Li Xiantuo He Danna Xue Shaolin Su Qing Mao Yu Zhu Jinqiu Sun Yanning Zhang SSL MDE 87 30 0 11 Feb 2021
Learning to Recover 3D Scene Shape from a Single Image Wei Yin Jianming Zhang Oliver Wang Simon Niklaus Long Mai Simon Chen Chunhua Shen MDE 94 237 0 17 Dec 2020
pixelNeRF: Neural Radiance Fields from One or Few Images Alex Yu Vickie Ye Matthew Tancik Angjoo Kanazawa 173 1,737 0 03 Dec 2020
AdaBins: Depth Estimation using Adaptive Bins S. Bhat Ibraheem Alhashim Peter Wonka 3DV MDE ViT 110 857 0 28 Nov 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 201 1,765 0 29 Jun 2020
Enforcing geometric constraints of virtual normal for depth prediction Wei Yin Yifan Liu Chunhua Shen Youliang Yan 3DV MDE 112 428 0 29 Jul 2019
Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer René Ranftl Katrin Lasinger David Hafner Konrad Schindler V. Koltun MDE 199 1,790 0 02 Jul 2019
3D Packing for Self-Supervised Monocular Depth Estimation Vitor Campagnolo Guizilini Rares Andrei Ambrus Sudeep Pillai Allan Raventos Adrien Gaidon SSL 3DPC MDE 79 647 0 06 May 2019
CAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depth José M. Fácil Benjamin Ummenhofer Huizhong Zhou Luis Montesano Thomas Brox Javier Civera MDE 128 139 0 03 Apr 2019
DeepV2D: Video to Depth with Differentiable Structure from Motion Zachary Teed Jia Deng 3DV VGen MDE 68 248 0 11 Dec 2018
The Cityscapes Dataset for Semantic Urban Scene Understanding Marius Cordts Mohamed Omran Sebastian Ramos Timo Rehfeld Markus Enzweiler Rodrigo Benenson Uwe Franke Stefan Roth Bernt Schiele 1.1K 11,609 0 06 Apr 2016
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network David Eigen Christian Puhrsch Rob Fergus MDE 3DPC 3DV 217 4,056 0 09 Jun 2014