Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation

22 March 2024

Kaixuan Wang

Chunhua Shen

Shaojie Shen

3DGS

ArXiv PDF HTML

Papers citing "Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation"

41 / 191 papers shown

Title
Auto-Rectify Network for Unsupervised Indoor Depth Estimation Jiawang Bian Huangying Zhan Naiyan Wang Tat-Jun Chin Chunhua Shen Ian Reid SSL MDE 73 61 0 04 Jun 2020
PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization Shunsuke Saito Tomas Simon Jason M. Saragih Hanbyul Joo 3DH 73 746 0 01 Apr 2020
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow Zachary Teed Jia Deng MDE 214 2,619 0 26 Mar 2020
Virtual KITTI 2 Yohann Cabon Naila Murray Martin Humenberger 3DPC 63 286 0 29 Jan 2020
Scalability in Perception for Autonomous Driving: Waymo Open Dataset Pei Sun Henrik Kretzschmar Xerxes Dotiwalla Aurelien Chouard Vijaysai Patnaik ... Shuyang Cheng Yu Zhang Jonathon Shlens Zhifeng Chen Dragomir Anguelov 111 2,875 0 10 Dec 2019
Real-time Scalable Dense Surfel Mapping Kaixuan Wang Fei Gao Shaojie Shen 37 65 0 10 Sep 2019
DIODE: A Dense Indoor and Outdoor DEpth Dataset Igor Vasiljevic Nicholas I. Kolkin Shanyi Zhang Ruotian Luo Haochen Wang ... Andrea F. Daniele Mohammadreza Mostajabi Steven Basart Matthew R. Walter Gregory Shakhnarovich MDE 3DV 69 232 0 01 Aug 2019
Enforcing geometric constraints of virtual normal for depth prediction Wei Yin Yifan Liu Chunhua Shen Youliang Yan 3DV MDE 112 427 0 29 Jul 2019
From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimation Jin Han Lee Myung-Kyu Han D. W. Ko I. Suh 3DV MDE 116 681 0 24 Jul 2019
Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer René Ranftl Katrin Lasinger David Hafner Konrad Schindler V. Koltun MDE 197 1,786 0 02 Jul 2019
The Replica Dataset: A Digital Replica of Indoor Spaces Julian Straub Thomas Whelan Lingni Ma Yufan Chen Erik Wijmans ... H. Strasdat R. D. Nardi Michael Goesele S. Lovegrove Richard Newcombe 3DV 126 851 0 13 Jun 2019
Pattern-Affinitive Propagation across Depth, Surface Normal and Semantic Segmentation Zhenyu Zhang Zhen Cui Chunyan Xu Yan Yan N. Sebe Jian Yang MDE 56 285 0 08 Jun 2019
PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitization Shunsuke Saito Zeng Huang Ryota Natsume Shigeo Morishima Angjoo Kanazawa Hao Li 3DH 137 1,256 0 13 May 2019
3D Packing for Self-Supervised Monocular Depth Estimation Vitor Campagnolo Guizilini Rares Andrei Ambrus Sudeep Pillai Allan Raventos Adrien Gaidon SSL 3DPC MDE 79 646 0 06 May 2019
DPSNet: End-to-end Deep Plane Sweep Stereo Sunghoon Im Hae-Gon Jeon Stephen Lin In So Kweon 3DV 83 227 0 02 May 2019
Spherical Regression: Learning Viewpoints, Surface Normals and 3D Rotations on n-Spheres Shuai Liao E. Gavves Cees G. M. Snoek 75 66 0 10 Apr 2019
CAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depth José M. Fácil Benjamin Ummenhofer Huizhong Zhou Luis Montesano Thomas Brox Javier Civera MDE 128 139 0 03 Apr 2019
FrameNet: Learning Local Canonical Frames of 3D Surfaces from a Single RGB Image Jingwei Huang Yichao Zhou Thomas Funkhouser Leonidas Guibas 3DV 61 48 0 29 Mar 2019
nuScenes: A multimodal dataset for autonomous driving Holger Caesar Varun Bankiti Alex H. Lang Sourabh Vora Venice Erin Liong Qiang Xu Anush Krishnan Yuxin Pan G. Baldan Oscar Beijbom 3DPC 273 5,727 0 26 Mar 2019
Occupancy Networks: Learning 3D Reconstruction in Function Space L. Mescheder Michael Oechsle Michael Niemeyer Sebastian Nowozin Andreas Geiger 3DV 236 2,894 0 10 Dec 2018
Learning Shape Priors for Single-View 3D Completion and Reconstruction Jiajun Wu Chengkai Zhang Xiuming Zhang Zhoutong Zhang William T. Freeman J. Tenenbaum 3DV 80 184 0 13 Sep 2018
Learning Monocular Depth by Distilling Cross-domain Stereo Networks Xiaoyang Guo Hongsheng Li Shuai Yi Jimmy S. J. Ren Xiaogang Wang MDE 65 207 0 20 Aug 2018
Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Network Xinjing Cheng Peng Wang Ruigang Yang MDE 91 322 0 01 Aug 2018
Evaluation of CNN-based Single-Image Depth Estimation Methods Tobias Koch Lukas Liebel Friedrich Fraundorfer Marco Körner 3DV 128 149 0 03 May 2018
Taskonomy: Disentangling Task Transfer Learning Amir Zamir Alexander Sax Bokui (William) Shen Leonidas Guibas Jitendra Malik Silvio Savarese 118 1,217 0 23 Apr 2018
Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images Nanyang Wang Yinda Zhang Zhuwen Li Yanwei Fu Wen Liu Yu-Gang Jiang 3DV 111 1,327 0 05 Apr 2018
GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose Zhichao Yin Jianping Shi MDE 43 1,142 0 06 Mar 2018
Dense 3D Object Reconstruction from a Single Depth View Bo Yang Stefano Rosa Andrew Markham Niki Trigoni Hongkai Wen GAN 3DV 57 119 0 01 Feb 2018
A Perceptual Measure for Deep Single Image Camera Calibration Yannick Hold-Geoffroy Kalyan Sunkavalli Jonathan Eisenmann Matt Fisher Emiliano Gambaretto Sunil Hadap Jean-François Lalonde 3DV 54 106 0 02 Dec 2017
PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume Deqing Sun Xiaodong Yang Ming-Yuan Liu Jan Kautz 3DPC 249 2,443 0 07 Sep 2017
Surface Normals in the Wild Weifeng Chen Donglai Xiang Jia Deng 3DH 70 38 0 10 Apr 2017
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes Angela Dai Angel X. Chang Manolis Savva Maciej Halber Thomas Funkhouser Matthias Nießner 3DPC 3DV 457 4,057 0 14 Feb 2017
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 503 10,318 0 16 Nov 2016
ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Cameras Raul Mur-Artal Juan D. Tardós 328 5,439 0 20 Oct 2016
Deeper Depth Prediction with Fully Convolutional Residual Networks Iro Laina Christian Rupprecht Vasileios Belagiannis Federico Tombari Nassir Navab 3DV MDE 406 1,826 0 01 Jun 2016
Single-Image Depth Perception in the Wild Weifeng Chen Z. Fu Dawei Yang Jia Deng MDE 100 519 0 13 Apr 2016
The Cityscapes Dataset for Semantic Urban Scene Understanding Marius Cordts Mohamed Omran Sebastian Ramos Timo Rehfeld Markus Enzweiler Rodrigo Benenson Uwe Franke Stefan Roth Bernt Schiele 1.1K 11,606 0 06 Apr 2016
Marr Revisited: 2D-3D Alignment via Surface Normal Prediction Aayush Bansal Bryan C. Russell Abhinav Gupta 49 221 0 05 Apr 2016
Designing Deep Networks for Surface Normal Estimation Xinyu Wang David Fouhey Abhinav Gupta 3DV SSL 276 355 0 18 Nov 2014
Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture David Eigen Rob Fergus VLM MDE 205 2,679 0 18 Nov 2014
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network David Eigen Christian Puhrsch Rob Fergus MDE 3DPC 3DV 214 4,054 0 09 Jun 2014