Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model

20 December 2023

Charles Herrmann

David J. Fleet

Papers citing "Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model"

33 / 33 papers shown

Title
VistaDepth: Frequency Modulation With Bias Reweighting For Enhanced Long-Range Depth Estimation Mingxia Zhan Li Zhang Xiaomeng Chu Beibei Wang MDE 136 0 0 21 Apr 2025
Survey on Monocular Metric Depth Estimation Jiuling Zhang VLM 201 0 0 21 Jan 2025
High-Resolution Frame Interpolation with Patch-based Cascaded Diffusion Junhwa Hur Charles Herrmann Saurabh Saxena Janne Kontkanen Wei-Sheng Lai Yichang Shih Michael Rubinstein David J. Fleet Deqing Sun 88 0 0 15 Oct 2024
A Simple Approach to Unifying Diffusion-based Conditional Generation Xirui Li Charles Herrmann Kelvin C.K. Chan Yinxiao Li Deqing Sun Chao Ma Ming-Hsuan Yang DiffM VLM 67 1 0 15 Oct 2024
Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free Ziyue Li Dinesh Manocha MoE 92 17 0 14 Oct 2024
Controlling Space and Time with Diffusion Models Daniel Watson Saurabh Saxena Lala Li Andrea Tagliasacchi David J. Fleet VGen 120 30 0 10 Jul 2024
The 3D-PC: a benchmark for visual perspective taking in humans and machines Drew Linsley Peisen Zhou A. Ashok Akash Nagaraj Gaurav Gaonkar Francis E Lewis Zygmunt Pizlo Thomas Serre 108 6 0 06 Jun 2024
Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single View Andreea Dogaru M. Ozer Bernhard Egger 3DGS 87 6 0 04 Apr 2024
FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scene Chen-Hao Wei Meng Yang Lei He Nanning Zheng MDE 53 3 0 27 Jul 2023
The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation Saurabh Saxena Charles Herrmann Junhwa Hur Abhishek Kar Mohammad Norouzi Deqing Sun David J. Fleet DiffM 79 81 0 02 Jun 2023
Perspective Fields for Single Image Camera Calibration Linyi Jin Jianming Zhang Yannick Hold-Geoffroy Oliver Wang Kevin Blackburn-Matzen Matthew Sticha David Fouhey 48 50 0 06 Dec 2022
A Generalist Framework for Panoptic Segmentation of Images and Videos Ting-Li Chen Lala Li Saurabh Saxena Geoffrey E. Hinton David J. Fleet VGen MLLM 57 102 0 12 Oct 2022
BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimation Zhenyu Li Xuyang Wang Xianming Liu Junjun Jiang MDE 64 194 0 03 Apr 2022
LocalBins: Improving Depth Estimation by Learning Local Distributions S. Bhat Ibraheem Alhashim Peter Wonka MDE 48 100 0 28 Mar 2022
NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimation Weihao Yuan Xiaodong Gu Zuozhuo Dai Siyu Zhu Ping Tan 59 179 0 03 Mar 2022
Palette: Image-to-Image Diffusion Models Chitwan Saharia William Chan Huiwen Chang Chris A. Lee Jonathan Ho Tim Salimans David J. Fleet Mohammad Norouzi DiffM VLM 471 1,630 0 10 Nov 2021
DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenes Jaehoon Cho Dongbo Min Youngjung Kim Kwanghoon Sohn 3DV 92 43 0 22 Oct 2021
Cascaded Diffusion Models for High Fidelity Image Generation Jonathan Ho Chitwan Saharia William Chan David J. Fleet Mohammad Norouzi Tim Salimans 145 1,218 0 30 May 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 193 7,818 0 11 May 2021
Vision Transformers for Dense Prediction René Ranftl Alexey Bochkovskiy V. Koltun ViT MDE 128 1,729 0 24 Mar 2021
Improved Denoising Diffusion Probabilistic Models Alex Nichol Prafulla Dhariwal DiffM 314 3,675 0 18 Feb 2021
Scalability in Perception for Autonomous Driving: Waymo Open Dataset Pei Sun Henrik Kretzschmar Xerxes Dotiwalla Aurelien Chouard Vijaysai Patnaik ... Shuyang Cheng Yu Zhang Jonathon Shlens Zhifeng Chen Dragomir Anguelov 113 2,877 0 10 Dec 2019
DIODE: A Dense Indoor and Outdoor DEpth Dataset Igor Vasiljevic Nicholas I. Kolkin Shanyi Zhang Ruotian Luo Haochen Wang ... Andrea F. Daniele Mohammadreza Mostajabi Steven Basart Matthew R. Walter Gregory Shakhnarovich MDE 3DV 69 232 0 01 Aug 2019
Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer René Ranftl Katrin Lasinger David Hafner Konrad Schindler V. Koltun MDE 197 1,789 0 02 Jul 2019
3D Packing for Self-Supervised Monocular Depth Estimation Vitor Campagnolo Guizilini Rares Andrei Ambrus Sudeep Pillai Allan Raventos Adrien Gaidon SSL 3DPC MDE 79 646 0 06 May 2019
CAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depth José M. Fácil Benjamin Ummenhofer Huizhong Zhou Luis Montesano Thomas Brox Javier Civera MDE 128 139 0 03 Apr 2019
nuScenes: A multimodal dataset for autonomous driving Holger Caesar Varun Bankiti Alex H. Lang Sourabh Vora Venice Erin Liong Qiang Xu Anush Krishnan Yuxin Pan G. Baldan Oscar Beijbom 3DPC 275 5,727 0 26 Mar 2019
Taskonomy: Disentangling Task Transfer Learning Amir Zamir Alexander Sax Bokui (William) Shen Leonidas Guibas Jitendra Malik Silvio Savarese 118 1,217 0 23 Apr 2018
Learning Depth from Single Images with Deep Neural Network Embedding Focal Length Lei He Guanghui Wang Zhanyi Hu MDE 52 173 0 27 Mar 2018
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes Angela Dai Angel X. Chang Manolis Savva Maciej Halber Thomas Funkhouser Matthias Nießner 3DPC 3DV 459 4,057 0 14 Feb 2017
Deep Unsupervised Learning using Nonequilibrium Thermodynamics Jascha Narain Sohl-Dickstein Eric A. Weiss Niru Maheswaranathan Surya Ganguli SyDa DiffM 281 6,925 0 12 Mar 2015
Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture David Eigen Rob Fergus VLM MDE 205 2,679 0 18 Nov 2014
Depth Map Prediction from a Single Image using a Multi-Scale Deep Network David Eigen Christian Puhrsch Rob Fergus MDE 3DPC 3DV 214 4,054 0 09 Jun 2014