RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation

17 November 2022

Niloy J. Mitra

Papers citing "RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation"

50 / 134 papers shown

Title
MeshLRM: Large Reconstruction Model for High-Quality Meshes Xinyue Wei Kai Zhang Sai Bi Hao Tan Fujun Luan Valentin Deschaintre Kalyan Sunkavalli Hao Su Zexiang Xu AI4CE 110 73 0 18 Apr 2024
IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illumination Xi Chen Sida Peng Dongchen Yang Yuan Liu Bowen Pan Chengfei Lv Xiaowei Zhou DiffM 44 18 0 17 Apr 2024
RoofDiffusion: Constructing Roofs from Severely Corrupted Point Data via Diffusion Kyle Shih-Huang Lo Jorg Peters Eric Spellman 41 1 0 14 Apr 2024
Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation Yujin Chen Yinyu Nie Benjamin Ummenhofer R. Birkl Michael Paulitsch Matthias Müller Matthias Nießner AI4CE 29 3 0 28 Mar 2024
latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction Christopher Wewer Kevin Raj Eddy Ilg Bernt Schiele J. E. Lenssen 3DGS 64 59 0 24 Mar 2024
LN3Diff: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation Yushi Lan Fangzhou Hong Shuai Yang Shangchen Zhou Xuyi Meng Bo Dai Xingang Pan Chen Change Loy 42 39 0 18 Mar 2024
EMIE-MAP: Large-Scale Road Surface Reconstruction Based on Explicit Mesh and Implicit Encoding Wenhua Wu Qi Wang Guangming Wang Junping Wang Tiankun Zhao Yang Liu Dongchao Gao Zhe Liu Hesheng Wang AI4CE 3DV 46 8 0 18 Mar 2024
Isotropic3D: Image-to-3D Generation Based on a Single CLIP Embedding Pengkun Liu Yikai Wang Gang Hua Jiafang Li Hang Xiao Hongxiang Xue Xinzhou Wang 51 8 0 15 Mar 2024
Towards Faster Training of Diffusion Models: An Inspiration of A Consistency Phenomenon Tianshuo Xu Peng Mi Ruilin Wang Yingcong Chen DiffM 49 6 0 14 Mar 2024
Envision3D: One Image to 3D with Anchor Views Interpolation Yatian Pang Tanghui Jia Yujun Shi Zhenyu Tang Junwu Zhang Xinhua Cheng Xing Zhou Francis E. H. Tay Li-xin Yuan 55 8 0 13 Mar 2024
SemCity: Semantic Scene Generation with Triplane Diffusion Jumin Lee Sebin Lee Changho Jo Woobin Im Juhyeong Seon Sung-eui Yoon DiffM 40 17 0 12 Mar 2024
Bayesian Diffusion Models for 3D Shape Reconstruction Haiyang Xu Yu Lei Zeyuan Chen Xiang Zhang Yue Zhao Yilin Wang Zhuowen Tu DiffM 40 8 0 11 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 49 39 0 04 Mar 2024
G3DR: Generative 3D Reconstruction in ImageNet Pradyumna Reddy Ismail Elezi Jiankang Deng 38 5 0 01 Mar 2024
HyperSDFusion: Bridging Hierarchical Structures in Language and Geometry for Enhanced 3D Text2Shape Generation Zhiying Leng Tolga Birdal Xiaohui Liang Federico Tombari 39 3 0 01 Mar 2024
ViewFusion: Towards Multi-View Consistency via Interpolated Denoising Xianghui Yang Yan Zuo Sameera Ramasinghe Loris Bazzani Gil Avraham Anton Van Den Hengel DiffM 35 6 0 29 Feb 2024
PolyOculus: Simultaneous Multi-view Image-based Novel View Synthesis Jason J. Yu Tristan Aumentado-Armstrong Fereshteh Forghani Konstantinos G. Derpanis Marcus A. Brubaker 41 5 0 28 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 47 11 0 05 Feb 2024
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Chin-Hsuan Wu Yen-Chun Chen Bolivar Solarte Lu Yuan Min Sun 24 9 0 28 Dec 2023
Neural Point Cloud Diffusion for Disentangled 3D Shape and Appearance Generation Philipp Schroppel Christopher Wewer J. E. Lenssen Eddy Ilg Thomas Brox 35 9 0 21 Dec 2023
SyncDreamer for 3D Reconstruction of Endangered Animal Species with NeRF and NeuS A. H. Ornek Deniz Sen Esmanur Civil 28 2 0 21 Dec 2023
Splatter Image: Ultra-Fast Single-View 3D Reconstruction Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 3DGS 48 176 0 20 Dec 2023
ID-Blau: Image Deblurring by Implicit Diffusion-based reBLurring AUgmentation Jia-Hao Wu Fu-Jen Tsai Yan-Tsung Peng Chung-Chi Tsai Chia-Wen Lin Yen-Yu Lin DiffM 30 6 0 18 Dec 2023
Exploring the Feasibility of Generating Realistic 3D Models of Endangered Species Using DreamGaussian: An Analysis of Elevation Angle's Impact on Model Generation Selcuk Anil Karatopak Deniz Sen 50 0 0 15 Dec 2023
GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learning Animesh Karnewar Roman Shapovalov Tom Monnier Andrea Vedaldi Niloy J. Mitra David Novotny 47 0 0 14 Dec 2023
NViST: In the Wild New View Synthesis from a Single Image with Transformers Wonbong Jang Lourdes Agapito ViT 32 10 0 13 Dec 2023
NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Image Yoonwoo Jeong Jinwoo Lee Chiheon Kim Minsu Cho Doyup Lee 21 3 0 12 Dec 2023
CAD: Photorealistic 3D Generation via Adversarial Distillation Bo Liu Despoina Paschalidou Ian Huang Hongyu Liu Bokui Shen Xiaoyu Xiang Jing Liao Leonidas J. Guibas DiffM 78 11 0 11 Dec 2023
EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion Zehuan Huang Hao Wen Junting Dong Yaohui Wang Yangguang Li ... Yan-Pei Cao Ding Liang Yu Qiao Bo Dai Lu Sheng 30 33 0 11 Dec 2023
RL Dreams: Policy Gradient Optimization for Score Distillation based 3D Generation Aradhya Neeraj Mathur Phu-Cuong Pham Aniket Bera Ojaswa Sharma 31 0 0 08 Dec 2023
PrimDiffusion: Volumetric Primitives Diffusion for 3D Human Generation Zhaoxi Chen Fangzhou Hong Haiyi Mei Guangcong Wang Lei Yang Ziwei Liu 40 24 0 07 Dec 2023
Free3D: Consistent Novel View Synthesis without 3D Representation Chuanxia Zheng Andrea Vedaldi 3DV 42 48 0 07 Dec 2023
Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion Kira Prabhu Jane Wu Lynn Tsai Peter Hedman Dan B. Goldman Ben Poole Michael Broxton DiffM 31 7 0 06 Dec 2023
AVID: Any-Length Video Inpainting with Diffusion Model Zhixing Zhang Bichen Wu Xiaoyan Wang Yaqiao Luo Luxin Zhang Yinan Zhao Peter Vajda Dimitris N. Metaxas Licheng Yu VGen DiffM 42 33 0 06 Dec 2023
Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing Yushi Lan Feitong Tan Di Qiu Qiangeng Xu Kyle Genova ... S. Fanello Rohit Pandey Thomas Funkhouser Chen Change Loy Yinda Zhang 3DGS 28 16 0 05 Dec 2023
RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D Lingteng Qiu Guanying Chen Xiaodong Gu Qi Zuo Mutian Xu Yushuang Wu Weihao Yuan Zilong Dong Liefeng Bo Xiaoguang Han 38 113 0 28 Nov 2023
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets A. Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian ... Zion English Vikram S. Voleti Adam Letts Varun Jampani Robin Rombach VGen 167 1,016 0 25 Nov 2023
ToddlerDiffusion: Flash Interpretable Controllable Diffusion Model Eslam Mohamed Bakr Liangbing Zhao Vincent Tao Hu Matthieu Cord Patrick Pérez Mohamed Elhoseiny 27 0 0 24 Nov 2023
WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space Katja Schwarz Seung Wook Kim Jun Gao Sanja Fidler Andreas Geiger Karsten Kreis 37 6 0 22 Nov 2023
DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model Yinghao Xu Hao Tan Fujun Luan Sai Bi Peng Wang ... Zifan Shi Kalyan Sunkavalli Gordon Wetzstein Zexiang Xu Kai Zhang 43 153 0 15 Nov 2023
LRM: Large Reconstruction Model for Single Image to 3D Yicong Hong Kai Zhang Jiuxiang Gu Sai Bi Yang Zhou Difan Liu Feng Liu Kalyan Sunkavalli Trung Bui Hao Tan 3DV 3DH 42 412 0 08 Nov 2023
Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long Yuanchen Guo Cheng Lin Yuan Liu Zhiyang Dou ... Yuexin Ma Song-Hai Zhang Marc Habermann Christian Theobalt Wenping Wang 40 405 0 23 Oct 2023
MOHO: Learning Single-view Hand-held Object Reconstruction with Multi-view Occlusion-Aware Supervision Chenyangguang Zhang Guanlong Jiao Yan Di Gu Wang Ziqin Huang Ruida Zhang Fabian Manhardt Bowen Fu F. Tombari Xiangyang Ji 22 6 0 18 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 33 102 0 11 Oct 2023
AI-Generated Images as Data Source: The Dawn of Synthetic Era Zuhao Yang Fangneng Zhan Kunhao Liu Muyu Xu Shijian Lu EGVM 31 18 0 03 Oct 2023
Multi-task Learning with 3D-Aware Regularization Weihong Li Steven G. McDonagh A. Leonardis Hakan Bilen 26 3 0 02 Oct 2023
Light Field Diffusion for Single-View Novel View Synthesis Yifeng Xiong Haoyu Ma Shanlin Sun Kun Han Hao Tang Xiaohui Xie DiffM 46 2 0 20 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 38 6 0 14 Sep 2023
SimNP: Learning Self-Similarity Priors Between Neural Points Christopher Wewer Eddy Ilg Bernt Schiele J. E. Lenssen 3DPC 30 10 0 07 Sep 2023
Text2Control3D: Controllable 3D Avatar Generation in Neural Radiance Fields using Geometry-Guided Text-to-Image Diffusion Model Sungwon Hwang J. Hyung Jaegul Choo DiffM 35 4 0 07 Sep 2023