v1v2 (latest)

Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models

21 March 2023

Matthias Nießner

Papers citing "Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models"

50 / 103 papers shown

Title
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 170 2,433 0 29 Sep 2022
Make-A-Video: Text-to-Video Generation without Text-Video Data Uriel Singer Adam Polyak Thomas Hayes Xiaoyue Yin Jie An ... Oron Ashual Oran Gafni Devi Parikh Sonal Gupta Yaniv Taigman DiffM VGen 83 1,428 0 29 Sep 2022
360FusionNeRF: Panoramic Neural Radiance Fields with Joint Guidance Shreyas Kulkarni Peng Yin Sebastian Scherer MDE 54 25 0 28 Sep 2022
$360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360$^\circ$ Radiance Fields$ 360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360 $^\circ$ Radiance Fields Huajian Huang Yingshu Chen Tianjian Zhang Sai-Kit Yeung 56 15 0 04 Aug 2022
GAUDI: A Neural Architect for Immersive 3D Scene Generation Miguel Angel Bautista Pengsheng Guo Samira Abnar Walter A. Talbott Alexander Toshev ... Shuangfei Zhai Hanlin Goh Daniel Ulbricht Afshin Dehghan J. Susskind SyDa 3DGS 59 138 0 27 Jul 2022
Classifier-Free Diffusion Guidance Jonathan Ho Tim Salimans FaML 196 3,963 0 26 Jul 2022
InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Images Zhengqi Li Qianqian Wang Noah Snavely Angjoo Kanazawa VGen 93 63 0 22 Jul 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 461 6,067 0 23 May 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 413 6,908 0 13 Apr 2022
Video Diffusion Models Jonathan Ho Tim Salimans Alexey A. Gritsenko William Chan Mohammad Norouzi David J. Fleet DiffM VGen 209 1,638 0 07 Apr 2022
CLIP-Mesh: Generating textured meshes from text using pretrained image-text models N. Khalid Tianhao Xie Eugene Belilovsky Tiberiu Popa CLIP 79 297 0 24 Mar 2022
Enhancement of Novel View Synthesis Using Omnidirectional Image Completion T. Hara Tatsuya Harada 49 11 0 18 Mar 2022
Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Image Xuanchi Ren Xiaolong Wang VGen 93 58 0 17 Mar 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 474 15,734 0 20 Dec 2021
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 364 3,627 0 20 Dec 2021
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields Can Wang Menglei Chai Mingming He Dongdong Chen Jing Liao CLIP 109 386 0 09 Dec 2021
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 267 361 0 06 Dec 2021
Zero-Shot Text-Guided Object Generation with Dream Fields Ajay Jain B. Mildenhall Jonathan T. Barron Pieter Abbeel Ben Poole 78 568 0 02 Dec 2021
360MonoDepth: High-Resolution 360° Monocular Depth Estimation M. Rey-Area Mingze Yuan Christian Richardt MDE 93 74 0 30 Nov 2021
Vector Quantized Diffusion Model for Text-to-Image Synthesis Shuyang Gu Dong Chen Jianmin Bao Fang Wen Bo Zhang Dongdong Chen Lu Yuan B. Guo DiffM 148 798 0 29 Nov 2021
Blended Diffusion for Text-driven Editing of Natural Images Omri Avrahami Dani Lischinski Ohad Fried DiffM 123 953 0 29 Nov 2021
RedCaps: web-curated image-text data created by the people, for the people Karan Desai Gaurav Kaul Zubin Aysola Justin Johnson 122 169 0 22 Nov 2021
LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs Christoph Schuhmann Richard Vencu Romain Beaumont R. Kaczmarczyk Clayton Mullis Aarush Katta Theo Coombes J. Jitsev Aran Komatsuzaki VLM MLLM CLIP 243 1,441 0 03 Nov 2021
CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation Aditya Sanghi Hang Chu Joseph G. Lambourne Ye Wang Chin-Yi Cheng Marco Fumero Kamal Rahimi Malekshan CLIP 110 294 0 06 Oct 2021
PixelSynth: Generating a 3D-Consistent Experience from a Single Image C. Rockwell David Fouhey Justin Johnson VGen 132 85 0 12 Aug 2021
Moving in a 360 World: Synthesizing Panoramic Parallaxes from a Single Panorama C. Hsu Cheng Sun Hwann-Tzong Chen 47 24 0 21 Jun 2021
Score-based Generative Modeling in Latent Space Arash Vahdat Karsten Kreis Jan Kautz DiffM 69 686 0 10 Jun 2021
On Fast Sampling of Diffusion Probabilistic Models Zhifeng Kong Ming-Yu Liu DiffM 80 199 0 31 May 2021
Diffusion Models Beat GANs on Image Synthesis Prafulla Dhariwal Alex Nichol 260 7,933 0 11 May 2021
StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery Or Patashnik Zongze Wu Eli Shechtman Daniel Cohen-Or Dani Lischinski CLIP VLM 129 1,209 0 31 Mar 2021
Layout-Guided Novel View Synthesis from a Single Indoor Panorama Jiale Xu Jia Zheng Yanyu Xu Rui Tang Shenghua Gao 3DV 38 26 0 31 Mar 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 967 29,810 0 26 Feb 2021
Improved Denoising Diffusion Probabilistic Models Alex Nichol Prafulla Dhariwal DiffM 352 3,715 0 18 Feb 2021
Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image Andrew Liu Richard Tucker Varun Jampani A. Makadia Noah Snavely Angjoo Kanazawa VGen 127 171 0 17 Dec 2020
Taming Transformers for High-Resolution Image Synthesis Patrick Esser Robin Rombach Bjorn Ommer ViT 131 2,999 0 17 Dec 2020
Score-Based Generative Modeling through Stochastic Differential Equations Yang Song Jascha Narain Sohl-Dickstein Diederik P. Kingma Abhishek Kumar Stefano Ermon Ben Poole DiffM SyDa 353 6,566 0 26 Nov 2020
Denoising Diffusion Implicit Models Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 289 7,469 0 06 Oct 2020
DiffWave: A Versatile Diffusion Model for Audio Synthesis Zhifeng Kong Ming-Yu Liu Jiaji Huang Kexin Zhao Bryan Catanzaro DiffM BDL 158 1,468 0 21 Sep 2020
Accelerating 3D Deep Learning with PyTorch3D Nikhila Ravi Jeremy Reizenstein David Novotny Taylor Gordon Wan-Yen Lo Justin Johnson Georgia Gkioxari 3DPC 120 925 0 16 Jul 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 674 18,310 0 19 Jun 2020
Improved Techniques for Training Score-Based Generative Models Yang Song Stefano Ermon DiffM 258 1,163 0 16 Jun 2020
3D Photography using Context-aware Layered Depth Inpainting Meng-Li Shih Shih-Yang Su Johannes Kopf Jia-Bin Huang 3DPC 3DV 62 302 0 09 Apr 2020
SynSin: End-to-end View Synthesis from a Single Image Olivia Wiles Georgia Gkioxari Richard Szeliski Justin Johnson 3DV 90 472 0 18 Dec 2019
Generative Modeling by Estimating Gradients of the Data Distribution Yang Song Stefano Ermon SyDa DiffM 258 3,954 0 12 Jul 2019
Generating Diverse High-Fidelity Images with VQ-VAE-2 Ali Razavi Aaron van den Oord Oriol Vinyals DRL BDL 147 1,827 0 02 Jun 2019
Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings Kevin Chen Chris Choy Manolis Savva Angel X. Chang Thomas Funkhouser Silvio Savarese 3DV 65 250 0 22 Mar 2018
Progressive Growing of GANs for Improved Quality, Stability, and Variation Tero Karras Timo Aila S. Laine J. Lehtinen GAN 164 7,376 0 27 Oct 2017
Submodular Trajectory Optimization for Aerial 3D Scanning Mike Roberts Debadeepta Dey A. Truong Sudipta N. Sinha S. Shah Ashish Kapoor Pat Hanrahan Neel Joshi 56 127 0 01 May 2017
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes Angela Dai Angel X. Chang Manolis Savva Maciej Halber Thomas Funkhouser Matthias Nießner 3DPC 3DV 489 4,081 0 14 Feb 2017
Improved Techniques for Training GANs Tim Salimans Ian Goodfellow Wojciech Zaremba Vicki Cheung Alec Radford Xi Chen GAN 486 9,067 0 10 Jun 2016