CLIP-Sculptor: Zero-Shot Generation of High-Fidelity and Diverse Shapes from Natural Language

2 November 2022

Karl Willis

Amir Hosein Khasahmadi

Srinath Sridhar

Daniel E. Ritchie

ArXiv PDF HTML

Papers citing "CLIP-Sculptor: Zero-Shot Generation of High-Fidelity and Diverse Shapes from Natural Language"

42 / 42 papers shown

Title
Recent Advance in 3D Object and Scene Generation: A Survey Xiang Tang Ruotong Li Xiaopeng Fan 77 0 0 16 Apr 2025
Towards Generating Realistic 3D Semantic Training Data for Autonomous Driving Lucas Nunes Rodrigo Marcuzzi Jens Behley C. Stachniss 3DPC 83 0 0 27 Mar 2025
VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modeling Hyojun Go Byeongjun Park Hyelin Nam Byung-Hoon Kim Hyungjin Chung Changick Kim 3DGS VGen 94 1 0 20 Mar 2025
PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned Prior S. Lee Hwanhee Jung Byoungsoo Koh Qixing Huang Sangho Yoon Sangpil Kim 49 0 0 17 Mar 2025
DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation Chenguo Lin Panwang Pan Bangbang Yang Zeming Li Yadong Mu 3DGS 76 7 0 28 Jan 2025
Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodings Aditya Sanghi Aliasghar Khani Pradyumna Reddy Arianna Rampini Derek Cheung Kamal Rahimi Malekshan Kanika Madan Hooman Shayani 43 3 0 12 Nov 2024
GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation Ruowei Wang Jiaqi Li Dan Zeng Xueqi Ma Zixiang Xu Jianwei Zhang Qijun Zhao 40 1 0 23 Oct 2024
Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Prompts Mohammad Sadil Khan Sankalp Sinha Talha Uddin Sheikh Didier Stricker Sk Aziz Ali Muhammad Zeshan Afzal 36 11 0 25 Sep 2024
TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling Dong Huo Zixin Guo Wei Ji Zhihao Shi Juwei Lu Peng Dai Songcen Xu Li Cheng Yee-Hong Yang DiffM 41 11 0 02 Aug 2024
HOTS3D: Hyper-Spherical Optimal Transport for Semantic Alignment of Text-to-3D Generation Zezeng Li Weimin Wang WenHai Li Na Lei Xianfeng Gu OT DiffM 33 0 0 19 Jul 2024
Exploring the Potentials and Challenges of Deep Generative Models in Product Design Conception Phillip Mueller Lars Mikelsons AI4CE 41 1 0 15 Jul 2024
GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priors Xiqian Yu Hanxin Zhu Tianyu He Zhibo Chen 3DGS DiffM 36 2 0 14 Jun 2024
GenHeld: Generating and Editing Handheld Objects Chaerin Min Srinath Sridhar 41 0 0 07 Jun 2024
Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Models Yabin Zhang Wen-Qing Zhu Hui Tang Zhiyuan Ma Kaiyang Zhou Lei Zhang VLM 31 21 0 26 Mar 2024
Scaling Diffusion Models to Real-World 3D LiDAR Scene Completion Lucas Nunes Rodrigo Marcuzzi Benedikt Mersch Jens Behley C. Stachniss DiffM 33 15 0 20 Mar 2024
Text-to-3D Shape Generation Han-Hung Lee Manolis Savva Angel X. Chang 32 11 0 20 Mar 2024
BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesis Lutao Jiang Lin Wang 3DGS 70 14 0 17 Mar 2024
$A$^{3}$lign-DFER: Pioneering Comprehensive Dynamic Affective Alignment for Dynamic Facial Expression Recognition with CLIP$ A $^{3}$ lign-DFER: Pioneering Comprehensive Dynamic Affective Alignment for Dynamic Facial Expression Recognition with CLIP Zeng Tao Yan Wang Junxiong Lin Haoran Wang Xinji Mai ... Ziheng Zhou Shaoqi Yan Qing Zhao Liyuan Han Wenqiang Zhang 38 13 0 07 Mar 2024
HyperSDFusion: Bridging Hierarchical Structures in Language and Geometry for Enhanced 3D Text2Shape Generation Zhiying Leng Tolga Birdal Xiaohui Liang Federico Tombari 39 3 0 01 Mar 2024
Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases Rio Aguina-Kang Maxim Gumin Do Heon Han Stewart Morris Seung Jean Yoo Aditya Ganeshan R. K. Jones Qiuhong Anna Wei Kailiang Fu Daniel E. Ritchie 3DV 39 24 0 05 Feb 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 48 40 0 31 Jan 2024
BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusion Yonghao Yu Shunan Zhu Huai Qin Haorui Li Jinglu Hu 29 7 0 30 Jan 2024
Make-A-Shape: a Ten-Million-scale 3D Shape Model Ka-Hei Hui Aditya Sanghi Arianna Rampini Kamal Rahimi Malekshan Zhengzhe Liu Hooman Shayani Chi-Wing Fu DiffM 27 17 0 20 Jan 2024
Masked Audio Generation using a Single Non-Autoregressive Transformer Alon Ziv Itai Gat Gaël Le Lan Tal Remez Felix Kreuk Alexandre Défossez Jade Copet Gabriel Synnaeve Yossi Adi 54 36 0 09 Jan 2024
SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds Minghao Chen Junyu Xie Iro Laina Andrea Vedaldi KELM 47 9 0 14 Dec 2023
AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes Rao Fu Zehao Wen Zichen Liu Srinath Sridhar 31 30 0 11 Dec 2023
TPA3D: Triplane Attention for Fast Text-to-3D Generation Hong-En Chen Bin-Shih Wu Sheng-Yu Huang Yu-Chiang Frank Wang 17 2 0 05 Dec 2023
BOgen: Generating Part-Level 3D Designs Based on User Intention Inference through Bayesian Optimization and Variational Autoencoder Seung Won Lee Jiin Choi Kyung-Hoon Hyun 11 2 0 05 Dec 2023
Text-Guided 3D Face Synthesis -- From Generation to Editing Yunjie Wu Yapeng Meng Zhipeng Hu Lincheng Li Haoqian Wu Kun Zhou Weiwei Xu Xin Yu DiffM 50 9 0 01 Dec 2023
Spice-E : Structural Priors in 3D Diffusion using Cross-Entity Attention Etai Sella Gal Fiebelman Noam Atia Hadar Averbuch-Elor DiffM 33 2 0 29 Nov 2023
Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models Zhengming Yu Zhiyang Dou Xiaoxiao Long Cheng Lin Zekun Li ... Taku Komura Marc Habermann Christian Theobalt Xin Li Wenping Wang 39 6 0 28 Nov 2023
Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model Jiahao Li Hao Tan Kai Zhang Zexiang Xu Fujun Luan Yinghao Xu Yicong Hong Kalyan Sunkavalli Greg Shakhnarovich Sai Bi 59 254 0 10 Nov 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 33 102 0 11 Oct 2023
TextField3D: Towards Enhancing Open-Vocabulary 3D Generation with Noisy Text Fields Tianyu Huang Yihan Zeng Bowen Dong Hang Xu Songcen Xu Rynson W. H. Lau Wangmeng Zuo DiffM 23 9 0 29 Sep 2023
VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation Zekun Qi Muzhou Yu Runpei Dong Kaisheng Ma 3DPC 20 11 0 28 Jul 2023
A Survey on Generative Modeling with Limited Data, Few Shots, and Zero Shot Milad Abdollahzadeh Touba Malekzadeh Christopher T. H. Teo Keshigeyan Chandrasegaran Guimeng Liu Ngai-man Cheung VLM MedIm 44 21 0 26 Jul 2023
Zero-shot CAD Program Re-Parameterization for Interactive Manipulation Milin Kodnongbua Benjamin T. Jones Maaz Bin Safeer Ahmad Vladimir G. Kim Adriana Schulz 35 4 0 05 Jun 2023
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era Chenghao Li Chaoning Zhang Atish Waghwase Lik-Hang Lee François Rameau Yang Yang Sung-Ho Bae Choong Seon Hong 51 74 0 10 May 2023
LoopDraw: a Loop-Based Autoregressive Model for Shape Synthesis and Editing Nam Anh Dinh Haochen Wang G. Shakhnarovich Rana Hanocka 11 2 0 09 Dec 2022
ShapeFormer: Transformer-based Shape Completion via Sparse Representation Xingguang Yan Liqiang Lin Niloy J. Mitra Dani Lischinski Daniel Cohen-Or Hui Huang ViT 64 112 0 25 Jan 2022
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 196 351 0 06 Dec 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,781 0 24 Feb 2021