CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation

6 October 2021

Joseph G. Lambourne

Kamal Rahimi Malekshan

CLIP

ArXiv PDF HTML

Papers citing "CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation"

50 / 236 papers shown

Title
Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptions Ian Huang Vrishab Krishna Omoruyi E. Atekha Leonidas J. Guibas DiffM VGen 27 11 0 09 Jun 2023
ATT3D: Amortized Text-to-3D Object Synthesis Jonathan Lorraine Kevin Xie Fangyin Wei Chen-Hsuan Lin Towaki Takikawa Nicholas Sharp Nayeon Lee Xuan Li Sanja Fidler James Lucas DiffM 22 86 0 06 Jun 2023
Zero-shot CAD Program Re-Parameterization for Interactive Manipulation Milin Kodnongbua Benjamin T. Jones Maaz Bin Safeer Ahmad Vladimir G. Kim Adriana Schulz 43 4 0 05 Jun 2023
HeadSculpt: Crafting 3D Head Avatars with Text Xiaoping Han Yukang Cao Kai Han Xiatian Zhu Jiankang Deng Yi-Zhe Song Tao Xiang Kwan-Yee K. Wong DiffM 27 45 0 05 Jun 2023
T2TD: Text-3D Generation Model based on Prior Knowledge Guidance Weizhi Nie Ruidong Chen Weijie Wang Bruno Lepri N. Sebe 35 4 0 25 May 2023
OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding Minghua Liu Ruoxi Shi Kaiming Kuang Yinhao Zhu Xuanlin Li Shizhong Han H. Cai Fatih Porikli Hao Su 3DPC 39 116 0 18 May 2023
CLIP-Count: Towards Text-Guided Zero-Shot Object Counting Ruixia Jiang Lin Liu Changan Chen VLM 38 60 0 12 May 2023
Locally Attentional SDF Diffusion for Controllable 3D Shape Generation Xin-Yang Zheng Hao Pan Peng-Shuai Wang Xin Tong Yang Liu H. Shum 48 126 0 08 May 2023
LLM2Loss: Leveraging Language Models for Explainable Model Diagnostics Shervin Ardeshir 33 0 0 04 May 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 203 311 0 03 May 2023
Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learning Anqi Wang Jiahua Dong Lik-Hang Lee Jiachuan Shen Pan Hui 3DV AI4CE 46 1 0 30 Apr 2023
TextDeformer: Geometry Manipulation using Text Guidance William Gao Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 27 81 0 26 Apr 2023
What's in a Name? Evaluating Assembly-Part Semantic Knowledge in Language Models through User-Provided Names in CAD Files Peter Meltzer Joseph G. Lambourne Daniele Grandi 31 2 0 25 Apr 2023
HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks Zhuo Chen Xudong Xu Yichao Yan Ye Pan Wenhan Zhu Wayne Wu Bo Dai Xiaokang Yang 3DH 32 8 0 19 Apr 2023
Text-guided Image-and-Shape Editing and Generation: A Short Survey Cheng-Kang Ted Chao Y. Gingold 38 3 0 18 Apr 2023
Mesh2Tex: Generating Mesh Textures from Image Queries Alexey Bokhovkin Shubham Tulsiani Angela Dai 78 23 0 12 Apr 2023
Advances in Data-Driven Analysis and Synthesis of 3D Indoor Scenes A. Patil Supriya Gadi Patil Manyi Li Matthew Fisher Manolis Savva Haotong Zhang 3DV 32 17 0 06 Apr 2023
DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models Yukang Cao Yan-Pei Cao Kai Han Ying Shan Kwan-Yee K. Wong DiffM 21 137 0 03 Apr 2023
DreamFace: Progressive Generation of Animatable 3D Faces under Text Guidance Longwen Zhang Qiwei Qiu Hongyang Lin Qixuan Zhang Cheng Shi Wei Yang Ye Shi Sibei Yang Lan Xu Jingyi Yu 3DH 38 74 0 01 Apr 2023
X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidance Yiwei Ma Xiaioqing Zhang Xiaoshuai Sun Jiayi Ji Haowei Wang Guannan Jiang Weilin Zhuang Rongrong Ji 23 39 0 28 Mar 2023
Learning Versatile 3D Shape Generation with Improved AR Models Simian Luo Xuelin Qian Yanwei Fu Yinda Zhang Ying Tai Zhenyu Zhang Chengjie Wang Xiangyang Xue 46 3 0 26 Mar 2023
CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout Haotian Bai Yiqi Lin Hui Xiong Sijia Li H. Lu Xiaodong Lin Lin Wang DiffM 45 42 0 24 Mar 2023
DreamStone: Image as Stepping Stone for Text-Guided 3D Shape Generation Zhengzhe Liu Peng Dai Ruihui Li Xiaojuan Qi Chi-Wing Fu DiffM 21 10 0 24 Mar 2023
Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenes Dana Cohen-Bar Elad Richardson G. Metzer Raja Giryes Daniel Cohen-Or 79 54 0 23 Mar 2023
TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision Jiacheng Wei Hao Wang Jiashi Feng Guosheng Lin Kim-Hui Yap 24 30 0 23 Mar 2023
Vox-E: Text-guided Voxel Editing of 3D Objects Etai Sella Gal Fiebelman Peter Hedman Hadar Averbuch-Elor DiffM 36 74 0 21 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 38 177 0 21 Mar 2023
MXM-CLR: A Unified Framework for Contrastive Learning of Multifold Cross-Modal Representations Ye Wang Bo‐Shu Jiang C. Zou Rui Ma 32 5 0 20 Mar 2023
Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation Junyoung Seo Wooseok Jang Minseop Kwak Ines Hyeonsu Kim Jaehoon Ko Junho Kim Jin-Hwa Kim Jiyoung Lee Seung Wook Kim DiffM 46 135 0 14 Mar 2023
Architext: Language-Driven Generative Architecture Design Theodoros Galanos Antonios Liapis Georgios N. Yannakakis VLM AI4CE 26 6 0 13 Mar 2023
GECCO: Geometrically-Conditioned Point Diffusion Models M. Tyszkiewicz Pascal Fua Eduard Trulls DiffM 26 21 0 10 Mar 2023
3DGen: Triplane Latent Diffusion for Textured Mesh Generation Anchit Gupta Wenhan Xiong Yixin Nie Anchit Gupta Barlas Oğuz DiffM 106 158 0 09 Mar 2023
CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embedding Jingyu Liu Wenhan Xiong Ian Jones Yixin Nie Anchit Gupta Barlas Ouguz 3DV 53 14 0 07 Mar 2023
Text2Face: A Multi-Modal 3D Face Model William Rowan P. Huber Nick E. Pears Andrew Keeling 3DH 29 2 0 05 Mar 2023
Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation Rui Zhao Wei Li Zhipeng Hu Lincheng Li Zhengxia Zou Z. Shi Changjie Fan 41 18 0 02 Mar 2023
Renderable Neural Radiance Map for Visual Navigation Obin Kwon Jeongho Park Songhwai Oh 29 56 0 01 Mar 2023
Text-driven Visual Synthesis with Latent Diffusion Prior Tingbo Liao Songwei Ge Yiran Xu Yao-Chih Lee Badour Albahar Jia-Bin Huang DiffM 32 6 0 16 Feb 2023
Multi-modal Machine Learning in Engineering Design: A Review and Future Directions Binyang Song Ruilin Zhou Faez Ahmed AI4CE 42 40 0 14 Feb 2023
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex Terry Yue Zhuo Zhuang Li Yujin Huang Fatemeh Shiri Weiqing Wang Gholamreza Haffari Yuan-Fang Li AAML 34 54 0 30 Jan 2023
Text-To-4D Dynamic Scene Generation Uriel Singer Shelly Sheynin Adam Polyak Oron Ashual Iurii Makarov ... Naman Goyal Andrea Vedaldi Devi Parikh Justin Johnson Yaniv Taigman DiffM 32 147 0 26 Jan 2023
Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models Jiale Xu Xintao Wang Weihao Cheng Yan-Pei Cao Ying Shan Xiaohu Qie Shenghua Gao 188 161 0 28 Dec 2022
Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Program Tiange Luo Honglak Lee Justin Johnson 39 5 0 25 Dec 2022
Point-E: A System for Generating 3D Point Clouds from Complex Prompts Alex Nichol Heewoo Jun Prafulla Dhariwal Pamela Mishkin Mark Chen DiffM 47 587 0 16 Dec 2022
LidarCLIP or: How I Learned to Talk to Point Clouds Georg Hess Adam Tonderski Christoffer Petersson Kalle AAstrom Lennart Svensson DiffM 27 22 0 13 Dec 2022
Diffusion-SDF: Text-to-Shape via Voxelized Diffusion Muheng Li Yueqi Duan Jie Zhou Jiwen Lu DiffM 42 121 0 06 Dec 2022
PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models Minghua Liu Yinhao Zhu H. Cai Shizhong Han Z. Ling Fatih Porikli Hao Su 3DPC 38 70 0 03 Dec 2022
3D-TOGO: Towards Text-Guided Cross-Category 3D Object Generation Zutao Jiang Guangsong Lu Xiaodan Liang Jihua Zhu Wei Zhang Xiaojun Chang Hang Xu DiffM 21 8 0 02 Dec 2022
3D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models Gimin Nam Mariem Khlifi Andrew Rodriguez Alberto Tono Linqi Zhou Paul Guerrero DiffM 37 68 0 01 Dec 2022
Language-Assisted 3D Feature Learning for Semantic Scene Understanding Junbo Zhang Guo Fan Guanghan Wang Zhèngyuān Sū Kaisheng Ma L. Yi 3DPC 27 7 0 25 Nov 2022
ClipCrop: Conditioned Cropping Driven by Vision-Language Model Zhihang Zhong Mingxi Cheng Zhirong Wu Yuhui Yuan Yinqiang Zheng Ji Li Han Hu Stephen Lin Yoichi Sato Imari Sato VLM CLIP 35 3 0 21 Nov 2022