CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation

6 October 2021

Joseph G. Lambourne

Kamal Rahimi Malekshan

CLIP

ArXiv PDF HTML

Papers citing "CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation"

50 / 236 papers shown

Title
MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation Zhiqi Li Yiming Chen Lingzhe Zhao Peidong Liu 32 7 0 24 Nov 2023
Text-Guided Texturing by Synchronized Multi-View Diffusion Yuxin Liu M. Xie Hanyuan Liu Tien-Tsin Wong DiffM 40 51 0 21 Nov 2023
Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Art Kaisei Fukaya Damon Daylamani-Zad Harry Agius 59 2 0 16 Nov 2023
MetaDreamer: Efficient Text-to-3D Creation With Disentangling Geometry and Texture Lincong Feng Muyu Wang Maoyu Wang Kuo Xu Xiaoli Liu 25 3 0 16 Nov 2023
Instant3D: Instant Text-to-3D Generation Ming Li Pan Zhou Jia-Wei Liu Jussi Keppo Min Lin Shuicheng Yan Xiangyu Xu 41 30 0 14 Nov 2023
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion Minghua Liu Ruoxi Shi Linghao Chen Zhuoyang Zhang Chao Xu Xinyue Wei Hansheng Chen Chong Zeng Jiayuan Gu Hao Su 39 189 0 14 Nov 2023
Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model Jiahao Li Hao Tan Kai Zhang Zexiang Xu Fujun Luan Yinghao Xu Yicong Hong Kalyan Sunkavalli Greg Shakhnarovich Sai Bi 59 254 0 10 Nov 2023
Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training Yipeng Gao Zeyu Wang Wei-Shi Zheng Cihang Xie Yuyin Zhou 3DPC 34 8 0 03 Nov 2023
EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation Zhengzhe Liu Jingyu Hu Ka-Hei Hui Xiaojuan Qi Daniel Cohen-Or Chi-Wing Fu 58 9 0 03 Nov 2023
HyperFields: Towards Zero-Shot Generation of NeRFs from Text Sudarshan Babu Richard Liu Avery Zhou Michael Maire Greg Shakhnarovich Rana Hanocka AI4CE 24 11 0 26 Oct 2023
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior Jingxiang Sun Bo Zhang Ruizhi Shao Lizhen Wang Wen Liu Zhenda Xie Yebin Liu 34 132 0 25 Oct 2023
TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models Tianshi Cao Karsten Kreis Sanja Fidler Nicholas Sharp Kangxue Yin 38 74 0 20 Oct 2023
3D-GPT: Procedural 3D Modeling with Large Language Models Chunyi Sun Junlin Han Weijian Deng Xinlong Wang Zishan Qin Stephen Gould 42 39 0 19 Oct 2023
GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models Taoran Yi Jiemin Fang Junjie Wang Guanjun Wu Lingxi Xie Xiaopeng Zhang Wenyu Liu Qi Tian Xinggang Wang 3DGS 46 128 0 12 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 38 103 0 11 Oct 2023
HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation Xin Huang Ruizhi Shao Qi Zhang Hongwen Zhang Yingfa Feng Yebin Liu Qing Wang DiffM 25 68 0 02 Oct 2023
TextField3D: Towards Enhancing Open-Vocabulary 3D Generation with Noisy Text Fields Tianyu Huang Yihan Zeng Bowen Dong Hang Xu Songcen Xu Rynson W. H. Lau Wangmeng Zuo DiffM 41 9 0 29 Sep 2023
Text-to-3D using Gaussian Splatting Manish Sharma Moitreya Chatterjee Yikai Wang Huaping Liu 3DGS 28 227 0 28 Sep 2023
Looking at words and points with attention: a benchmark for text-to-shape coherence Andrea Amaduzzi Giuseppe Lisanti Samuele Salti Luigi Di Stefano 18 2 0 14 Sep 2023
Text-Guided Generation and Editing of Compositional 3D Avatars Hao Zhang Yao Feng Peter Kulits Yandong Wen Justus Thies Michael J. Black 33 32 0 13 Sep 2023
ImageBind-LLM: Multi-modality Instruction Tuning Jiaming Han Renrui Zhang Wenqi Shao Peng Gao Peng Xu ... Yafei Wen Xiaoxin Chen Xiangyu Yue Hongsheng Li Yu Qiao MLLM 49 117 0 07 Sep 2023
Representation Learning for Sequential Volumetric Design Tasks Md Ferdous Alam Yi Wang Linh Tran Chin-Yi Cheng Jieliang Luo 3DV 27 2 0 05 Sep 2023
Towards Foundational AI Models for Additive Manufacturing: Language Models for G-Code Debugging, Manipulation, and Comprehension Anushrut Jignasu Kelly O. Marshall Baskar Ganapathysubramanian Aditya Balu Chinmay Hegde A. Krishnamurthy ELM AI4CE 27 6 0 04 Sep 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Peng Gao Xianzhi Li Hongsheng Li Pheng-Ann Heng MLLM 35 126 0 01 Sep 2023
Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Details I. Hwang Hyeonwoo Kim Y. Kim DiffM 29 16 0 31 Aug 2023
Towards High-Fidelity Text-Guided 3D Face Generation and Manipulation Using only Images Cuican Yu Guansong Lu Yihan Zeng Jian Sun Xiaodan Liang Huibin Li Zongben Xu Songcen Xu Wei Zhang Hang Xu 47 14 0 31 Aug 2023
Utilizing Task-Generic Motion Prior to Recover Full-Body Motion from Very Sparse Signals Myungjin Shin Dohae Lee In-Kwon Lee 3DH 27 4 0 30 Aug 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani Jun Liu 78 31 0 27 Aug 2023
Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields H. Song Seokhun Choi Hoseok Do Chul Lee Taehyeong Kim DiffM 33 24 0 23 Aug 2023
TADA! Text to Animatable Digital Avatars Tingting Liao Hongwei Yi Yuliang Xiu Jiaxaing Tang Yangyi Huang Justus Thies Michael J. Black 76 94 0 21 Aug 2023
Guide3D: Create 3D Avatars from Text and Image Guidance Yukang Cao Yan-Pei Cao Kai Han Ying Shan Kwan-Yee K. Wong DiffM 41 10 0 18 Aug 2023
Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Events Hoonhee Cho Hyeonseong Kim Yujeong Chae Kuk-Jin Yoon VLM 31 24 0 18 Aug 2023
AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Pose Huichao Zhang Bo Chen Hao Yang Liao Qu Xu Wang Li Chen Chao Long Feida Zhu Kang Du Min Zheng DiffM 22 50 0 07 Aug 2023
Sketch and Text Guided Diffusion Model for Colored Point Cloud Generation Zijie Wu Yaonan Wang Mingtao Feng He-ping Xie Ajmal Mian DiffM 19 32 0 05 Aug 2023
VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation Zekun Qi Muzhou Yu Runpei Dong Kaisheng Ma 3DPC 26 11 0 28 Jul 2023
Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures Kun Yuan V. Srivastav Tong Yu Joël L. Lavanchy Pietro Mascagni Pietro Mascagni N. Padoy Nicolas Padoy 37 20 0 27 Jul 2023
Points-to-3D: Bridging the Gap between Sparse Points and Shape-Controllable Text-to-3D Generation Chaohui Yu Qiang-feng Zhou Jingliang Li Zhe Zhang Zhibin Wang Fan Wang DiffM 30 38 0 26 Jul 2023
FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields Sung Ju Hwang J. Hyung Daejin Kim Minjeong Kim Jaegul Choo 3DH CLIP CVBM 70 11 0 21 Jul 2023
Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generation Aditya Sanghi P. Jayaraman Arianna Rampini Joseph Lambourne Hooman Shayani Evan Atherton Saeid Asgari Taghanaki 3DV 34 15 0 08 Jul 2023
Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representation Zibo Zhao Wen Liu Xin Chen Xi Zeng Rui Wang Pei Cheng Bin-Bin Fu Tao Chen Gang Yu Shenghua Gao DiffM 33 88 0 29 Jun 2023
One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization Minghua Liu Chao Xu Haian Jin Ling-Hao Chen T. MukundVarma Zexiang Xu Hao Su 43 441 0 29 Jun 2023
Local 3D Editing via 3D Distillation of CLIP Knowledge J. Hyung Sung Ju Hwang Daejin Kim Hyunji Lee Jaegul Choo 36 23 0 21 Jun 2023
Pushing the Limits of 3D Shape Generation at Scale Wang Yu Xuelin Qian Jingyang Huo Tiejun Huang Bo Zhao Yanwei Fu 39 11 0 20 Jun 2023
3D VR Sketch Guided 3D Shape Prototyping and Exploration Ling Luo Pinaki Nath Chowdhury Tao Xiang Yi-Zhe Song Yulia Gryaditskaya 45 13 0 19 Jun 2023
UniG3D: A Unified 3D Object Generation Dataset Qinghong Sun Yangguang Li Zexia Liu Xiaoshui Huang Fenggang Liu Xihui Liu Wanli Ouyang Jing Shao 31 6 0 19 Jun 2023
Vision-Language Models can Identify Distracted Driver Behavior from Naturalistic Videos Md Zahid Hasan Jiajing Chen Jiyang Wang Mohammed Shaiqur Rahman Ameya Joshi Senem Velipasalar C. Hegde Anuj Sharma S. Sarkar VLM 52 18 0 16 Jun 2023
DreamHuman: Animatable 3D Avatars from Text Nikos Kolotouros Thiemo Alldieck Andrei Zanfir Eduard Gabriel Bazavan Mihai Fieraru C. Sminchisescu 47 91 0 15 Jun 2023
CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Exploration Jingyu Hu Ka-Hei Hui Zhengzhe Liu Haotong Zhang Chi-Wing Fu 20 2 0 14 Jun 2023
ZeroForge: Feedforward Text-to-Shape Without 3D Supervision Kelly O. Marshall Minh Pham Ameya Joshi Anushrut Jignasu Aditya Balu Adarsh Krishnamurthy A. Hegde CLIP 26 3 0 14 Jun 2023
Scalable 3D Captioning with Pretrained Models Tiange Luo C. Rockwell Honglak Lee Justin Johnson 29 153 0 12 Jun 2023