CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

9 December 2021

Papers citing "CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields"

50 / 307 papers shown

Title
Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priors Yukang Lin Haonan Han Chaoqun Gong Zunnan Xu Yachao Zhang Xiu Li DiffM 26 57 0 29 Sep 2023
Text-to-3D using Gaussian Splatting Manish Sharma Moitreya Chatterjee Yikai Wang Huaping Liu 3DGS 39 229 0 28 Sep 2023
CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Prompting Shaoxiang Guo Qing Cai Lin Qi Junyu Dong 3DH 46 7 0 28 Sep 2023
Directional Texture Editing for 3D Models Shengqi Liu Zhuo Chen Jin Gao Yichao Yan Wenhan Zhu Jia-Ming Lyu Xiaokang Yang DiffM 62 0 0 26 Sep 2023
NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation Rui Yu Jiachen Liu Zihan Zhou Sharon X. Huang 22 1 0 23 Sep 2023
Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates Kashun Shum Jaeyeon Kim Binh-Son Hua Duc Thanh Nguyen Sai-Kit Yeung 3DH AI4CE 26 7 0 20 Sep 2023
DePT: Decoupled Prompt Tuning Ji Zhang Shihan Wu Lianli Gao Hengtao Shen Jingkuan Song VLM 37 27 0 14 Sep 2023
Text-Guided Generation and Editing of Compositional 3D Avatars Hao Zhang Yao Feng Peter Kulits Yandong Wen Justus Thies Michael J. Black 33 32 0 13 Sep 2023
SAMPLING: Scene-adaptive Hierarchical Multiplane Images Representation for Novel View Synthesis from a Single Image Xiaoyu Zhou Zhiwei Lin X. Shan Yongtao Wang Deqing Sun Ming-Hsuan Yang AI4TS 53 4 0 12 Sep 2023
Editing 3D Scenes via Text Prompts without Retraining Shuangkang Fang Yufeng Wang Yezhou Yang Yi-Hsuan Tsai Wenrui Ding Shuchang Zhou Ming-Hsuan Yang DiffM 33 2 0 10 Sep 2023
Language-Conditioned Path Planning Amber Xie Youngwoon Lee Pieter Abbeel Stephen James LM&Ro 38 14 0 31 Aug 2023
Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Details I. Hwang Hyeonwoo Kim Y. Kim DiffM 37 16 0 31 Aug 2023
Utilizing Task-Generic Motion Prior to Recover Full-Body Motion from Very Sparse Signals Myungjin Shin Dohae Lee In-Kwon Lee 3DH 32 4 0 30 Aug 2023
Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views Zi-Xin Zou Weihao Cheng Yan-Pei Cao Shi-Sheng Huang Ying Shan Songiie Zhang DiffM 41 23 0 27 Aug 2023
Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields H. Song Seokhun Choi Hoseok Do Chul Lee Taehyeong Kim DiffM 33 24 0 23 Aug 2023
Semantic-Aware Implicit Template Learning via Part Deformation Consistency S. Kim Minseok Joo Jae-Won Lee Juyeon Ko Juhan Cha Hyunwoo J. Kim 43 2 0 23 Aug 2023
TADA! Text to Animatable Digital Avatars Tingting Liao Hongwei Yi Yuliang Xiu Jiaxaing Tang Yangyi Huang Justus Thies Michael J. Black 76 95 0 21 Aug 2023
An Empirical Study of CLIP for Text-based Person Search Min Cao Yang Bai Ziyin Zeng Mang Ye Min Zhang VLM 49 36 0 19 Aug 2023
Watch Your Steps: Local Image and Scene Editing by Text Instructions Ashkan Mirzaei Tristan Aumentado-Armstrong Marcus A. Brubaker J. Kelly Alex Levinshtein Konstantinos G. Derpanis Igor Gilitschenski DiffM 31 34 0 17 Aug 2023
Fine-grained Text and Image Guided Point Cloud Completion with CLIP Model Wei Song Jun Zhou Mingjie Wang Hongchen Tan Nannan Li Xiuping Liu 34 2 0 17 Aug 2023
Semantify: Simplifying the Control of 3D Morphable Models using CLIP Omer Gralnik G. Gafni Ariel Shamir 3DV 32 4 0 14 Aug 2023
Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases Eugen Šlapak Enric Pardo Matús Dopiriak T. Maksymyuk Juraj Gazda AI4CE 35 12 0 14 Aug 2023
Zero-shot Text-driven Physically Interpretable Face Editing Yapeng Meng Songru Yang Xuyang Hu Rui Zhao Lincheng Li Z. Shi Zhengxia Zou DiffM 24 0 0 11 Aug 2023
FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields Sung Ju Hwang J. Hyung Daejin Kim Minjeong Kim Jaegul Choo 3DH CLIP CVBM 70 11 0 21 Jul 2023
Survey on Controlable Image Synthesis with Deep Learning Shixiong Zhang Jiao Li Lu Yang 3DV 43 1 0 18 Jul 2023
Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models Alexander W. Bergman Wang Yifan Gordon Wetzstein DiffM 40 6 0 10 Jul 2023
NeuBTF: Neural fields for BTF encoding and transfer Carlos Rodriguez-Pardo Konstantinos Kazatzis Jorge López-Moreno Elena Garces AI4CE 62 9 0 03 Jul 2023
KITE: Keypoint-Conditioned Policies for Semantic Manipulation Priya Sundaresan Suneel Belkhale Dorsa Sadigh Jeannette Bohg LM&Ro 35 24 0 29 Jun 2023
DreamEditor: Text-Driven 3D Scene Editing with Neural Fields Jingyu Zhuang Chen Wang Lingjie Liu Liang Lin Guanbin Li DiffM 13 129 0 23 Jun 2023
Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields Ori Gordon Omri Avrahami Dani Lischinski DiffM 37 22 0 22 Jun 2023
Local 3D Editing via 3D Distillation of CLIP Knowledge J. Hyung Sung Ju Hwang Daejin Kim Hyunji Lee Jaegul Choo 36 23 0 21 Jun 2023
Instruct-NeuralTalker: Editing Audio-Driven Talking Radiance Fields with Instructions Yuqi Sun Reian He Weimin Tan Bo Yan DiffM 43 2 0 19 Jun 2023
CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Search Fahad Shamshad Muzammal Naseer Karthik Nandakumar AAML PICV 49 27 0 16 Jun 2023
Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model Lu Yu Weikang Xiang Kang Han DiffM 43 15 0 15 Jun 2023
ZeroForge: Feedforward Text-to-Shape Without 3D Supervision Kelly O. Marshall Minh Pham Ameya Joshi Anushrut Jignasu Aditya Balu Adarsh Krishnamurthy A. Hegde CLIP 32 3 0 14 Jun 2023
Neural Projection Mapping Using Reflectance Fields Yotam Erel D. Iwai Amit H. Bermano 21 6 0 11 Jun 2023
NeRFool: Uncovering the Vulnerability of Generalizable Neural Radiance Fields against Adversarial Perturbations Y. Fu Ye Yuan Souvik Kundu Shang Wu Shunyao Zhang Yingyan Lin AAML 71 6 0 10 Jun 2023
HyP-NeRF: Learning Improved NeRF Priors using a HyperNetwork Bipasha Sen Gaurav Singh Aditya Agarwal Rohith Agaram K. M. Krishna Srinath Sridhar AI4CE 39 13 0 09 Jun 2023
RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models Xing-Chun Zhou Ying He F. Richard Yu Jianqiang Li You Li DiffM 19 18 0 09 Jun 2023
Instruct-Video2Avatar: Video-to-Avatar Generation with Instructions Shaoxu Li DiffM 21 5 0 05 Jun 2023
Adjustable Visual Appearance for Generalizable Novel View Synthesis Josef Bengtson David Nilsson Che-Tsung Lin Marcel Büsching Fredrik Kahl 59 0 0 02 Jun 2023
FaceDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion Models Hao Zhang Yanbo Xu Tianyuan Dai Yu-Wing Tai Chi-Keung Tang DiffM 11 5 0 01 Jun 2023
CLIP3Dstyler: Language Guided 3D Arbitrary Neural Style Transfer Mingwu Gao YanWu Xu Yang Zhao Tingbo Hou Chenyang Zhao Biwei Huang CLIP 39 1 0 25 May 2023
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction Xinhang Liu Jiaben Chen Shiu-hong Kao Yu-Wing Tai Chi-Keung Tang DiffM 42 15 0 24 May 2023
InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360-degree Neural Radiance Fields Dongqing Wang Tong Zhang Alaa Abboud Sabine Süsstrunk 45 12 0 24 May 2023
Text-guided 3D Human Generation from 2D Collections Tsu-Jui Fu Wenhan Xiong Yixin Nie Jingyu Liu Barlas Ouguz William Yang Wang 47 1 0 23 May 2023
RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars Dongwei Pan Long Zhuo Jingtan Piao Huiwen Luo Wei Cheng ... Chen Change Loy Chao Qian Wayne Wu Dahua Lin Kwan-Yee Lin 32 19 0 22 May 2023
BlendFields: Few-Shot Example-Driven Facial Modeling Kacper Kania Stephan J. Garbin Andrea Tagliasacchi V. Estellers K. M. Yi Julien P. C. Valentin Tomasz Trzciñski Marek Kowalski 3DH 26 5 0 12 May 2023
An Inverse Scaling Law for CLIP Training Xianhang Li Zeyu Wang Cihang Xie VLM CLIP 48 55 0 11 May 2023
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era Chenghao Li Chaoning Zhang Atish Waghwase Lik-Hang Lee François Rameau Yang Yang Sung-Ho Bae Choong Seon Hong 54 75 0 10 May 2023