CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

9 December 2021

Papers citing "CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields"

50 / 307 papers shown

Title
FlashTex: Fast Relightable Mesh Texturing with LightControlNet Kangle Deng Timothy Omernick Alexander Weiss Deva Ramanan Jun-Yan Zhu Tinghui Zhou Maneesh Agrawala 48 28 0 20 Feb 2024
Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review Thang-Anh-Quan Nguyen Amine Bourki Mátyás Macudzinski Anthony Brunel M. Bennamoun 48 11 0 17 Feb 2024
NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs Michael Fischer Zhengqin Li Thu Nguyen-Phuoc Aljaz Bozic Zhao Dong Carl S. Marshall Tobias Ritschel 49 10 0 13 Feb 2024
Mesh-based Gaussian Splatting for Real-time Large-scale Deformation Lin Gao Jie Yang Bo-Tao Zhang Jiali Sun Yu-Jie Yuan Hongbo Fu Yu-Kun Lai 3DGS AI4CE 26 22 0 07 Feb 2024
ConRF: Zero-shot Stylization of 3D Scenes with Conditioned Radiation Fields Xingyu Miao Yang Bai Haoran Duan Fan Wan Yawen Huang Yang Long Yefeng Zheng VGen 36 4 0 02 Feb 2024
Geometry Transfer for Stylizing Radiance Fields Hyunyoung Jung Seonghyeon Nam N. Sarafianos Sungjoo Yoo Alexander Sorkine-Hornung Rakesh Ranjan 55 10 0 01 Feb 2024
ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields Edward Bartrum Thu Nguyen-Phuoc Christopher Xie Zhengqin Li Numair Khan A. Avetisyan Douglas Lanman Lei Xiao DiffM 46 4 0 31 Jan 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 77 41 0 31 Jan 2024
TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts Jingyu Zhuang Di Kang Yan-Pei Cao Guanbin Li Liang Lin Ying Shan DiffM 3DGS 55 38 0 26 Jan 2024
PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DoF Object Pose Dataset Generation Lukas Meyer Floris Erich Yusuke Yoshiyasu Marc Stamminger Noriaki Ando Y. Domae 3DGS 34 11 0 04 Jan 2024
Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attribute Chaoqun Gong Yuqin Dai Ronghui Li Achun Bao Jun Li Jian Yang Yachao Zhang Xiu Li 31 5 0 01 Jan 2024
Taming Mode Collapse in Score Distillation for Text-to-3D Generation Peihao Wang Dejia Xu Zhiwen Fan Dilin Wang Sreyas Mohan ... Rakesh Ranjan Yilei Li Qiang Liu Zhangyang Wang Vikas Chandra DiffM 39 27 0 31 Dec 2023
Joint Self-Supervised and Supervised Contrastive Learning for Multimodal MRI Data: Towards Predicting Abnormal Neurodevelopment Zhiyuan Li Hailong Li Anca L. Ralescu Jonathan R. Dillman M. Altaye Kim M. Cecil N. Parikh Lili He 37 2 0 22 Dec 2023
Free-Editor: Zero-shot Text-driven 3D Scene Editing Nazmul Karim Hasan Iqbal Umar Khalid Jingyi Hua Chong Chen DiffM 51 8 0 21 Dec 2023
GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning Ye Yuan Xueting Li Yangyi Huang Shalini De Mello Koki Nagano Jan Kautz Umar Iqbal 3DGS 30 44 0 18 Dec 2023
LatentEditor: Text Driven Local Editing of 3D Scenes Umar Khalid Hasan Iqbal Nazmul Karim Jingyi Hua Chong Chen DiffM 3DGS 27 13 0 14 Dec 2023
SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds Minghao Chen Junyu Xie Iro Laina Andrea Vedaldi KELM 52 9 0 14 Dec 2023
OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers Hanming Liang Jiacheng Bao Ruichi Zhang Sihan Ren Yuecheng Xu Sibei Yang Xin Chen Jingyi Yu Lan Xu 55 18 0 14 Dec 2023
Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models Liangchen Song Liangliang Cao Jiatao Gu Yifan Jiang Junsong Yuan Hao Tang DiffM 31 13 0 13 Dec 2023
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 37 143 0 13 Dec 2023
HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation Hongyu Liu Xuan Wang Bo Liu Yujun Shen Yibing Song Jing Liao Qifeng Chen DiffM 55 17 0 12 Dec 2023
MaTe3D: Mask-guided Text-based 3D-aware Portrait Editing Kangneng Zhou Daiheng Gao Xuan Wang Jie Zhang Peng Zhang ... Shiqi Yang Bang Zhang Liefeng Bo Yaxing Wang Ming-Ming Cheng DiffM 41 4 0 12 Dec 2023
Learning Naturally Aggregated Appearance for Efficient 3D Editing Ka Leong Cheng Qiuyu Wang Zifan Shi Kecheng Zheng Yinghao Xu Ouyang Hao Qifeng Chen Yujun Shen 3DH 63 4 0 11 Dec 2023
Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Models Ivan Kapelyukh Yifei Ren Ignacio Alzugaray Edward Johns VLM LM&Ro 33 20 0 07 Dec 2023
Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Views Yabo Chen Jiemin Fang Yuyang Huang Taoran Yi Xiaopeng Zhang Lingxi Xie Xinggang Wang Wenrui Dai Hongkai Xiong Qi Tian DiffM 38 20 0 07 Dec 2023
TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshes Xuying Zhang Bo-Wen Yin Yuming Chen Zheng Lin Yunheng Li Qibin Hou Ming-Ming Cheng CLIP DiffM 47 7 0 07 Dec 2023
TPA3D: Triplane Attention for Fast Text-to-3D Generation Hong-En Chen Bin-Shih Wu Sheng-Yu Huang Yu-Chiang Frank Wang 24 2 0 05 Dec 2023
Prompt2NeRF-PIL: Fast NeRF Generation via Pretrained Implicit Latent Jianmeng Liu Yuyao Zhang Zeyuan Meng Yu-Wing Tai Chi-Keung Tang VLM DiffM AI4CE 36 1 0 05 Dec 2023
Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training Runze He Shaofei Huang Xuecheng Nie Tianrui Hui Luoqi Liu Jiao Dai Jizhong Han Guanbin Li Si Liu DiffM 35 7 0 04 Dec 2023
Gaussian Grouping: Segment and Edit Anything in 3D Scenes Mingqiao Ye Martin Danelljan Fisher Yu Lei Ke 3DGS DiffM 39 167 0 01 Dec 2023
FSGS: Real-Time Few-shot View Synthesis using Gaussian Splatting Zehao Zhu Zhiwen Fan Yi Ding Zhangyang Wang 3DGS 60 146 0 01 Dec 2023
4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling Sherwin Bahmani Ivan Skorokhodov Victor Rong Gordon Wetzstein Leonidas J. Guibas Peter Wonka Sergey Tulyakov Jeong Joon Park Andrea Tagliasacchi David B. Lindell DiffM 59 103 0 29 Nov 2023
HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting Xian Liu Xiaohang Zhan Jiaxiang Tang Ying Shan Gang Zeng Dahua Lin Xihui Liu Ziwei Liu 3DGS 45 72 0 28 Nov 2023
SemiVL: Semi-Supervised Semantic Segmentation with Vision-Language Guidance Lukas Hoyer D. Tan Muhammad Ferjad Naeem Luc Van Gool F. Tombari VLM MLLM 36 16 0 27 Nov 2023
GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions Jiemin Fang Junjie Wang Xiaopeng Zhang Lingxi Xie Qi Tian 3DGS DiffM 53 109 0 27 Nov 2023
Deceptive-Human: Prompt-to-NeRF 3D Human Generation with 3D-Consistent Synthetic Images Shiu-hong Kao Xinhang Liu Yu-Wing Tai Chi-Keung Tang 39 0 0 27 Nov 2023
ET3D: Efficient Text-to-3D Generation via Multi-View Distillation Yiming Chen Zhiqi Li Peidong Liu 31 6 0 27 Nov 2023
GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting Yiwen Chen Zilong Chen Chi Zhang Feng Wang Xiaofeng Yang Yikai Wang Zhongang Cai Lei Yang Huaping Liu Guosheng Lin 3DGS 108 187 0 24 Nov 2023
PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF Yutao Feng Yintong Shang Xuan Li Tianjia Shao Chenfanfu Jiang Yin Yang AI4CE 59 23 0 22 Nov 2023
Entangled View-Epipolar Information Aggregation for Generalizable Neural Radiance Fields Zhiyuan Min Yawei Luo Wei Yang Yuesong Wang Yi Yang 49 2 0 20 Nov 2023
Aria-NeRF: Multimodal Egocentric View Synthesis Jiankai Sun Jianing Qiu Chuanyang Zheng Johnathan Tucker Javier Yu Mac Schwager EgoV 45 5 0 11 Nov 2023
InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image Jianhui Li Shilong Liu Zidong Liu Yikai Wang Kaiwen Zheng Jinghui Xu Jianmin Li Jun Zhu 47 10 0 06 Nov 2023
PDF: Point Diffusion Implicit Function for Large-scale Scene Neural Representation Yuhan Ding Fukun Yin Jiayuan Fan Hui Li Xin Chen Wen Liu Chongshan Lu Gang Yu Tao Chen 38 5 0 03 Nov 2023
Open-NeRF: Towards Open Vocabulary NeRF Decomposition Hao Zhang Fang Li Narendra Ahuja 37 12 0 25 Oct 2023
Few-shot Action Recognition with Captioning Foundation Models Xiang Wang Shiwei Zhang Hangjie Yuan Yingya Zhang Changxin Gao Deli Zhao Nong Sang VLM 46 7 0 16 Oct 2023
ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Context Binglun Wang Niladri Shekhar Dutt Niloy J. Mitra 52 10 0 15 Oct 2023
GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models Taoran Yi Jiemin Fang Junjie Wang Guanjun Wu Lingxi Xie Xiaopeng Zhang Wenyu Liu Qi Tian Xinggang Wang 3DGS 46 128 0 12 Oct 2023
Point-Based Radiance Fields for Controllable Human Motion Synthesis Haitao Yu Deheng Zhang Peiyuan Xie Tianyi Zhang 3DH 26 4 0 05 Oct 2023
ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRF Jangho Park Gihyun Kwon Jong Chul Ye 32 12 0 04 Oct 2023
USB-NeRF: Unrolling Shutter Bundle Adjusted Neural Radiance Fields Moyang Li Peng Wang Lingzhe Zhao Bangyan Liao Peidong Liu 34 10 0 04 Oct 2023