CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

9 December 2021

Papers citing "CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields"

50 / 307 papers shown

Title
NeRFEditor: Differentiable Style Decomposition for Full 3D Scene Editing Chun-Yu Sun Yanbing Liu Junlin Han Stephen Gould 26 7 0 07 Dec 2022
EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Points Chengwei Zheng Wen-chang Lin F. Xu VGen 40 33 0 07 Dec 2022
Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization Yuechen Zhang Zexin He Jinbo Xing Xu Yao Jiaya Jia VGen 34 25 0 06 Dec 2022
One-shot Implicit Animatable Avatars with Model-based Priors Yangyi Huang Hongwei Yi Weiyang Liu Haofan Wang Boxi Wu Wenxiao Wang Binbin Lin Debing Zhang Deng Cai 3DH 41 32 0 05 Dec 2022
PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Models Minghua Liu Yinhao Zhu H. Cai Shizhong Han Z. Ling Fatih Porikli Hao Su 3DPC 41 70 0 03 Dec 2022
3D-TOGO: Towards Text-Guided Cross-Category 3D Object Generation Zutao Jiang Guangsong Lu Xiaodan Liang Jihua Zhu Wei Zhang Xiaojun Chang Hang Xu DiffM 21 8 0 02 Dec 2022
3D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models Gimin Nam Mariem Khlifi Andrew Rodriguez Alberto Tono Linqi Zhou Paul Guerrero DiffM 37 68 0 01 Dec 2022
UniT3D: A Unified Transformer for 3D Dense Captioning and Visual Grounding Dave Zhenyu Chen Ronghang Hu Xinlei Chen Matthias Nießner Angel X. Chang 29 52 0 01 Dec 2022
NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views Dejia Xu Yi Ding Peihao Wang Zhiwen Fan Yi Wang Zhangyang Wang DiffM 59 143 0 29 Nov 2022
Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges K. T. Baghaei Amirreza Payandeh Pooya Fayyazsanavi Shahram Rahimi Zhiqian Chen Somayeh Bakhtiari Ramezani FaML AI4TS 40 6 0 27 Nov 2022
3DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Models Gang Li Heliang Zheng Chaoyue Wang Chang Li C. Zheng Dacheng Tao DiffM 28 59 0 25 Nov 2022
Expanding Small-Scale Datasets with Guided Imagination Yifan Zhang Daquan Zhou Bryan Hooi Kaixin Wang Jiashi Feng 49 46 0 25 Nov 2022
Unsupervised Continual Semantic Adaptation through Neural Rendering Zhizheng Liu Francesco Milano Jonas Frey Roland Siegwart Hermann Blum Cesar Cadena CLL 39 18 0 25 Nov 2022
TPA-Net: Generate A Dataset for Text to Physics-based Animation Yuxing Qiu Feng Gao Minchen Li Govind Thattai Yin Yang Chenfanfu Jiang PINN DiffM VGen 49 0 0 25 Nov 2022
ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field Yuan Li Zhi-Hao Lin D. Forsyth Jia-Bin Huang Shenlong Wang AI4CE 36 30 0 23 Nov 2022
Peekaboo: Text to Image Diffusion Models are Zero-Shot Segmentors R. Burgert Kanchana Ranasinghe Xiang Li Michael S. Ryoo DiffM VLM 36 37 0 23 Nov 2022
BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fields Peng Wang Lingzhe Zhao Rui Ma Peidong Liu 35 74 0 23 Nov 2022
SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fields Ashkan Mirzaei Tristan Aumentado-Armstrong Konstantinos G. Derpanis J. Kelly Marcus A. Brubaker Igor Gilitschenski Alex Levinshtein 33 111 0 22 Nov 2022
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures G. Metzer Elad Richardson Or Patashnik Raja Giryes Daniel Cohen-Or DiffM 73 454 0 14 Nov 2022
CASA: Category-agnostic Skeletal Animal Reconstruction Yuefan Wu Ze-Yin Chen Shao-Wei Liu Zhongzheng Ren Shenlong Wang 33 30 0 04 Nov 2022
CLIP-Sculptor: Zero-Shot Generation of High-Fidelity and Diverse Shapes from Natural Language Aditya Sanghi Rao Fu Vivian Liu Karl Willis Hooman Shayani Amir Hosein Khasahmadi Srinath Sridhar Daniel E. Ritchie 25 52 0 02 Nov 2022
Deep Generative Models on 3D Representations: A Survey Zifan Shi Sida Peng Yinghao Xu Andreas Geiger Yiyi Liao Yujun Shen MedIm 3DV 52 0 0 27 Oct 2022
TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition Yingfa Chen Rui Chen Jiabao Lei Yabin Zhang Kui Jia CLIP 27 81 0 20 Oct 2022
Signal Processing for Implicit Neural Representations Dejia Xu Peihao Wang Yi Ding Zhiwen Fan Zhangyang Wang 34 38 0 17 Oct 2022
AVE-CLIP: AudioCLIP-based Multi-window Temporal Transformer for Audio Visual Event Localization Tanvir Mahmud Diana Marculescu CLIP 19 31 0 11 Oct 2022
NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review K. Gao Yina Gao Hongjie He Dening Lu Linlin Xu Jonathan Li 32 47 0 01 Oct 2022
Diffusion-based Image Translation using Disentangled Style and Content Representation Gihyun Kwon Jong Chul Ye DiffM 162 156 0 30 Sep 2022
Understanding Pure CLIP Guidance for Voxel Grid NeRF Models Han-Hung Lee Angel X. Chang 24 63 0 30 Sep 2022
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 85 2,328 0 29 Sep 2022
360FusionNeRF: Panoramic Neural Radiance Fields with Joint Guidance Shreyas Kulkarni Peng Yin Sebastian Scherer MDE 35 24 0 28 Sep 2022
NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes Zhiwen Fan Peihao Wang Yi Ding Xinyu Gong Dejia Xu Zhangyang Wang 111 63 0 19 Sep 2022
Generative Deformable Radiance Fields for Disentangled Image Synthesis of Topology-Varying Objects ZiYun Wang Yu Deng Jiaolong Yang Jingyi Yu Xin Tong 3DH 35 10 0 09 Sep 2022
ISS: Image as Stepping Stone for Text-Guided 3D Shape Generation Zhengzhe Liu Peng Dai Ruihui Li Xiaojuan Qi Chi-Wing Fu DiffM 182 25 0 09 Sep 2022
Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representations Vadim Tschernezki Iro Laina Diane Larlus Andrea Vedaldi 189 185 0 07 Sep 2022
UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene Chen Yaosen Qinjian Yuan Zhiqiang Li Yue Liu Wen Wang Chaoping Xie Xuming Wen Qien Yu 3DH 32 47 0 15 Aug 2022
Fast Learning Radiance Fields by Shooting Much Fewer Rays Wenyuan Zhang Ruofan Xing Yunfan Zeng Yu-Shen Liu Kanle Shi Zhizhong Han AI4CE 27 33 0 14 Aug 2022
Language-Guided Face Animation by Recurrent StyleGAN-based Generator Tiankai Hang Huan Yang Bei Liu Jianlong Fu Xin Geng B. Guo VGen 40 13 0 11 Aug 2022
ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Model Rao Fu Xiaoyu Zhan Yiwen Chen Daniel E. Ritchie Srinath Sridhar 39 79 0 19 Jul 2022
3D Concept Grounding on Neural Fields Yining Hong Yilun Du Chun-Tse Lin J. Tenenbaum Chuang Gan 31 19 0 13 Jul 2022
Progressively-connected Light Field Network for Efficient View Synthesis Peng Wang Yuan Liu Guying Lin Jiatao Gu Lingjie Liu Taku Komura Wenping Wang 3DH 41 9 0 10 Jul 2022
LaTeRF: Label and Text Driven Object Radiance Fields Ashkan Mirzaei Yash Kant Jonathan Kelly Igor Gilitschenski 30 36 0 04 Jul 2022
EpiGRAF: Rethinking training of 3D GANs Ivan Skorokhodov Sergey Tulyakov Yiqun Wang Peter Wonka DiffM 46 125 0 21 Jun 2022
NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors Haolin Liu I-Chao Shen Binghui Chen 32 45 0 10 Jun 2022
CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshes Youwang Kim Ji-Yeon Kim Tae-Hyun Oh 3DH CLIP 38 48 0 09 Jun 2022
Volumetric Disentanglement for 3D Scene Manipulation Sagie Benaim Frederik Warburg Peter Ebert Christensen Serge Belongie 45 15 0 06 Jun 2022
Decomposing NeRF for Editing via Feature Field Distillation Sosuke Kobayashi Eiichi Matsumoto Vincent Sitzmann 187 329 0 31 May 2022
Prompt-based Learning for Unpaired Image Captioning Peipei Zhu Tianlin Li Lin Zhu Zhenglong Sun Weishi Zheng Yaowei Wang Chen Chen VLM 29 31 0 26 May 2022
AE-NeRF: Auto-Encoding Neural Radiance Fields for 3D-Aware Object Manipulation Mira Kim Jaehoon Ko Kyusun Cho J. Choi Daewon Choi Seung Wook Kim 28 4 0 28 Apr 2022
SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image Dejia Xu Yi Ding Peihao Wang Zhiwen Fan Humphrey Shi Zhangyang Wang 46 188 0 02 Apr 2022
MotionCLIP: Exposing Human Motion Generation to CLIP Space Guy Tevet Brian Gordon Amir Hertz Amit H. Bermano Daniel Cohen-Or CLIP 44 326 0 15 Mar 2022