CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

9 December 2021

Papers citing "CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields"

50 / 307 papers shown

Title
Portrait3D: 3D Head Generation from Single In-the-wild Portrait Image Jinkun Hao Junshu Tang Jiangning Zhang Ran Yi Yijia Hong Moran Li Weijian Cao Yating Wang Lizhuang Ma DiffM 51 0 0 24 Jun 2024
MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modeling Jian Yang Jiakun Li Guoming Li Zhen Shen Huai-Yu Wu Zhaoxin Fan Heng Huang 3DH 42 0 0 23 Jun 2024
A3D: Does Diffusion Dream about 3D Alignment? Savva Ignatyev Nina Konovalova Daniil Selikhanovych Nikolay Patakin Nikolay Patakin ... Anton Konushin Peter Wonka Alexander Filippov Peter Wonka Evgeny Burnaev DiffM 71 0 0 21 Jun 2024
LLaNA: Large Language and NeRF Assistant Andrea Amaduzzi Pierluigi Zama Ramirez Giuseppe Lisanti Samuele Salti Luigi Di Stefano 48 2 0 17 Jun 2024
NeRFDeformer: NeRF Transformation from a Single View via 3D Scene Flows Z-H. Tang Zhongzheng Ren Xiaoming Zhao Bowen Wen Jonathan Tremblay Stan Birchfield Alexander Schwing 32 2 0 15 Jun 2024
Preserving Identity with Variational Score for General-purpose 3D Editing Duong H. Le Tuan Pham Aniruddha Kembhavi Stephan Mandt Wei-Chiu Ma Jiasen Lu 54 0 0 13 Jun 2024
ICE-G: Image Conditional Editing of 3D Gaussian Splats Vishnu Jaganathan Hannah Hanyun Huang Muhammad Zubair Irshad Varun Jampani Amit Raj Z. Kira 3DGS 50 8 0 12 Jun 2024
InfoGaussian: Structure-Aware Dynamic Gaussians through Lightweight Information Shaping Yunchao Zhang Guandao Yang Leonidas J. Guibas Yanchao Yang 3DGS 33 1 0 09 Jun 2024
3DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Views Xiaobiao Du Haiyang Sun Shuyun Wang Zhuojie Wu Hongwei Sheng Jiaying Ying Ming Lu Tianqing Zhu Kun Zhan Xin Yu 3DPC 40 6 0 07 Jun 2024
IReNe: Instant Recoloring of Neural Radiance Fields Alessio Mazzucchelli Adrian Garcia-Garcia Elena Garces Fernando Rivas-Manzaneque Francesc Moreno-Noguer Adrian Penate-Sanchez 3DH 75 2 0 30 May 2024
REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignment Haonan Han Rui Yang Huan Liao Jiankai Xing Zunnan Xu Xiao-Qing Yu Junwei Zha Xiu Li Wanhua Li DiffM 47 5 0 28 May 2024
F-3DGS: Factorized Coordinates and Representations for 3D Gaussian Splatting Xiangyu Sun J. Lee Daniel Rho Jong Hwan Ko Usman Ali Eunbyung Park 3DGS 36 8 0 27 May 2024
Unified Editing of Panorama, 3D Scenes, and Videos Through Disentangled Self-Attention Injection Gihyun Kwon Jangho Park Jong Chul Ye VGen DiffM 57 0 0 27 May 2024
TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing Teng Xu Jiamin Chen Peng Chen Youjia Zhang Junqing Yu Wei Yang 3DGS DiffM 36 5 0 23 May 2024
Boosting Medical Image-based Cancer Detection via Text-guided Supervision from Reports Guangyu Guo Jiawen Yao Yingda Xia Tony C. W. Mok Zhilin Zheng Junwei Han Le Lu Dingwen Zhang Jian Zhou Ling Zhang 37 1 0 23 May 2024
Implicit-ARAP: Efficient Handle-Guided Deformation of High-Resolution Meshes and Neural Fields via Local Patch Meshing Daniele Baieri Filippo Maggioli Zorah Lähner Simone Melzi Emanuele Rodolà 49 3 0 21 May 2024
AtomGS: Atomizing Gaussian Splatting for High-Fidelity Radiance Field Rong Liu Rui Xu Yue Hu Meida Chen Andrew Feng 3DGS 40 9 0 20 May 2024
GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting Haodong Chen Yongle Huang Haojian Huang Xiangsheng Ge Dian Shao DiffM 42 12 0 13 May 2024
Point Resampling and Ray Transformation Aid to Editable NeRF Models Zhenyang Li Zilong Chen Feifan Qu Mingqing Wang Yizhou Zhao Kai Zhang Yifan Peng 41 1 0 12 May 2024
DragGaussian: Enabling Drag-style Manipulation on 3D Gaussian Representation Sitian Shen Jing Xu Yuheng Yuan Xingyi Yang Qiuhong Shen Xinchao Wang 3DGS 33 3 0 09 May 2024
$${M^2D}$NeRF: Multi-Modal Decomposition NeRF with 3D Feature Fields$ ${M^2D}$ NeRF: Multi-Modal Decomposition NeRF with 3D Feature Fields N. Wang Lefei Zhang Angel X Chang 66 0 0 08 May 2024
Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splatting O. Shorinwa Johnathan Tucker Aliyah Smith Aiden Swann Timothy Chen Roya Firoozi Monroe Kennedy Mac Schwager 42 22 0 07 May 2024
Light Field Compression Based on Implicit Neural Representation Henan Wang Hanxi Zhu Zhibo Chen 45 0 0 07 May 2024
MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Prior Honghua Chen Chen Change Loy Xingang Pan 45 13 0 05 May 2024
WateRF: Robust Watermarks in Radiance Fields for Protection of Copyrights Youngdong Jang Dong In Lee MinHyuk Jang Jong Wook Kim Feng Yang Sangpil Kim 42 14 0 03 May 2024
NeRF in Robotics: A Survey Guangming Wang Lei Pan Songyou Peng Shaohui Liu Chenfeng Xu Yanzi Miao Wei Zhan Masayoshi Tomizuka Marc Pollefeys Hesheng Wang 31 13 0 02 May 2024
NeRF-Insert: 3D Local Editing with Multimodal Control Signals Benet Oriol Sabat Alessandro Achille Matthew Trager Stefano Soatto 34 2 0 30 Apr 2024
DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing Minghao Chen Iro Laina Andrea Vedaldi 3DGS 52 23 0 29 Apr 2024
CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields Deheng Zhang Clara Fernandez-Labrador Christopher Schroers 34 9 0 23 Apr 2024
RainyScape: Unsupervised Rainy Scene Reconstruction using Decoupled Neural Rendering Xianqiang Lyu Hui Liu Junhui Hou 52 1 0 17 Apr 2024
Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement Chi-Yin Wang Junming Huang Rong Zhang Qi Wang Haotian Yang Haibin Huang Chongyang Ma Weiwei Xu 3DH 44 2 0 15 Apr 2024
$ViFu: Multiple 360$^\circ$ Objects Reconstruction with Clean Background via Visible Part Fusion$ ViFu: Multiple 360 $^\circ$ Objects Reconstruction with Clean Background via Visible Part Fusion Tianhan Xu Takuya Ikeda Koichi Nishiwaki 30 0 0 15 Apr 2024
DATENeRF: Depth-Aware Text-based Editing of NeRFs Sara Rojas Julien Philip Kai Zhang Sai Bi Fujun Luan Guohao Li Kalyan Sunkavalli DiffM 27 3 0 06 Apr 2024
OpenNeRF: Open Set 3D Neural Scene Segmentation with Pixel-Wise Features and Rendered Novel Views Francis Engelmann Fabian Manhardt Michael Niemeyer Keisuke Tateno Marc Pollefeys Federico Tombari VLM 78 32 1 04 Apr 2024
GenN2N: Generative NeRF2NeRF Translation Xiangyue Liu Han Xue Kunming Luo Ping Tan Li Yi 29 4 0 03 Apr 2024
Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition Yisheng He Weihao Yuan Siyu Zhu Zilong Dong Liefeng Bo Qixing Huang 44 3 0 03 Apr 2024
NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields Muhammad Zubair Irshad Sergey Zakahrov Vitor Campagnolo Guizilini Adrien Gaidon Z. Kira Rares Ambrus ViT 54 12 0 01 Apr 2024
Lift3D: Zero-Shot Lifting of Any 2D Vision Model to 3D Mukund Varma Peihao Wang Zhiwen Fan Zhangyang Wang Hao Su R. Ramamoorthi VLM 45 8 0 27 Mar 2024
TC4D: Trajectory-Conditioned Text-to-4D Generation Sherwin Bahmani Xian Liu Yifan Wang Ivan Skorokhodov Victor Rong ... Jeong Joon Park Sergey Tulyakov Gordon Wetzstein Andrea Tagliasacchi David B. Lindell 105 35 0 26 Mar 2024
Text-to-3D Shape Generation Han-Hung Lee Manolis Savva Angel X. Chang 34 11 0 20 Mar 2024
N-Modal Contrastive Losses with Applications to Social Media Data in Trimodal Space William Theisen Walter J. Scheirer 34 1 0 18 Mar 2024
Omni-Recon: Harnessing Image-based Rendering for General-Purpose Neural Radiance Fields Yonggan Fu Huaizhi Qu Zhifan Ye Chaojian Li Kevin Zhao Yingyan Lin AI4CE 37 0 0 17 Mar 2024
GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping Yuhang Zheng Xiangyu Chen Yupeng Zheng Songen Gu Runyi Yang ... Chao Yang Dawei Wang Zhen Chen Xiaoxiao Long Meiqing Wang 63 44 0 14 Mar 2024
StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting Kunhao Liu Fangneng Zhan Muyu Xu Christian Theobalt Ling Shao Shijian Lu 3DGS 42 34 0 12 Mar 2024
V3D: Video Diffusion Models are Effective 3D Generators Zilong Chen Yikai Wang Feng Wang Zhengyi Wang Huaping Liu VGen 40 62 0 11 Mar 2024
FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications Yuki Tatsukawa I-Chao Shen Anran Qi Yuki Koyama Takeo Igarashi Ariel Shamir CLIP VLM 33 5 0 11 Mar 2024
S-DyRF: Reference-Based Stylized Radiance Fields for Dynamic Scenes Xingyi Li Zhiguo Cao Yizheng Wu Kewei Wang Ke Xian Zhe Wang Guo-Shing Lin 51 2 0 10 Mar 2024
GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splatting Francesco Palandra Andrea Sanchietti Daniele Baieri Emanuele Rodolà 3DGS 35 20 0 08 Mar 2024
G3DR: Generative 3D Reconstruction in ImageNet Pradyumna Reddy Ismail Elezi Jiankang Deng 38 5 0 01 Mar 2024
Consolidating Attention Features for Multi-view Image Editing Or Patashnik Rinon Gal Daniel Cohen-Or Jun-Yan Zhu Fernando de la Torre 32 5 0 22 Feb 2024