CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

9 December 2021

Papers citing "CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields"

50 / 307 papers shown

Title
MS-NeRF: Multi-Space Neural Radiance Fields Ze-Xin Yin Jiaxiong Qiu Jiaxiong Qiu Bo Ren Bo Ren AI4CE 34 1 0 07 May 2023
LLM2Loss: Leveraging Language Models for Explainable Model Diagnostics Shervin Ardeshir 36 0 0 04 May 2023
ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Rendering Andrea Ramazzina Mario Bijelic Stefanie Walz Alessandro Sanvito Dominik Scheuble Felix Heide 29 18 0 03 May 2023
Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learning Anqi Wang Jiahua Dong Lik-Hang Lee Jiachuan Shen Pan Hui 3DV AI4CE 48 1 0 30 Apr 2023
NaviNeRF: NeRF-based 3D Representation Disentanglement by Latent Semantic Navigation Baao Xie Bo Li Zequn Zhang Junting Dong Xin Jin Jingyu Yang Wenjun Zeng 32 9 0 22 Apr 2023
Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedra Jonáš Kulhánek Torsten Sattler 38 50 0 19 Apr 2023
Reference-guided Controllable Inpainting of Neural Radiance Fields Ashkan Mirzaei Tristan Aumentado-Armstrong Marcus A. Brubaker J. Kelly Alex Levinshtein Konstantinos G. Derpanis Igor Gilitschenski 35 26 0 19 Apr 2023
HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks Zhuo Chen Xudong Xu Yichao Yan Ye Pan Wenhan Zhu Wayne Wu Bo Dai Xiaokang Yang 3DH 32 8 0 19 Apr 2023
Mesh2Tex: Generating Mesh Textures from Image Queries Alexey Bokhovkin Shubham Tulsiani Angela Dai 78 23 0 12 Apr 2023
DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model H. Seo Hayeon Kim Gwanghyun Kim S. Chun DiffM 21 40 0 06 Apr 2023
JacobiNeRF: NeRF Shaping with Mutual Information Gradients Xiaomeng Xu Yanchao Yang Kaichun Mo Boxiao Pan L. Yi Leonidas J. Guibas 41 9 0 01 Apr 2023
Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversion Hiromichi Kamata Yuiko Sakuma Akio Hayakawa Masato Ishii T. Narihira DiffM 37 37 0 28 Mar 2023
X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidance Yiwei Ma Xiaioqing Zhang Xiaoshuai Sun Jiayi Ji Haowei Wang Guannan Jiang Weilin Zhuang Rongrong Ji 28 39 0 28 Mar 2023
Zero-shot Model Diagnosis Jinqi Luo Zhaoning Wang Chen Henry Wu Dong Huang Fernando de la Torre VLM 26 21 0 27 Mar 2023
Clean-NeRF: Reformulating NeRF to account for View-Dependent Observations Xinhang Liu Yu-Wing Tai Chi-Keung Tang 39 7 0 26 Mar 2023
CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout Haotian Bai Yiqi Lin Hui Xiong Sijia Li H. Lu Xiaodong Lin Lin Wang DiffM 45 42 0 24 Mar 2023
DreamStone: Image as Stepping Stone for Text-Guided 3D Shape Generation Zhengzhe Liu Peng Dai Ruihui Li Xiaojuan Qi Chi-Wing Fu DiffM 21 10 0 24 Mar 2023
SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field Chong Bao Yinda Zhang Bangbang Yang Tianxing Fan Zesong Yang Hujun Bao Guofeng Zhang Zhaopeng Cui DiffM 198 96 0 23 Mar 2023
TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision Jiacheng Wei Hao Wang Jiashi Feng Guosheng Lin Kim-Hui Yap 24 30 0 23 Mar 2023
Semantic Ray: Learning a Generalizable Semantic Field with Cross-Reprojection Attention F. Liu Chubing Zhang Yu Zheng Yueqi Duan 33 27 0 23 Mar 2023
FER-former: Multi-modal Transformer for Facial Expression Recognition Yande Li Mingjie Wang Minglun Gong Y. Lu Li Liu 32 8 0 23 Mar 2023
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions Ayaan Haque Matthew Tancik Alexei A. Efros Aleksander Holynski Angjoo Kanazawa VGen DiffM 56 361 0 22 Mar 2023
Vox-E: Text-guided Voxel Editing of 3D Objects Etai Sella Gal Fiebelman Peter Hedman Hadar Averbuch-Elor DiffM 36 74 0 21 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 38 179 0 21 Mar 2023
3D Concept Learning and Reasoning from Multi-View Images Yining Hong Chun-Tse Lin Yilun Du Zhenfang Chen J. Tenenbaum Chuang Gan 3DV 32 52 0 20 Mar 2023
SKED: Sketch-guided Text-based 3D Editing Aryan Mikaeili Or Perel Mehdi Safaee Daniel Cohen-Or Ali Mahdavi-Amiri DiffM 41 66 0 19 Mar 2023
DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery Chaofan Ma Yu-Hao Yang Chen Ju Feifan Zhang Jinxian Liu Yu Wang Ya Zhang Yanfeng Wang DiffM 37 37 0 17 Mar 2023
DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion Maham Tanveer Yizhi Wang Ali Mahdavi-Amiri Hao Zhang DiffM 34 25 0 16 Mar 2023
NEF: Neural Edge Fields for 3D Parametric Curve Reconstruction from Multi-view Images Yunfan Ye Renjiao Yi Zhirui Gao Chenyang Zhu Zhiping Cai Kaiyang Xu 40 19 0 14 Mar 2023
Frequency-Modulated Point Cloud Rendering with Easy Editing Yi Zhang Xiaoyang Huang Bingbing Ni Teng Li Wenjun Zhang 41 13 0 14 Mar 2023
Just Flip: Flipped Observation Generation and Optimization for Neural Radiance Fields to Cover Unobserved View Minjae Lee Kyeongsu Kang Hyeonwoo Yu 64 3 0 11 Mar 2023
Self-NeRF: A Self-Training Pipeline for Few-Shot Neural Radiance Fields Jia-Xuan Bai Le-Tong Huang Wenyi Gong Jie Guo Yanwen Guo 48 5 0 10 Mar 2023
Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement Jiaxiang Tang Hang Zhou Xiaokang Chen Tianshu Hu Errui Ding Jingdong Wang Gang Zeng 41 115 0 03 Mar 2023
3D generation on ImageNet Ivan Skorokhodov Aliaksandr Siarohin Yinghao Xu Jian Ren Hsin-Ying Lee Peter Wonka Sergey Tulyakov 69 55 0 02 Mar 2023
Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation Rui Zhao Wei Li Zhipeng Hu Lincheng Li Zhengxia Zou Z. Shi Changjie Fan 41 18 0 02 Mar 2023
TextIR: A Simple Framework for Text-based Editable Image Restoration Yun-Hao Bai Cairong Wang Shuzhao Xie Chao Dong Chun Yuan Zhi Wang DiffM 30 15 0 28 Feb 2023
Painting 3D Nature in 2D: View Synthesis of Natural Scenes from a Single Semantic Mask Shangzhan Zhang Sida Peng Tianrun Chen Linzhan Mou Haotong Lin Kaicheng Yu Yiyi Liao Xiaowei Zhou 59 8 0 14 Feb 2023
3D-aware Blending with Generative NeRFs Hyunsung Kim Gayoung Lee Yunjey Choi Jin-Hwa Kim Jun-Yan Zhu 29 12 0 13 Feb 2023
Robust Camera Pose Refinement for Multi-Resolution Hash Encoding Hwan Heo Taekyung Kim Jiyoung Lee Jae-Won Lee Soohyun Kim Hyunwoo J. Kim Jin-Hwa Kim 3DV 31 20 0 03 Feb 2023
Text-To-4D Dynamic Scene Generation Uriel Singer Shelly Sheynin Adam Polyak Oron Ashual Iurii Makarov ... Naman Goyal Andrea Vedaldi Devi Parikh Justin Johnson Yaniv Taigman DiffM 39 147 0 26 Jan 2023
HexPlane: A Fast Representation for Dynamic Scenes Ang Cao Justin Johnson 63 429 0 23 Jan 2023
RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenes Bingchen Gong Yuehao Wang Xiaoguang Han Qingxu Dou 33 27 0 19 Jan 2023
Interactive Segmentation of Radiance Fields Rahul Goel Dhawal Sirikonda Saurabh Saini P. J. Narayanan 26 50 0 27 Dec 2022
PaletteNeRF: Palette-based Color Editing for NeRFs Qiling Wu Jianchao Tan Kun Xu 37 18 0 25 Dec 2022
3D Highlighter: Localizing Regions on 3D Shapes via Text Descriptions Dale Decatur Itai Lang Rana Hanocka 29 25 0 21 Dec 2022
PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields Zhengfei Kuang Fujun Luan Sai Bi Zhixin Shu Gordon Wetzstein Kalyan Sunkavalli 38 44 0 21 Dec 2022
Distilling Vision-Language Pre-training to Collaborate with Weakly-Supervised Temporal Action Localization Chen Ju Kunhao Zheng Jinxian Liu Peisen Zhao Ya Zhang Jianlong Chang Yanfeng Wang Qi Tian 17 11 0 19 Dec 2022
NeRF-Art: Text-Driven Neural Radiance Fields Stylization Can Wang Ruixia Jiang Menglei Chai Mingming He Dongdong Chen Jing Liao AI4CE 26 119 0 15 Dec 2022
LidarCLIP or: How I Learned to Talk to Point Clouds Georg Hess Adam Tonderski Christoffer Petersson Kalle AAstrom Lennart Svensson DiffM 27 22 0 13 Dec 2022
LADIS: Language Disentanglement for 3D Shape Editing Ian Huang Panos Achlioptas Tianyi Zhang Sergey Tulyakov Minhyuk Sung Leonidas J. Guibas 34 10 0 09 Dec 2022