Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions

22 March 2023

Aleksander Holynski

Papers citing "Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions"

50 / 299 papers shown

Title
A3D: Does Diffusion Dream about 3D Alignment? Savva Ignatyev Nina Konovalova Daniil Selikhanovych Nikolay Patakin Nikolay Patakin ... Anton Konushin Peter Wonka Alexander Filippov Peter Wonka Evgeny Burnaev DiffM 68 0 0 21 Jun 2024
Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Images Haruo Fujiwara Yusuke Mukuta Tatsuya Harada 47 4 0 19 Jun 2024
LLaNA: Large Language and NeRF Assistant Andrea Amaduzzi Pierluigi Zama Ramirez Giuseppe Lisanti Samuele Salti Luigi Di Stefano 44 2 0 17 Jun 2024
Wild-GS: Real-Time Novel View Synthesis from Unconstrained Photo Collections Jiacong Xu Yiqun Mei Vishal M. Patel 3DGS 53 18 0 14 Jun 2024
ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editing Jun-Kun Chen Samuel Rota Buló Norman Muller Lorenzo Porzi Peter Kontschieder Yu-Xiong Wang DiffM 36 9 0 13 Jun 2024
Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusion Linzhan Mou Jun-Kun Chen Yu-Xiong Wang VGen DiffM 41 10 0 13 Jun 2024
Preserving Identity with Variational Score for General-purpose 3D Editing Duong H. Le Tuan Pham Aniruddha Kembhavi Stephan Mandt Wei-Chiu Ma Jiasen Lu 47 0 0 13 Jun 2024
ICE-G: Image Conditional Editing of 3D Gaussian Splats Vishnu Jaganathan Hannah Hanyun Huang Muhammad Zubair Irshad Varun Jampani Amit Raj Z. Kira 3DGS 34 8 0 12 Jun 2024
Tuning-Free Visual Customization via View Iterative Self-Attention Control Xiaojie Li Chenghao Gu Shuzhao Xie Yunpeng Bai Weixiang Zhang Zhi Wang 42 0 0 10 Jun 2024
A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation Ruihe Wang Yukang Cao Kai Han Kwan-Yee K. Wong 58 5 0 06 Jun 2024
SuperGaussian: Repurposing Video Models for 3D Super Resolution Yuan Shen Duygu Ceylan Paul Guerrero Zexiang Xu Niloy J. Mitra Shenlong Wang Anna Frühstück 74 4 0 02 Jun 2024
Bilateral Guided Radiance Field Processing Yuehao Wang Chaoyi Wang Bingchen Gong Tianfan Xue 44 7 0 01 Jun 2024
IReNe: Instant Recoloring of Neural Radiance Fields Alessio Mazzucchelli Adrian Garcia-Garcia Elena Garces Fernando Rivas-Manzaneque Francesc Moreno-Noguer Adrian Penate-Sanchez 3DH 72 2 0 30 May 2024
EG4D: Explicit Generation of 4D Object without Score Distillation Qi Sun Zhiyang Guo Bo Liu Jing Nathan Yan Shengming Yin Wen-gang Zhou Jing Liao Houqiang Li VGen 3DGS 40 13 0 28 May 2024
F-3DGS: Factorized Coordinates and Representations for 3D Gaussian Splatting Xiangyu Sun J. Lee Daniel Rho Jong Hwan Ko Usman Ali Eunbyung Park 3DGS 34 8 0 27 May 2024
Unified Editing of Panorama, 3D Scenes, and Videos Through Disentangled Self-Attention Injection Gihyun Kwon Jangho Park Jong Chul Ye VGen DiffM 47 0 0 27 May 2024
ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Sampling F. Babiloni Alexandros Lattas Jiankang Deng S. Zafeiriou DiffM 35 4 0 26 May 2024
Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors Soumava Paul Christopher Wewer Bernt Schiele J. E. Lenssen 3DGS 42 3 0 26 May 2024
Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis Basile Van Hoorick Rundi Wu Ege Ozguroglu Kyle Sargent Ruoshi Liu P. Tokmakov Achal Dave Changxi Zheng Carl Vondrick DiffM VGen 58 29 0 23 May 2024
TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing Teng Xu Jiamin Chen Peng Chen Youjia Zhang Junqing Yu Wei Yang 3DGS DiffM 27 5 0 23 May 2024
CAT3D: Create Anything in 3D with Multi-View Diffusion Models Ruiqi Gao Aleksander Holynski Philipp Henzler Arthur Brussee Ricardo Martín Brualla Pratul P. Srinivasan Jonathan T. Barron Ben Poole 43 150 0 16 May 2024
Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning Wenqi Dong Bangbang Yang Lin Ma Xiao Liu Liyuan Cui Hujun Bao Yuewen Ma Zhaopeng Cui DiffM 45 9 0 13 May 2024
GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting Haodong Chen Yongle Huang Haojian Huang Xiangsheng Ge Dian Shao DiffM 42 11 0 13 May 2024
DragGaussian: Enabling Drag-style Manipulation on 3D Gaussian Representation Sitian Shen Jing Xu Yuheng Yuan Xingyi Yang Qiuhong Shen Xinchao Wang 3DGS 30 3 0 09 May 2024
$${M^2D}$NeRF: Multi-Modal Decomposition NeRF with 3D Feature Fields$ ${M^2D}$ NeRF: Multi-Modal Decomposition NeRF with 3D Feature Fields N. Wang Lefei Zhang Angel X Chang 55 0 0 08 May 2024
MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Prior Honghua Chen Chen Change Loy Xingang Pan 39 13 0 05 May 2024
NeRF-Insert: 3D Local Editing with Multimodal Control Signals Benet Oriol Sabat Alessandro Achille Matthew Trager Stefano Soatto 32 2 0 30 Apr 2024
DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing Minghao Chen Iro Laina Andrea Vedaldi 3DGS 45 23 0 29 Apr 2024
OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentation Lizhi Wang Feng Zhou Jianqin Yin 3DGS 37 0 0 24 Apr 2024
BANF: Band-limited Neural Fields for Levels of Detail Reconstruction Ahan Shabanov Shrisudhan Govindarajan Cody Reading Lily Goli Daniel Rebain Kwang Moo Yi Andrea Tagliasacchi 37 5 0 19 Apr 2024
Customizing Text-to-Image Diffusion with Camera Viewpoint Control Nupur Kumari Grace Su Richard Zhang Taesung Park Eli Shechtman Jun-Yan Zhu DiffM 44 3 0 18 Apr 2024
InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior Zhiheng Liu Ouyang Hao Qiuyu Wang Ka Leong Cheng Jie Xiao Kai Zhu Nan Xue Yu Liu Yujun Shen Yang Cao DiffM 3DGS 45 20 0 17 Apr 2024
RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpainting Ashkan Mirzaei Riccardo de Lutio Seungryong Kim David Acuna J. Kelly Sanja Fidler Igor Gilitschenski Zan Gojcic DiffM 47 10 0 16 Apr 2024
StyleCity: Large-Scale 3D Urban Scenes Stylization Yingshu Chen Huajian Huang Tuan-Anh Vu Ka Chun Shum Sai-Kit Yeung 49 0 0 16 Apr 2024
Portrait3D: Text-Guided High-Quality 3D Portrait Generation Using Pyramid Representation and GANs Prior Yiqian Wu Hao Xu Xiangjun Tang Xien Chen Siyu Tang Zhebin Zhang Chen Li Xiaogang Jin 43 10 0 16 Apr 2024
SRGS: Super-Resolution 3D Gaussian Splatting Xiang Feng Yongbo He Yubo Wang Yan Yang Wen Li Yifei Chen Zhenzhong Kuang Jiajun Ding Jianping Fan Jun Yu 33 5 0 16 Apr 2024
Taming Latent Diffusion Model for Neural Radiance Field Inpainting C. Lin Changil Kim Jia-Bin Huang Qinbo Li Chih-Yao Ma Johannes Kopf Ming-Hsuan Yang Hung-Yu Tseng AI4CE DiffM 31 10 0 15 Apr 2024
DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading Tong Wu Jiali Sun Yu-Kun Lai Yuewen Ma Leif Kobbelt Lin Gao 3DGS 60 17 0 15 Apr 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 75 55 0 10 Apr 2024
DATENeRF: Depth-Aware Text-based Editing of NeRFs Sara Rojas Julien Philip Kai Zhang Sai Bi Fujun Luan Guohao Li Kalyan Sunkavalli DiffM 27 3 0 06 Apr 2024
InstructHumans: Editing Animated 3D Human Textures with Instructions Jiayin Zhu Linlin Yang Angela Yao DiffM 45 1 0 05 Apr 2024
GenN2N: Generative NeRF2NeRF Translation Xiangyue Liu Han Xue Kunming Luo Ping Tan Li Yi 29 3 0 03 Apr 2024
Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decomposition Yisheng He Weihao Yuan Siyu Zhu Zilong Dong Liefeng Bo Qixing Huang 42 3 0 03 Apr 2024
GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image Chong Bao Yinda Zhang Yuan Li Xiyu Zhang Bangbang Yang Hujun Bao Marc Pollefeys Guofeng Zhang Zhaopeng Cui DiffM 45 5 0 02 Apr 2024
NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields Muhammad Zubair Irshad Sergey Zakahrov Vitor Campagnolo Guizilini Adrien Gaidon Z. Kira Rares Andrei Ambrus ViT 45 12 0 01 Apr 2024
MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space Armand Comas Massague Di Qiu Menglei Chai Marcel C. Bühler Amit Raj ... Mark Matthews Paulo F. U. Gotardo Octavia Camps Sergio Orts Thabo Beeler 52 1 0 01 Apr 2024
Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing Ri-Zhao Qiu Ge Yang Weijia Zeng Xiaolong Wang 3DGS 43 21 0 01 Apr 2024
DiSR-NeRF: Diffusion-Guided View-Consistent Super-Resolution NeRF Jie Long Lee Chen Li Gim Hee Lee 31 6 0 01 Apr 2024
Neural Radiance Field-based Visual Rendering: A Comprehensive Review Mingyuan Yao Yukang Huo Yang Ran Qingbin Tian Ruifeng Wang Haihua Wang AI4CE 32 8 0 31 Mar 2024
Lift3D: Zero-Shot Lifting of Any 2D Vision Model to 3D Mukund Varma Peihao Wang Zhiwen Fan Zhangyang Wang Hao Su R. Ramamoorthi VLM 40 8 0 27 Mar 2024