Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions

22 March 2023

Aleksander Holynski

Papers citing "Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions"

49 / 299 papers shown

Title
Text2Control3D: Controllable 3D Avatar Generation in Neural Radiance Fields using Geometry-Guided Text-to-Image Diffusion Model Sungwon Hwang J. Hyung Jaegul Choo DiffM 35 4 0 07 Sep 2023
Towards Foundational AI Models for Additive Manufacturing: Language Models for G-Code Debugging, Manipulation, and Comprehension Anushrut Jignasu Kelly O. Marshall Baskar Ganapathysubramanian Aditya Balu Chinmay Hegde A. Krishnamurthy ELM AI4CE 27 6 0 04 Sep 2023
GridPull: Towards Scalability in Learning Implicit Representations from 3D Point Clouds Chao Chen Yu-Shen Liu Zhizhong Han 3DPC 36 12 0 25 Aug 2023
IT3D: Improved Text-to-3D Generation with Explicit View Synthesis Yiwen Chen Chi Zhang Xiaofeng Yang Zhongang Cai Gang Yu Lei Yang Guo-Shing Lin DiffM 37 62 0 22 Aug 2023
Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projection Junsheng Zhou Baorui Ma Shujuan Li Yu-Shen Liu Zhizhong Han 40 36 0 22 Aug 2023
FocalDreamer: Text-driven 3D Editing via Focal-fusion Assembly Yuhan Li Yishun Dou Yue Shi Yulai Lei Xuanhong Chen Yi Zhang Peng Zhou Bingbing Ni 3DGS 30 56 0 21 Aug 2023
O $^2$ -Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model Yubin Hu Sheng Ye Wang Zhao Matthieu Lin Yuze He Yu-Hui Wen Ying He Yong-Jin Liu DiffM 33 4 0 18 Aug 2023
Watch Your Steps: Local Image and Scene Editing by Text Instructions Ashkan Mirzaei Tristan Aumentado-Armstrong Marcus A. Brubaker J. Kelly Alex Levinshtein Konstantinos G. Derpanis Igor Gilitschenski DiffM 27 34 0 17 Aug 2023
CoDeF: Content Deformation Fields for Temporally Consistent Video Processing Ouyang Hao Qiuyu Wang Yuxi Xiao Qingyan Bai Juntao Zhang Kecheng Zheng Xiaowei Zhou Qifeng Chen Yujun Shen DiffM VGen 46 81 0 15 Aug 2023
Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases Eugen Šlapak Enric Pardo Matús Dopiriak T. Maksymyuk Juraj Gazda AI4CE 30 12 0 14 Aug 2023
Magic NeRF Lens: Interactive Fusion of Neural Radiance Fields for Virtual Facility Inspection Ke Li S. Schmidt Tim Rolff Reinhard Bacher Wim Leemans Frank Steinicke 21 9 0 19 Jul 2023
Survey on Controlable Image Synthesis with Deep Learning Shixiong Zhang Jiao Li Lu Yang 3DV 32 1 0 18 Jul 2023
Collaborative Score Distillation for Consistent Visual Synthesis Subin Kim Kyungmin Lee June Suk Choi Jongheon Jeong Kihyuk Sohn Jinwoo Shin DiffM 29 21 0 04 Jul 2023
NeuBTF: Neural fields for BTF encoding and transfer Carlos Rodriguez-Pardo Konstantinos Kazatzis Jorge López-Moreno Elena Garces AI4CE 54 9 0 03 Jul 2023
Freestyle 3D-Aware Portrait Synthesis Based on Compositional Generative Priors Tianxiang Ma Kang Zhao Jianxin Sun Yingya Zhang Jing Dong 32 1 0 27 Jun 2023
DreamEditor: Text-Driven 3D Scene Editing with Neural Fields Jingyu Zhuang Chen Wang Lingjie Liu Liang Lin Guanbin Li DiffM 13 129 0 23 Jun 2023
Blended-NeRF: Zero-Shot Object Generation and Blending in Existing Neural Radiance Fields Ori Gordon Omri Avrahami Dani Lischinski DiffM 32 22 0 22 Jun 2023
Instruct-NeuralTalker: Editing Audio-Driven Talking Radiance Fields with Instructions Yuqi Sun Reian He Weimin Tan Bo Yan DiffM 32 2 0 19 Jun 2023
Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model Lu Yu Weikang Xiang Kang Han DiffM 26 15 0 15 Jun 2023
UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video Zhi-Hao Lin Bohan Liu Yi-Ting Chen David A. Forsyth Jia-Bin Huang Jia-Bin Huang Anand Bhattad Shenlong Wang VGen 42 10 0 15 Jun 2023
InstructP2P: Learning to Edit 3D Point Clouds with Text Instructions Jiale Xu Xintao Wang Yannan Cao Weihao Cheng Ying Shan Shenghua Gao DiffM 22 11 0 12 Jun 2023
HyP-NeRF: Learning Improved NeRF Priors using a HyperNetwork Bipasha Sen Gaurav Singh Aditya Agarwal Rohith Agaram K. M. Krishna Srinath Sridhar AI4CE 23 13 0 09 Jun 2023
HeadSculpt: Crafting 3D Head Avatars with Text Xiaoping Han Yukang Cao Kai Han Xiatian Zhu Jiankang Deng Yi-Zhe Song Tao Xiang Kwan-Yee K. Wong DiffM 19 45 0 05 Jun 2023
Instruct-Video2Avatar: Video-to-Avatar Generation with Instructions Shaoxu Li DiffM 16 5 0 05 Jun 2023
Adjustable Visual Appearance for Generalizable Novel View Synthesis Josef Bengtson David Nilsson Che-Tsung Lin Marcel Büsching Fredrik Kahl 43 0 0 02 Jun 2023
AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars Mohit Mendiratta Xingang Pan Mohamed A. Elgharib Kartik Teotia Mallikarjun B R A. Tewari Vladislav Golyanik Adam Kortylewski Christian Theobalt DiffM 42 30 0 01 Jun 2023
Control4D: Efficient 4D Portrait Editing with Text Ruizhi Shao Jingxiang Sun Cheng Peng Zerong Zheng Boyao Zhou Hongwen Zhang Yebin Liu DiffM 24 23 0 31 May 2023
AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation Thu Nguyen-Phuoc Gabriel Schwartz Yuting Ye Stephen Lombardi Lei Xiao 35 6 0 30 May 2023
LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images Viraj Prabhu Sriram Yenamandra Prithvijit Chattopadhyay Judy Hoffman 33 38 0 30 May 2023
HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance Junzhe Zhu Peiye Zhuang Oluwasanmi Koyejo DiffM 26 73 0 30 May 2023
Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback Yiqi Lin Hao Wu Ruichen Wang H. Lu Xiaodong Lin Hui Xiong Lin Wang 3DV 45 12 0 25 May 2023
InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360-degree Neural Radiance Fields Dongqing Wang Tong Zhang Alaa Abboud Sabine Süsstrunk 40 12 0 24 May 2023
RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture Liangchen Song Liangliang Cao Hongyu Xu Kai Kang Feng Tang Junsong Yuan Yang Zhao VGen DiffM 29 44 0 18 May 2023
OR-NeRF: Object Removing from 3D Scenes Guided by Multiview Segmentation with Neural Radiance Fields Youtan Yin Zhoujie Fu Fan Yang Guosheng Lin 47 29 0 17 May 2023
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era Chenghao Li Chaoning Zhang Atish Waghwase Lik-Hang Lee François Rameau Yang Yang Sung-Ho Bae Choong Seon Hong 54 74 0 10 May 2023
HyperStyle3D: Text-Guided 3D Portrait Stylization via Hypernetworks Zhuo Chen Xudong Xu Yichao Yan Ye Pan Wenhan Zhu Wayne Wu Bo Dai Xiaokang Yang 3DH 32 8 0 19 Apr 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 18 123 0 11 Apr 2023
Vox-E: Text-guided Voxel Editing of 3D Objects Etai Sella Gal Fiebelman Peter Hedman Hadar Averbuch-Elor DiffM 28 73 0 21 Mar 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 104 291 0 21 Feb 2023
RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenes Bingchen Gong Yuehao Wang Xiaoguang Han Qingxu Dou 28 27 0 19 Jan 2023
Boomerang: Local sampling on image manifolds using diffusion models Lorenzo Luzi P. Mayer Josue Casco-Rodriguez Ali Siahkoohi Richard G. Baraniuk DiffM 32 20 0 21 Oct 2022
Visual Language Maps for Robot Navigation Chen Huang Oier Mees Andy Zeng Wolfram Burgard LM&Ro 162 345 0 11 Oct 2022
Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representations Vadim Tschernezki Iro Laina Diane Larlus Andrea Vedaldi 189 185 0 07 Sep 2022
UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene Chen Yaosen Qinjian Yuan Zhiqiang Li Yue Liu Wen Wang Chaoping Xie Xuming Wen Qien Yu 3DH 27 47 0 15 Aug 2022
Decomposing NeRF for Editing via Feature Field Distillation Sosuke Kobayashi Eiichi Matsumoto Vincent Sitzmann 184 328 0 31 May 2022
StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning Yihua Huang Yue He Yu-Jie Yuan Yu-Kun Lai Lin Gao 178 148 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 339 12,003 0 04 Mar 2022
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 211 352 0 06 Dec 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 356 5,811 0 29 Apr 2021