SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model

9 December 2022

Zhifei Zhang

Papers citing "SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model"

50 / 172 papers shown

Title
GroupDiff: Diffusion-based Group Portrait Editing Yuming Jiang Nanxuan Zhao Qing Liu Krishna Kumar Singh Shuai Yang Chen Change Loy Ziwei Liu DiffM 41 1 0 22 Sep 2024
Click2Mask: Local Editing with Dynamic Mask Generation Omer Regev Omri Avrahami Dani Lischinski DiffM 53 1 0 12 Sep 2024
Improving Text-guided Object Inpainting with Semantic Pre-inpainting Yifu Chen Jingwen Chen Yingwei Pan Yehao Li Ting Yao Zhineng Chen Tao Mei DiffM 31 6 0 12 Sep 2024
FreeEnhance: Tuning-Free Image Enhancement via Content-Consistent Noising-and-Denoising Process Yang Luo Y. Zhang Zhaofan Qiu Ting Yao Zhineng Chen Yu-Gang Jiang Tao Mei DiffM 43 4 0 11 Sep 2024
Thinking Outside the BBox: Unconstrained Generative Object Compositing Gemma Canet Tarrés Zhe Lin Zhifei Zhang Jianming Zhang Yizhi Song Dan Ruta Andrew Gilbert John Collomosse Soo Ye Kim DiffM 35 9 0 06 Sep 2024
TC-PDM: Temporally Consistent Patch Diffusion Models for Infrared-to-Visible Video Translation Anh-Dzung Doan Vu Minh Hieu Phan Surabhi Gupta Markus Wagner Tat-Jun Chin Ian Reid VGen DiffM 41 0 0 26 Aug 2024
Prompt-Softbox-Prompt: A free-text Embedding Control for Image Editing Yitong Yang Yinglin Wang Jing Wang Tian Zhang DiffM 40 1 0 24 Aug 2024
MegaFusion: Extend Diffusion Models towards Higher-resolution Image Generation without Further Tuning Haoning Wu Shaocheng Shen Qiang Hu Xiaoyun Zhang Ya Zhang Yanfeng Wang 40 10 0 20 Aug 2024
FD2Talk: Towards Generalized Talking Head Generation with Facial Decoupled Diffusion Model Ziyu Yao Xuxin Cheng Zhiqi Huang DiffM 30 3 0 18 Aug 2024
MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editing Chenjie Cao Chaohui Yu Yanwei Fu Fan Wang Xiangyang Xue VGen 50 7 0 15 Aug 2024
Dense Feature Interaction Network for Image Inpainting Localization Ye Yao Tingfeng Han Shan Jia Siwei Lyu 33 1 0 05 Aug 2024
View-consistent Object Removal in Radiance Fields Yiren Lu Jing Ma Yu Yin 39 3 0 04 Aug 2024
A Simple Background Augmentation Method for Object Detection with Diffusion Model Yuhang Li Jun Gao Chen Chen Yue Zhang Jielei Zhang DiffM 43 5 0 01 Aug 2024
DragText: Rethinking Text Embedding in Point-based Image Editing Gayoon Choi Taejin Jeong Sujung Hong Jaehoon Joo Seong Jae Hwang DiffM 46 1 0 25 Jul 2024
Diffree: Text-Guided Shape Free Object Inpainting with Diffusion Model Lirui Zhao Tianshuo Yang Wenqi Shao Yuxin Zhang Yu Qiao Ping Luo Kaipeng Zhang Rongrong Ji DiffM 48 3 0 24 Jul 2024
CLII: Visual-Text Inpainting via Cross-Modal Predictive Interaction Liang Zhao Qing Guo Xiaoguang Li Song Wang DiffM 44 0 0 23 Jul 2024
I2AM: Interpreting Image-to-Image Latent Diffusion Models via Bi-Attribution Maps Junseo Park Hyeryung Jang 81 0 0 17 Jul 2024
TGIF: Text-Guided Inpainting Forgery Dataset Hannes Mareen Dimitrios Karageorgiou Glenn Van Wallendael Peter Lambert Symeon Papadopoulos DiffM 48 4 0 16 Jul 2024
LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models Hai Jiang Ao Luo Xiaohong Liu Songchen Han Shuaicheng Liu DiffM 44 25 0 12 Jul 2024
Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers Zhengbo Zhang Li Xu Duo Peng Hossein Rahmani Jun Liu 37 10 0 11 Jul 2024
Coherent and Multi-modality Image Inpainting via Latent Space Optimization Lingzhi Pan Tong Zhang Bingyuan Chen Qi Zhou Wei Ke Sabine Süsstrunk Mathieu Salzmann DiffM 40 2 0 10 Jul 2024
VQA-Diff: Exploiting VQA and Diffusion for Zero-Shot Image-to-3D Vehicle Asset Generation in Autonomous Driving Yibo Liu Zheyuan Yang Guile Wu Y. Ren Kejian Lin Bingbing Liu Yang Liu Jinjun Shan 44 5 0 09 Jul 2024
DiffRetouch: Using Diffusion to Retouch on the Shoulder of Experts Zheng-Peng Duan Jiawei Zhang Zheng Lin Xin Jin Dongqing Zou Chunle Guo Chongyi Li DiffM 42 0 0 04 Jul 2024
Learning Action and Reasoning-Centric Image Editing from Videos and Simulations Benno Krojer Dheeraj Vattikonda Luis Lara Varun Jampani Eva Portelance Christopher Pal Siva Reddy EGVM VGen 49 3 0 03 Jul 2024
Masked Extended Attention for Zero-Shot Virtual Try-On In The Wild Nadav Orzech Yotam Nitzan Ulysse Mizrahi Dov Danon Amit H. Bermano DiffM 35 1 0 21 Jun 2024
CLIPAway: Harmonizing Focused Embeddings for Removing Objects via Diffusion Models Yigit Ekin Ahmet Burak Yildirim Erdem Çağlar Aykut Erdem Erkut Erdem Aysegül Dündar DiffM 39 8 0 13 Jun 2024
FaithFill: Faithful Inpainting for Object Completion Using a Single Reference Image Rupayan Mallick Amr Abdalla Sarah Adel Bargal DiffM 26 0 0 12 Jun 2024
CUPID: Contextual Understanding of Prompt-conditioned Image Distributions Yayan Zhao Mingwei Li Matthew Berger DiffM 36 2 0 11 Jun 2024
Zero-shot Image Editing with Reference Imitation Xi Chen Yutong Feng Mengting Chen Yiyang Wang Shilong Zhang Yu Liu Yujun Shen Hengshuang Zhao DiffM 37 21 0 11 Jun 2024
Zero-Painter: Training-Free Layout Control for Text-to-Image Synthesis Marianna Ohanyan Hayk Manukyan Zhangyang Wang Shant Navasardyan Humphrey Shi DiffM 61 1 0 06 Jun 2024
Improved Distribution Matching Distillation for Fast Image Synthesis Tianwei Yin Michael Gharbi Taesung Park Richard Zhang Eli Shechtman Frédo Durand William T. Freeman DiffM 44 98 0 23 May 2024
StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation Yupeng Zhou Daquan Zhou Ming-Ming Cheng Jiashi Feng Qibin Hou DiffM VGen 49 90 0 02 May 2024
Anywhere: A Multi-Agent Framework for User-Guided, Reliable, and Diverse Foreground-Conditioned Image Generation Tianyidan Xie Rui Ma Qian Wang Xiaoqian Ye Feixuan Liu Ying Tai Zhenyu Zhang Lanjun Wang Zili Yi DiffM MLLM 47 2 0 29 Apr 2024
Paint by Inpaint: Learning to Add Image Objects by Removing Them First Navve Wasserman Noam Rotstein Roy Ganz Ron Kimmel DiffM 39 15 0 28 Apr 2024
DM-Align: Leveraging the Power of Natural Language Instructions to Make Changes to Images Maria Mihaela Truşcǎ Tinne Tuytelaars Marie-Francine Moens DiffM 54 1 0 27 Apr 2024
AudioScenic: Audio-Driven Video Scene Editing Kaixin Shen Ruijie Quan Linchao Zhu Jun Xiao Yi Yang VGen DiffM 42 1 0 25 Apr 2024
Gorgeous: Create Your Desired Character Facial Makeup from Any Ideas Jia Wei Sii Chee Seng Chan DiffM 51 0 0 22 Apr 2024
Lazy Diffusion Transformer for Interactive Image Editing Yotam Nitzan Zongze Wu Richard Zhang Eli Shechtman Daniel Cohen-Or Taesung Park Michael Gharbi 43 9 0 18 Apr 2024
Sketch-guided Image Inpainting with Partial Discrete Diffusion Process Nakul Sharma Aditay Tripathi Anirban Chakraborty Anand Mishra DiffM 41 3 0 18 Apr 2024
RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpainting Ashkan Mirzaei Riccardo de Lutio Seungryong Kim David Acuna J. Kelly Sanja Fidler Igor Gilitschenski Zan Gojcic DiffM 47 10 0 16 Apr 2024
Salient Object-Aware Background Generation using Text-Guided Diffusion Models Amir Erfan Eshratifar JOÃO-BRUNO Soares K. Thadani Shaunak Mishra Mikhail Kuznetsov Yueh-Ning Ku P.De Juan DiffM 37 4 0 15 Apr 2024
RoofDiffusion: Constructing Roofs from Severely Corrupted Point Data via Diffusion Kyle Shih-Huang Lo Jorg Peters Eric Spellman 41 1 0 14 Apr 2024
DreamView: Injecting View-specific Text Guidance into Text-to-3D Generation Junkai Yan Yipeng Gao Q. Yang Xihan Wei Xuansong Xie Ancong Wu Wei-Shi Zheng 40 1 0 09 Apr 2024
Mask-ControlNet: Higher-Quality Image Generation with An Additional Mask Prompt Zhiqi Huang Hui Xiong Haoyu Wang Longguang Wang Zhiheng Li DiffM 38 0 0 08 Apr 2024
ByteEdit: Boost, Comply and Accelerate Generative Image Editing Yuxi Ren Jie Wu Yanzuo Lu Huafeng Kuang Xin Xia ... Shiyin Wang Xuefeng Xiao Yitong Wang Min Zheng Lean Fu 40 5 0 07 Apr 2024
RecDiffusion: Rectangling for Image Stitching with Diffusion Models Tianhao Zhou Haipeng Li Ziyi Wang Ao Luo Chen-Lin Zhang Jiajun Li Bing Zeng Shuaicheng Liu DiffM 32 9 0 28 Mar 2024
Magic Fixup: Streamlining Photo Editing by Watching Dynamic Videos Hadi Alzayer Zhihao Xia Xuaner Zhang Eli Shechtman Jia-Bin Huang Michael Gharbi DiffM VGen 27 19 0 19 Mar 2024
Tuning-Free Image Customization with Image and Text Guidance Pengzhi Li Qiang Nie Ying Chen Xi Jiang Kai Wu Yuhuan Lin Yong-Jin Liu Jinlong Peng Chengjie Wang Feng Zheng DiffM 30 19 0 19 Mar 2024
IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation Yizhi Song Zhifei Zhang Zhe Lin Scott D. Cohen Brian L. Price Jianming Zhang Soo Ye Kim He Zhang Wei Xiong Daniel G. Aliaga DiffM 74 36 0 15 Mar 2024
XReal: Realistic Anatomy and Pathology-Aware X-ray Generation via Controllable Diffusion Model Anees Ur Rehman Hashmi Ibrahim Almakky Mohammad Areeb Qazi Santosh Sanjeev Vijay Ram Papineni Dwarikanath Mahapatra Mohammad Yaqub MedIm 38 5 0 14 Mar 2024