SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model

9 December 2022

Zhifei Zhang

Papers citing "SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model"

50 / 172 papers shown

Title
Mitigating the Impact of Attribute Editing on Face Recognition Sudipta Banerjee Sai Pranaswi Mullangi Shruti Wagle Chinmay Hegde Nasir D. Memon CVBM 41 1 0 12 Mar 2024
BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion Xu Ju Xian Liu Xintao Wang Hao Wang Ying Shan Qiang Xu 40 64 0 11 Mar 2024
NoiseCollage: A Layout-Aware Text-to-Image Diffusion Model Based on Noise Cropping and Merging Takahiro Shirakawa Seiichi Uchida DiffM 35 15 0 06 Mar 2024
Context-aware Talking Face Video Generation Meidai Xuanyuan Yuwang Wang Honglei Guo Qionghai Dai DiffM 41 0 0 28 Feb 2024
Diffusion Model-Based Image Editing: A Survey Yi Huang Jiancheng Huang Yifan Liu Mingfu Yan Jiaxi Lv Jianzhuang Liu Wei Xiong He Zhang Liangliang Cao Liangliang Cao EGVM 66 86 0 27 Feb 2024
Outline-Guided Object Inpainting with Diffusion Models Markus Pobitzer Filip Janicki Mattia Rigotti C. Malossi DiffM 35 1 0 26 Feb 2024
Causal Representation Learning from Multiple Distributions: A General Setting Kun Zhang Shaoan Xie Ignavier Ng Yujia Zheng CML OOD 29 18 0 07 Feb 2024
An Inpainting-Infused Pipeline for Attire and Background Replacement F. Mahlow A. F. Zanella William Alberto Cruz-Castaneda Marcellus Amadeus 41 0 0 05 Feb 2024
Mobile Fitting Room: On-device Virtual Try-on via Diffusion Models Justin Blalock David Munechika Harsha Karanth Alec Helbling Pratham Mehta Seongmin Lee Duen Horng Chau DiffM 32 0 0 02 Feb 2024
A Survey on Data Augmentation in Large Model Era Yue Zhou Chenlu Guo Xu Wang Yi-Ju Chang Yuan Wu LM&MA VLM 49 23 0 27 Jan 2024
BootPIG: Bootstrapping Zero-shot Personalized Image Generation Capabilities in Pretrained Diffusion Models Senthil Purushwalkam Akash Gokul Chenyu You Nikhil Naik DiffM 39 17 0 25 Jan 2024
ActAnywhere: Subject-Aware Video Background Generation Boxiao Pan Zhan Xu Chun-Hao Paul Huang Krishna Kumar Singh Yang Zhou Leonidas J. Guibas Jimei Yang VGen DiffM 29 3 0 19 Jan 2024
Towards Language-Driven Video Inpainting via Multimodal Large Language Models Jianzong Wu Xiangtai Li Chenyang Si Shangchen Zhou Jingkang Yang ... Yining Li Kai Chen Yunhai Tong Ziwei Liu Chen Change Loy VGen DiffM MLLM 41 17 0 18 Jan 2024
Deep Learning-based Image and Video Inpainting: A Survey Weize Quan Jiaxi Chen Yanli Liu Dong-Ming Yan Peter Wonka 3DV 43 35 0 07 Jan 2024
HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Models Hayk Manukyan Andranik Sargsyan Barsegh Atanyan Zhangyang Wang Shant Navasardyan Humphrey Shi DiffM 35 28 0 21 Dec 2023
DreamDistribution: Learning Prompt Distribution for Diverse In-distribution Generation Brian Nlong Zhao Yuhang Xiao Lyne Tchapmi Xinyang Jiang Yifan Yang Dongsheng Li Laurent Itti Vibhav Vineet Yunhao Ge VLM 115 7 0 21 Dec 2023
ID-Blau: Image Deblurring by Implicit Diffusion-based reBLurring AUgmentation Jia-Hao Wu Fu-Jen Tsai Yan-Tsung Peng Chung-Chi Tsai Chia-Wen Lin Yen-Yu Lin DiffM 33 6 0 18 Dec 2023
Relightful Harmonization: Lighting-aware Portrait Background Replacement Mengwei Ren Wei Xiong Jae Shin Yoon Zhixin Shu Jianming Zhang HyunJoon Jung Guido Gerig He Zhang DiffM 38 18 0 11 Dec 2023
Offloading and Quality Control for AI Generated Content Services in 6G Mobile Edge Computing Networks Yi-Ting Wang Chang Liu Jun Zhao 11 1 0 11 Dec 2023
BARET : Balanced Attention based Real image Editing driven by Target-text Inversion Yuming Qiao Fanyi Wang Jingwen Su Yanhao Zhang Yunjie Yu Siyu Wu Guo-Jun Qi DiffM 30 4 0 09 Dec 2023
SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Control Jaskirat Singh Jianming Zhang Qing Liu Cameron Smith Zhe-nan Lin Liang Zheng DiffM 34 11 0 08 Dec 2023
Prompt-In-Prompt Learning for Universal Image Restoration Zilong Li Yiming Lei Chenglong Ma Junping Zhang Hongming Shan VLM 39 25 0 08 Dec 2023
DiffCMR: Fast Cardiac MRI Reconstruction with Diffusion Probabilistic Models Tianqi Xiang Wenjun Yue Yiqun Lin Jiewen Yang Zhenkun Wang Xiaomeng Li DiffM MedIm 33 1 0 08 Dec 2023
RL Dreams: Policy Gradient Optimization for Score Distillation based 3D Generation Aradhya Neeraj Mathur Phu-Cuong Pham Aniket Bera Ojaswa Sharma 33 0 0 08 Dec 2023
AVID: Any-Length Video Inpainting with Diffusion Model Zhixing Zhang Bichen Wu Xiaoyan Wang Yaqiao Luo Luxin Zhang Yinan Zhao Peter Vajda Dimitris N. Metaxas Licheng Yu VGen DiffM 42 33 0 06 Dec 2023
A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpainting Junhao Zhuang Yanhong Zeng Wenran Liu Chun Yuan Kai Chen DiffM 53 71 0 06 Dec 2023
DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Models Shaoan Xie Yang Zhao Zhisheng Xiao Kelvin C. K. Chan Yandong Li Yanwu Xu Kun Zhang Tingbo Hou DiffM 36 26 0 05 Dec 2023
LooseControl: Lifting ControlNet for Generalized Depth Conditioning Shariq Farooq Bhat Niloy J. Mitra Peter Wonka AI4CE DiffM 36 34 0 05 Dec 2023
AmbiGen: Generating Ambigrams from Pre-trained Diffusion Model Boheng Zhao Rana Hanocka Raymond A. Yeh DiffM 16 1 0 05 Dec 2023
UniGS: Unified Representation for Image Generation and Segmentation Lu Qi Lehan Yang Weidong Guo Yu-Syuan Xu Bo Du Varun Jampani Ming-Hsuan Yang 40 17 0 04 Dec 2023
Exploring Multi-Modal Fusion for Image Manipulation Detection and Localization Konstantinos Triaridis Vasileios Mezaris 27 4 0 04 Dec 2023
HiFi Tuner: High-Fidelity Subject-Driven Fine-Tuning for Diffusion Models Zhonghao Wang Wei Wei Yang Zhao Zhisheng Xiao M. Hasegawa-Johnson Humphrey Shi Tingbo Hou DiffM 33 11 0 30 Nov 2023
Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Following Yutong Feng Biao Gong Di Chen Yujun Shen Yu Liu Jingren Zhou DiffM 34 43 0 28 Nov 2023
Emu Edit: Precise Image Editing via Recognition and Generation Tasks Shelly Sheynin Adam Polyak Uriel Singer Yuval Kirstain Amit Zohar Oron Ashual Devi Parikh Yaniv Taigman 19 130 0 16 Nov 2023
DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model Yinghao Xu Hao Tan Fujun Luan Sai Bi Peng Wang ... Zifan Shi Kalyan Sunkavalli Gordon Wetzstein Zexiang Xu Kai Zhang 43 153 0 15 Nov 2023
Diffusion-based Radiotherapy Dose Prediction Guided by Inter-slice Aware Structure Encoding Zheng-Kai Feng L. Wen Jianghong Xiao Yuanyuan Xu Xi Wu Jiliu Zhou Xingchen Peng Yan Wang DiffM MedIm 21 8 0 06 Nov 2023
Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model Shiyuan Yang Xiaodong Chen Jing Liao DiffM 30 59 0 11 Oct 2023
Magicremover: Tuning-free Text-guided Image inpainting with Diffusion Models Si-hang Yang Lu Zhang Liqian Ma Yu Liu JingJing Fu You He DiffM 31 11 0 04 Oct 2023
Completing Visual Objects via Bridging Generation and Segmentation Xiang Li Yinpeng Chen Chung-Ching Lin Hao Chen Kai Hu Rita Singh Bhiksha Raj Lijuan Wang Zicheng Liu DiffM 29 4 0 01 Oct 2023
DreamCom: Finetuning Text-guided Inpainting Model for Image Composition Lingxiao Lu Jiangtong Li Bo Zhang Li Niu DiffM 28 11 0 27 Sep 2023
Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates Kashun Shum Jaeyeon Kim Binh-Son Hua Duc Thanh Nguyen Sai-Kit Yeung 3DH AI4CE 21 7 0 20 Sep 2023
Progressive Text-to-Image Diffusion with Soft Latent Direction Yuteng Ye Jiale Cai Hang Zhou Guanwen Li Youjia Zhang Zikai Song Chenxing Gao Junqing Yu Wei Yang 43 5 0 18 Sep 2023
A 3M-Hybrid Model for the Restoration of Unique Giant Murals: A Case Study on the Murals of Yongle Palace Jing Yang Nur Intan Raihana Ruhaiyem Chichun Zhou 32 1 0 12 Sep 2023
MaskDiffusion: Boosting Text-to-Image Consistency with Conditional Mask Yupeng Zhou Daquan Zhou Zuo-Liang Zhu Yaxing Wang Qibin Hou Jiashi Feng 29 10 0 08 Sep 2023
VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders Xuyang Liu Siteng Huang Yachen Kang Honggang Chen Donglin Wang ObjD 35 12 0 03 Sep 2023
FocalDreamer: Text-driven 3D Editing via Focal-fusion Assembly Yuhan Li Yishun Dou Yue Shi Yulai Lei Xuanhong Chen Yi Zhang Peng Zhou Bingbing Ni 3DGS 30 56 0 21 Aug 2023
O $^2$ -Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model Yubin Hu Sheng Ye Wang Zhao Matthieu Lin Yuze He Yu-Hui Wen Ying He Yong-Jin Liu DiffM 33 4 0 18 Aug 2023
Learning A Coarse-to-Fine Diffusion Transformer for Image Restoration Liyan Wang Qinyu Yang Cong Wang Wen Wang Jin-shan Pan Zhixun Su DiffM 37 2 0 17 Aug 2023
Image Synthesis under Limited Data: A Survey and Taxonomy Mengping Yang Zhe Wang 28 8 0 31 Jul 2023
AnyDoor: Zero-shot Object-level Image Customization Xi Chen Lianghua Huang Yu Liu Yujun Shen Deli Zhao Hengshuang Zhao DiffM 46 257 0 18 Jul 2023