DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation

25 August 2022

Nataniel Ruiz

Yuanzhen Li

Varun Jampani

Yael Pritch

Michael Rubinstein

Kfir Aberman

ArXiv PDF HTML

Papers citing "DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation"

50 / 2,074 papers shown

Title
Few-shot Domain-Adaptive Visually-fused Event Detection from Text Farhad Moghimifar Fatemeh Shiri Van Nguyen Gholamreza Haffari Yuanyou Li VLM 38 2 0 04 May 2023
Key-Locked Rank One Editing for Text-to-Image Personalization Yoad Tewel Rinon Gal Gal Chechik Yuval Atzmon DiffM 146 168 0 02 May 2023
DreamPaint: Few-Shot Inpainting of E-Commerce Items for Virtual Try-On without 3D Modeling M. S. Seyfioglu Karim Bouyarmane Suren Kumar A. Tavanaei Ismail B. Tutar DiffM 53 4 0 02 May 2023
In-Context Learning Unlocked for Diffusion Models Zhendong Wang Yi Ding Yadong Lu Yelong Shen Pengcheng He Weizhu Chen Zhangyang Wang Mingyuan Zhou VLM DiffM 94 68 0 01 May 2023
Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model Shishi Xiao Suizi Huang Yue Lin Yilin Ye Weizhen Zeng 41 32 0 28 Apr 2023
Generating images of rare concepts using pre-trained diffusion models Dvir Samuel Rami Ben-Ari Simon Raviv N. Darshan Gal Chechik 135 38 0 27 Apr 2023
Motion-Conditioned Diffusion Model for Controllable Video Synthesis Tsai-Shien Chen C. Lin Hung-Yu Tseng Nayeon Lee Ming-Hsuan Yang DiffM VGen 81 62 0 27 Apr 2023
Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images Zeyu Lu Di Huang Lei Bai Jingjing Qu Chengzhi Wu Xihui Liu Wanli Ouyang 26 53 0 25 Apr 2023
Exploring Compositional Visual Generation with Latent Classifier Guidance Changhao Shi Haomiao Ni Kaican Li Shaobo Han Mingfu Liang Martin Renqiang Min DiffM 37 9 0 25 Apr 2023
Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Models Zhendong Wang Yi Ding Huangjie Zheng Peihao Wang Pengcheng He Zhangyang Wang Weizhu Chen Mingyuan Zhou 38 99 0 25 Apr 2023
Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation Zeyu Lu Chengyue Wu Xinyuan Chen Yaohui Wang Junlin Wu Yu Qiao Xihui Liu DiffM 31 16 0 24 Apr 2023
Speed Is All You Need: On-Device Acceleration of Large Diffusion Models via GPU-Aware Optimizations Yu-Hui Chen Raman Sarokin Juhyun Lee Jiuqiang Tang Chuo-Ling Chang Andrei Kulik Matthias Grundmann VLM 45 38 0 21 Apr 2023
Building Multimodal AI Chatbots Mingyu Lee 29 3 0 21 Apr 2023
Collaborative Diffusion for Multi-Modal Face Generation and Editing Ziqi Huang Kelvin C. K. Chan Yuming Jiang Ziwei Liu DiffM 52 103 0 20 Apr 2023
Image retrieval outperforms diffusion models on data augmentation Max F. Burg F. Wenzel Dominik Zietlow Max Horn Osama Makansi Francesco Locatello Chris Russell VLM DiffM 55 16 0 20 Apr 2023
UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer Soon Yau Cheong A. Mustafa Andrew Gilbert DiffM 25 13 0 18 Apr 2023
Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models A. Blattmann Robin Rombach Huan Ling Tim Dockhorn Seung Wook Kim Sanja Fidler Karsten Kreis 3DGS VGen 144 1,019 0 18 Apr 2023
MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing Ming Cao Xintao Wang Zhongang Qi Ying Shan Xiaohu Qie Yinqiang Zheng DiffM 42 432 0 17 Apr 2023
Identity Encoder for Personalized Diffusion Yu-Chuan Su Kelvin C. K. Chan Yandong Li Yang Zhao Han-Ying Zhang Boqing Gong Haoran Wang Xuhui Jia DiffM 37 7 0 14 Apr 2023
Text-Conditional Contextualized Avatars For Zero-Shot Personalization S. Azadi Thomas Hayes Akbar Shah Guan Pang Devi Parikh Sonal Gupta DiffM 21 4 0 14 Apr 2023
Delta Denoising Score Amir Hertz Kfir Aberman Daniel Cohen-Or DiffM 40 90 0 14 Apr 2023
One-Shot Stylization for Full-Body Human Images Aiyu Cui Svetlana Lazebnik 3DH 29 0 0 14 Apr 2023
Expressive Text-to-Image Generation with Rich Text Songwei Ge Taesung Park Jun-Yan Zhu Jia-Bin Huang DiffM 79 79 0 13 Apr 2023
DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning Enze Xie Lewei Yao Han Shi Zhili Liu Daquan Zhou Zhaoqiang Liu Jiawei Li Zhenguo Li 34 77 0 13 Apr 2023
PATMAT: Person Aware Tuning of Mask-Aware Transformer for Face Inpainting Saman Motamed Jianjin Xu Chenhuan Wu Fernando de la Torre DiffM 25 3 0 12 Apr 2023
Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA James Smith Yen-Chang Hsu Lingyu Zhang Ting Hua Z. Kira Yilin Shen Hongxia Jin DiffM 134 97 0 12 Apr 2023
DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion J. Karras Aleksander Holynski Ting-Chun Wang Ira Kemelmacher-Shlizerman DiffM VGen 35 138 0 12 Apr 2023
Gradient-Free Textual Inversion Zhengcong Fei Mingyuan Fan Junshi Huang DiffM 38 31 0 12 Apr 2023
NeAT: Neural Artistic Tracing for Beautiful Style Transfer Dan Ruta Andrew Gilbert John Collomosse Eli Shechtman Nicholas I. Kolkin 3DH 29 3 0 11 Apr 2023
EKILA: Synthetic Media Provenance and Attribution for Generative Art Kar Balan S. Agarwal Simon Jenni Andy Parsons Andrew Gilbert John Collomosse 30 12 0 10 Apr 2023
Defense-Prefix for Preventing Typographic Attacks on CLIP Hiroki Azuma Yusuke Matsui VLM AAML 20 17 0 10 Apr 2023
Towards Real-time Text-driven Image Manipulation with Unconditional Diffusion Models Nikita Starodubcev Dmitry Baranchuk Valentin Khrulkov Artem Babenko DiffM 49 4 0 10 Apr 2023
InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuning Jing Shi Wei Xiong Zhe Lin H. J. Jung DiffM 133 281 0 06 Apr 2023
Training-Free Layout Control with Cross-Attention Guidance Minghao Chen Iro Laina Andrea Vedaldi DiffM 135 223 0 06 Apr 2023
Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Models Xuhui Jia Yang Zhao Kelvin C. K. Chan Yandong Li Han-Ying Zhang Boqing Gong Tingbo Hou Haoran Wang Yu-Chuan Su DiffM 29 100 0 05 Apr 2023
Few-shot Semantic Image Synthesis with Class Affinity Transfer Marlene Careil Jakob Verbeek Stéphane Lathuilière DiffM 32 4 0 05 Apr 2023
JPEG Compressed Images Can Bypass Protections Against AI Editing Pedro Sandoval-Segura Jonas Geiping Tom Goldstein DiffM 26 10 0 05 Apr 2023
Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generation Mayu Otani Riku Togashi Yu Sawai Ryosuke Ishigami Yuta Nakashima Esa Rahtu J. Heikkilä Shiníchi Satoh 38 64 0 04 Apr 2023
The Work Avatar Face-Off: Knowledge Worker Preferences for Realism in Meetings Vrushank Phadnis Kristin Moore Mar Gonzalez-Franco CVBM 13 5 0 03 Apr 2023
DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models Yukang Cao Yan-Pei Cao Kai Han Ying Shan Kwan-Yee K. Wong DiffM 26 137 0 03 Apr 2023
Subject-driven Text-to-Image Generation via Apprenticeship Learning Wenhu Chen Hexiang Hu Yandong Li Nataniel Rui Xuhui Jia Ming-Wei Chang William W. Cohen DiffM 27 187 0 01 Apr 2023
A Closer Look at Parameter-Efficient Tuning in Diffusion Models Chendong Xiang Fan Bao Chongxuan Li Hang Su Jun Zhu DiffM 14 16 0 31 Mar 2023
One-shot Unsupervised Domain Adaptation with Personalized Diffusion Models Yasser Benigmim Subhankar Roy S. Essid Vicky Kalogeiton Stéphane Lathuilière DiffM 53 28 0 31 Mar 2023
Reference-based Image Composition with Sketch via Structure-aware Diffusion Model Kangyeol Kim S. Park Junsoo Lee Jaegul Choo DiffM 16 12 0 31 Mar 2023
Zero-Shot Video Editing Using Off-The-Shelf Image Diffusion Models Wen Wang Yan Jiang K. Xie Zide Liu Hao Chen Yue Cao Xinlong Wang Chunhua Shen DiffM VGen 34 112 0 30 Mar 2023
Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models Eric Zhang Kai Wang Xingqian Xu Zhangyang Wang Humphrey Shi DiffM 51 175 0 30 Mar 2023
PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor Vidit Goel E. Peruzzo Yi Ding Dejia Xu Xingqian Xu N. Sebe Trevor Darrell Zhangyang Wang Humphrey Shi DiffM 30 6 0 30 Mar 2023
Discriminative Class Tokens for Text-to-Image Diffusion Models Idan Schwartz Vésteinn Snaebjarnarson Hila Chefer Ryan Cotterell Serge Belongie Lior Wolf Sagie Benaim 33 9 0 30 Mar 2023
DiffCollage: Parallel Generation of Large Content with Diffusion Models Qinsheng Zhang Jiaming Song Xun Huang Yongxin Chen Xuan Li DiffM 31 82 0 30 Mar 2023
Bi-directional Training for Composed Image Retrieval via Text Prompt Learning Zheyuan Liu Weixuan Sun Yicong Hong Damien Teney Stephen Gould 40 30 0 29 Mar 2023