Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models

31 January 2023

Hila Chefer

Yuval Alaluf

Yael Vinker

Lior Wolf

Daniel Cohen-Or

DiffM

ArXiv PDF HTML

Papers citing "Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models"

50 / 404 papers shown

Title
Divide, Evaluate, and Refine: Evaluating and Improving Text-to-Image Alignment with Iterative VQA Feedback Jaskirat Singh Liang Zheng 28 18 0 10 Jul 2023
Counting Guidance for High Fidelity Text-to-Image Synthesis Wonjune Kang Kevin Galim H. Koo Nam Ik Cho DiffM 32 8 0 30 Jun 2023
A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesis Aishwarya Agarwal Srikrishna Karanam K. J. Joseph Apoorv Saxena Koustava Goswami Balaji Vasan Srinivasan VLM DiffM 11 46 0 26 Jun 2023
Text-Anchored Score Composition: Tackling Condition Misalignment in Text-to-Image Diffusion Models Luozhou Wang Guibao Shen Wenhang Ge Guangyong Chen Yijun Li Yingke Chen DiffM 38 4 0 26 Jun 2023
Zero-shot spatial layout conditioning for text-to-image diffusion models Guillaume Couairon Marlene Careil Matthieu Cord Stéphane Lathuilière Jakob Verbeek VLM 16 63 0 23 Jun 2023
Continuous Layout Editing of Single Images with Diffusion Models Zhiyuan Zhang Zhitong Huang J. Liao DiffM 21 10 0 22 Jun 2023
Energy-Based Cross Attention for Bayesian Context Update in Text-to-Image Diffusion Models Geon Yeong Park Jeongsol Kim Beomsu Kim Sang Wan Lee Jong Chul Ye DiffM 19 21 0 16 Jun 2023
Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment Royi Rassin Eran Hirsch Daniel Glickman Shauli Ravfogel Yoav Goldberg Gal Chechik DiffM 42 100 0 15 Jun 2023
Norm-guided latent space exploration for text-to-image generation Dvir Samuel Rami Ben-Ari N. Darshan Haggai Maron Gal Chechik DiffM 29 24 0 14 Jun 2023
Grounded Text-to-Image Synthesis with Attention Refocusing Quynh Phung Songwei Ge Jia-Bin Huang DiffM 25 104 0 08 Jun 2023
Unsupervised Compositional Concepts Discovery with Text-to-Image Generative Models Nan Liu Yilun Du Shuang Li J. Tenenbaum Antonio Torralba DiffM CoGe 8 24 0 08 Jun 2023
WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Models Changhoon Kim Kyle Min Maitreya Patel Sheng Cheng Yezhou Yang WIGM 24 28 0 07 Jun 2023
On the Design Fundamentals of Diffusion Models: A Survey Ziyi Chang G. Koulieris Hubert P. H. Shum DiffM 29 53 0 07 Jun 2023
Stable Diffusion is Unstable Chengbin Du Yanxi Li Zhongwei Qiu Chang Xu DiffM 33 17 0 05 Jun 2023
Discovering Failure Modes of Text-guided Diffusion Models via Adversarial Search Qihao Liu Adam Kortylewski Yutong Bai Song Bai Alan Yuille DiffM 32 12 0 01 Jun 2023
The Hidden Language of Diffusion Models Hila Chefer Oran Lang Mor Geva Volodymyr Polosukhin Assaf Shocher Michal Irani Inbar Mosseri Lior Wolf DiffM 20 26 0 01 Jun 2023
Cones 2: Customizable Image Synthesis with Multiple Subjects Zhiheng Liu Yifei Zhang Yujun Shen Kecheng Zheng Kai Zhu Ruili Feng Yu Liu Deli Zhao Jingren Zhou Yang Cao DiffM 63 80 0 30 May 2023
LayerDiffusion: Layered Controlled Image Editing with Diffusion Models Pengzhi Li Qinxuan Huang Yikang Ding Zhiheng Li DiffM 25 35 0 30 May 2023
Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models Yuchao Gu Xintao Wang Jay Zhangjie Wu Yujun Shi Yunpeng Chen ... Shuning Chang Wei Yu Wu Yixiao Ge Ying Shan Mike Zheng Shou DiffM 43 166 0 29 May 2023
Break-A-Scene: Extracting Multiple Concepts from a Single Image Omri Avrahami Kfir Aberman Ohad Fried Daniel Cohen-Or Dani Lischinski VLM DiffM 30 165 0 25 May 2023
CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusion Guangyao Zhai Evin Pınar Örnek Shun-cheng Wu Yan Di F. Tombari Nassir Navab Benjamin Busam DiffM 32 12 0 25 May 2023
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models Weixi Feng Wanrong Zhu Tsu-jui Fu Varun Jampani Arjun Reddy Akula Xuehai He Sugato Basu Qing Guo William Yang Wang MLLM 27 162 0 24 May 2023
A Neural Space-Time Representation for Text-to-Image Personalization Yuval Alaluf Elad Richardson G. Metzer Daniel Cohen-Or DiffM 28 94 0 24 May 2023
MultiFusion: Fusing Pre-Trained Models for Multi-Lingual, Multi-Modal Image Generation Marco Bellagente Manuel Brack H. Teufel Felix Friedrich Bjorn Deiseroth ... Koen Oostermeijer Andres Felipe Cruz Salinas P. Schramowski Kristian Kersting Samuel Weinbach 36 15 0 24 May 2023
Vision + Language Applications: A Survey Yutong Zhou N. Shimada VLM 30 5 0 24 May 2023
Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models Ruichen Wang Zekang Chen Chen Chen Jiancang Ma H. Lu Xiaodong Lin DiffM 52 65 0 23 May 2023
If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selection Shyamgopal Karthik Karsten Roth Massimiliano Mancini Zeynep Akata 33 20 0 22 May 2023
The CLIP Model is Secretly an Image-to-Prompt Converter Yuxuan Ding Chunna Tian Haoxuan Ding Lingqiao Liu DiffM 22 14 0 22 May 2023
MaGIC: Multi-modality Guided Image Completion Yongsheng Yu Hao Wang Tiejian Luo Hengrui Fan Libo Zhang 11 12 0 19 May 2023
FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention Guangxuan Xiao Tianwei Yin William T. Freeman F. Durand Song Han VGen DiffM 45 238 0 17 May 2023
What You See is What You Read? Improving Text-Image Alignment Evaluation Michal Yarom Yonatan Bitton Soravit Changpinyo Roee Aharoni Jonathan Herzig Oran Lang E. Ofek Idan Szpektor EGVM 51 73 0 17 May 2023
Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models Wenkai Dong Song Xue Xiaoyue Duan Shumin Han DiffM 42 57 0 08 May 2023
Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model Shishi Xiao Suizi Huang Yue Lin Yilin Ye Weizhen Zeng 41 30 0 28 Apr 2023
Generating images of rare concepts using pre-trained diffusion models Dvir Samuel Rami Ben-Ari Simon Raviv N. Darshan Gal Chechik 135 38 0 27 Apr 2023
MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing Ming Cao Xintao Wang Zhongang Qi Ying Shan Xiaohu Qie Yinqiang Zheng DiffM 31 428 0 17 Apr 2023
Expressive Text-to-Image Generation with Rich Text Songwei Ge Taesung Park Jun-Yan Zhu Jia-Bin Huang DiffM 79 79 0 13 Apr 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 18 123 0 11 Apr 2023
Training-Free Layout Control with Cross-Attention Guidance Minghao Chen Iro Laina Andrea Vedaldi DiffM 135 222 0 06 Apr 2023
Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Models Eric Zhang Kai Wang Xingqian Xu Zhangyang Wang Humphrey Shi DiffM 46 173 0 30 Mar 2023
MDP: A Generalized Framework for Text-Guided Image Editing by Manipulating the Diffusion Path Qian Wang Biao Zhang Michael Birsak Peter Wonka DiffM 30 17 0 29 Mar 2023
Vox-E: Text-guided Voxel Editing of 3D Objects Etai Sella Gal Fiebelman Peter Hedman Hadar Averbuch-Elor DiffM 28 73 0 21 Mar 2023
Localizing Object-level Shape Variations with Text-to-Image Diffusion Models Or Patashnik Daniel Garibi Idan Azuri Hadar Averbuch-Elor Daniel Cohen-Or DiffM 34 110 0 20 Mar 2023
SVDiff: Compact Parameter Space for Diffusion Fine-Tuning Ligong Han Yinxiao Li Han Zhang P. Milanfar Dimitris N. Metaxas Feng Yang DiffM 41 269 0 20 Mar 2023
Editing Implicit Assumptions in Text-to-Image Diffusion Models Hadas Orgad Bahjat Kawar Yonatan Belinkov DiffM 28 86 0 14 Mar 2023
Cones: Concept Neurons in Diffusion Models for Customized Generation Zhiheng Liu Ruili Feng Kai Zhu Yifei Zhang Kecheng Zheng Yu Liu Deli Zhao Jingren Zhou Yang Cao DiffM 111 120 0 09 Mar 2023
Is This Loss Informative? Faster Text-to-Image Customization by Tracking Objective Dynamics Anton Voronov Mikhail Khoroshikh Artem Babenko Max Ryabinin 31 6 0 09 Feb 2023
Benchmarking Spatial Relationships in Text-to-Image Generation Tejas Gokhale Hamid Palangi Besmira Nushi Vibhav Vineet Eric Horvitz Ece Kamar Chitta Baral Yezhou Yang EGVM 40 66 0 20 Dec 2022
Versatile Diffusion: Text, Images and Variations All in One Diffusion Model Xingqian Xu Zhangyang Wang Eric Zhang Kai Wang Humphrey Shi DiffM 32 181 0 15 Nov 2022
LAVIS: A Library for Language-Vision Intelligence Dongxu Li Junnan Li Hung Le Guangsen Wang Silvio Savarese S. Hoi VLM 123 51 0 15 Sep 2022
A Survey on Generative Diffusion Model Hanqun Cao Cheng Tan Zhangyang Gao Yilun Xu Guangyong Chen Pheng-Ann Heng Stan Z. Li MedIm 37 206 0 06 Sep 2022