DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Models

19 October 2022

Papers citing "DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Models"

39 / 39 papers shown

Title
Follow the Flow: On Information Flow Across Textual Tokens in Text-to-Image Models Guy Kaplan Michael Toker Yuval Reif Yonatan Belinkov Roy Schwartz DiffM 48 0 0 01 Apr 2025
On Geometrical Properties of Text Token Embeddings for Strong Semantic Binding in Text-to-Image Generation H. Seo Junseo Bang Haechang Lee Joohoon Lee Byung Hyun Lee Se Young Chun 46 0 0 29 Mar 2025
Scaling Down Semantic Leakage: Investigating Associative Bias in Smaller Language Models Veronika Smilga 38 0 0 11 Jan 2025
GRADE: Quantifying Sample Diversity in Text-to-Image Models Royi Rassin Aviv Slobodkin Shauli Ravfogel Yanai Elazar Yoav Goldberg 109 1 0 29 Oct 2024
TextureMeDefect: LLM-based Defect Texture Generation for Railway Components on Mobile Devices Rahatara Ferdousi M. Anwar Hossain Abdulmotaleb El Saddik 21 0 0 07 Oct 2024
Classification-Denoising Networks Louis Thiry Florentin Guth 34 0 0 04 Oct 2024
Inverse Painting: Reconstructing The Painting Process B. Chen Yifan Wang Brian L. Curless Ira Kemelmacher-Shlizerman Steven M. Seitz DiffM 34 1 0 30 Sep 2024
DefectTwin: When LLM Meets Digital Twin for Railway Defect Inspection Rahatara Ferdousi M. Anwar Hossain Chunsheng Yang Abdulmotaleb El Saddik 16 3 0 26 Aug 2024
Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models Hila Gonen Terra Blevins Alisa Liu Luke Zettlemoyer Noah A. Smith 31 5 0 12 Aug 2024
Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space Core Francisco Park Maya Okawa Andrew Lee Ekdeep Singh Lubana Hidenori Tanaka 62 7 0 27 Jun 2024
Make It Count: Text-to-Image Generation with an Accurate Number of Objects Lital Binyamin Yoad Tewel Hilit Segev Eran Hirsch Royi Rassin Gal Chechik 39 7 0 14 Jun 2024
DiffusionPID: Interpreting Diffusion via Partial Information Decomposition Shaurya Dewan Rushikesh Zawar Prakanshul Saxena Yingshan Chang Andrew F. Luo Yonatan Bisk DiffM 49 4 0 07 Jun 2024
Text Guided Image Editing with Automatic Concept Locating and Forgetting Jia Li Lijie Hu Zhixian He Jingfeng Zhang Tianhang Zheng Di Wang DiffM 49 9 0 30 May 2024
Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Images Memoona Aziz Umair Rehman Muhammad Umair Danish Katarina Grolinger EGVM 35 4 0 15 May 2024
Language in Vivo vs. in Silico: Size Matters but Larger Language Models Still Do Not Comprehend Language on a Par with Humans Vittoria Dentella Fritz Guenther Evelina Leivada ELM 49 1 0 23 Apr 2024
Object-Attribute Binding in Text-to-Image Generation: Evaluation and Control Maria Mihaela Truşcǎ Wolf Nuyts Jonathan Thomm Robert Honig Thomas Hofmann Tinne Tuytelaars Marie-Francine Moens 23 2 0 21 Apr 2024
Object-Conditioned Energy-Based Attention Map Alignment in Text-to-Image Diffusion Models Yasi Zhang Peiyu Yu Yingnian Wu DiffM 48 10 0 10 Apr 2024
Human-Centric Aware UAV Trajectory Planning in Search and Rescue Missions Employing Multi-Objective Reinforcement Learning with AHP and Similarity-Based Experience Replay Mahya Ramezani J. L. Sánchez-López 24 6 0 28 Feb 2024
Explicitly Representing Syntax Improves Sentence-to-layout Prediction of Unexpected Situations Wolf Nuyts Ruben Cartuyvels Marie-Francine Moens 51 1 0 25 Jan 2024
Mismatch Quest: Visual and Textual Feedback for Image-Text Misalignment Brian Gordon Yonatan Bitton Yonatan Shafir Roopal Garg Xi Chen Dani Lischinski Daniel Cohen-Or Idan Szpektor 44 11 0 05 Dec 2023
The Quo Vadis of the Relationship between Language and Large Language Models Evelina Leivada Vittoria Dentella Elliot Murphy 30 3 0 17 Oct 2023
Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task Maya Okawa Ekdeep Singh Lubana Robert P. Dick Hidenori Tanaka CoGe DiffM 39 44 0 13 Oct 2023
Exploring Human's Gender Perception and Bias toward Non-Humanoid Robots Mahya Ramezani Jose Luis Sanchez-Lopez 17 0 0 21 Sep 2023
Total Selfie: Generating Full-Body Selfies B. Chen Brian L. Curless Ira Kemelmacher-Shlizerman S. M. Seitz DiffM 36 4 0 28 Aug 2023
Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment Royi Rassin Eran Hirsch Daniel Glickman Shauli Ravfogel Yoav Goldberg Gal Chechik DiffM 45 100 0 15 Jun 2023
The Hidden Language of Diffusion Models Hila Chefer Oran Lang Mor Geva Volodymyr Polosukhin Assaf Shocher Michal Irani Inbar Mosseri Lior Wolf DiffM 20 26 0 01 Jun 2023
Transferring Visual Attributes from Natural Language to Verified Image Generation Rodrigo Valerio João Bordalo Michal Yarom Yonattan Bitton Idan Szpektor João Magalhães 29 5 0 24 May 2023
What You See is What You Read? Improving Text-Image Alignment Evaluation Michal Yarom Yonatan Bitton Soravit Changpinyo Roee Aharoni Jonathan Herzig Oran Lang E. Ofek Idan Szpektor EGVM 57 74 0 17 May 2023
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Information Sunjae Kwon Rishabh Garodia Minhwa Lee Zhichao Yang Hong-ye Yu CoGe 39 4 0 02 May 2023
DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion J. Karras Aleksander Holynski Ting-Chun Wang Ira Kemelmacher-Shlizerman DiffM VGen 35 138 0 12 Apr 2023
Testing AI on language comprehension tasks reveals insensitivity to underlying meaning Vittoria Dentella Fritz Guenther Elliot Murphy G. Marcus Evelina Leivada ELM 40 26 0 23 Feb 2023
Teaching CLIP to Count to Ten Roni Paiss Ariel Ephrat Omer Tov Shiran Zada Inbar Mosseri Michal Irani Tali Dekel VLM CLIP 34 92 0 23 Feb 2023
Affect-Conditioned Image Generation F. Ibarrola R. Lulham Kazjon Grace DiffM 32 3 0 20 Feb 2023
Auditing Gender Presentation Differences in Text-to-Image Models Yanzhe Zhang Lu Jiang Greg Turk Diyi Yang EGVM 27 23 0 07 Feb 2023
When are Lemons Purple? The Concept Association Bias of Vision-Language Models Yutaro Yamada Yingtian Tang Yoyo Zhang Ilker Yildirim CoGe 26 14 0 22 Dec 2022
Schrödinger's Bat: Diffusion Models Sometimes Generate Polysemous Words in Superposition Jennifer C. White Ryan Cotterell DiffM 38 5 0 23 Nov 2022
Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approaches Daniel Fried Nicholas Tomlin Jennifer Hu Roma Patel Aida Nematzadeh 24 6 0 15 Nov 2022
DALL-E 2 Fails to Reliably Capture Common Syntactic Processes Evelina Leivada Elliot Murphy G. Marcus 138 37 0 23 Oct 2022
Underspecification in Scene Description-to-Depiction Tasks Ben Hutchinson Jason Baldridge Vinodkumar Prabhakaran DiffM 71 32 0 11 Oct 2022