v1v2v3 (latest)

DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models

8 February 2022

ArXiv (abs)PDF HTML Github (140★)

Papers citing "DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models"

38 / 38 papers shown

Title
CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics Shravan Nayak Mehar Bhatia Xiaofeng Zhang Verena Rieser Lisa Anne Hendricks Sjoerd van Steenkiste Yash Goyal Karolina Stañczak Aishwarya Agrawal EGVM 27 0 0 10 Jun 2025
CuRe: Cultural Gaps in the Long Tail of Text-to-Image Systems Aniket Rege Zinnia Nie Mahesh Ramesh Unmesh Raskar Zhuoran Yu Aditya Kusupati Yong Jae Lee Ramya Korlakai Vinayak 28 0 0 09 Jun 2025
Hidden Bias in the Machine: Stereotypes in Text-to-Image Models Sedat Porikli Vedat Porikli 20 0 0 09 Jun 2025
Speaking images. A novel framework for the automated self-description of artworks Valentine Bernasconi Gustavo Marfia VGen 15 0 0 28 May 2025
Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunities Wei Wei Jintao Guo Shanshan Zhao Minghao Fu Lunhao Duan ... Guo-Hua Wang Qing-Guo Chen Zhao Xu Weihua Luo Kaifu Zhang DiffM 317 1 0 05 May 2025
The Amazon Nova Family of Models: Technical Report and Model Card Amazon AGI Aaron Langford A. Shah Abhanshu Gupta Abhimanyu Bhatter ... Benjamin Biggs Benjamin Ott Bhanu Vinzamuri Bharath Venkatesh Bhavana Ganesh 26 21 0 17 Mar 2025
Exploring Bias in over 100 Text-to-Image Generative Models Jordan Vice Naveed Akhtar Leonid Sigal Ajmal Mian EGVM 114 4 0 11 Mar 2025
FoREST: Frame of Reference Evaluation in Spatial Reasoning Tasks Tanawan Premsri Parisa Kordjamshidi 110 1 0 25 Feb 2025
Culture-TRIP: Culturally-Aware Text-to-Image Generation with Iterative Prompt Refinement Suchae Jeong Inseong Choi Youngsik Yun Jihie Kim DiffM 133 2 0 24 Feb 2025
T2ISafety: Benchmark for Assessing Fairness, Toxicity, and Privacy in Image Generation Lijun Li Zhelun Shi Xuhao Hu Bowen Dong Yiran Qin Xihui Liu Lu Sheng Jing Shao 150 2 0 21 Feb 2025
FairT2I: Mitigating Social Bias in Text-to-Image Generation via Large Language Model-Assisted Detection and Attribute Rebalancing Jinya Sakurai Issei Sato 153 1 0 06 Feb 2025
MJ-VIDEO: Fine-Grained Benchmarking and Rewarding Video Preferences in Video Generation Haibo Tong Zhaoyang Wang Zhe Chen Haonian Ji Shi Qiu ... Peng Xia Mingyu Ding Rafael Rafailov Chelsea Finn Huaxiu Yao EGVM VGen 280 4 0 03 Feb 2025
DebiasPI: Inference-time Debiasing by Prompt Iteration of a Text-to-Image Generative Model Sarah Bonna Yu-Cheng Huang Ekaterina Novozhilova Sejin Paik Zhengyang Shan ... Jialin Yu Nupur Divekar Deepti Ghadiyaram Derry Wijaya Margrit Betke 88 0 0 28 Jan 2025
Do Existing Testing Tools Really Uncover Gender Bias in Text-to-Image Models? Yunbo Lyu Zhou Yang Ye Liu Jing Jiang David Lo 136 1 0 28 Jan 2025
INFELM: In-depth Fairness Evaluation of Large Text-To-Image Models Di Jin Xing Liu Yu Liu Jia Qing Yap Andrea Wong Adriana Crespo Qi Lin Zhiyuan Yin Qiang Yan Ryan Ye EGVM VLM 500 0 0 10 Jan 2025
Ethical-Lens: Curbing Malicious Usages of Open-Source Text-to-Image Models Yuzhu Cai Sheng Yin Yuxi Wei Chenxin Xu Weibo Mao Felix Juefei Xu Siheng Chen Yanfeng Wang EGVM 200 3 0 03 Jan 2025
Constructing Fair Latent Space for Intersection of Fairness and Explainability Hyungjun Joo Hyeonggeun Han Sehwan Kim Sangwoo Hong Jungwoo Lee 112 0 0 23 Dec 2024
Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention Maps Jeeyung Kim Erfan Esmaeili Qiang Qiu DiffM 137 1 0 21 Nov 2024
On the Fairness, Diversity and Reliability of Text-to-Image Generative Models Jordan Vice Naveed Akhtar Leonid Sigal Richard Hartley Ajmal Mian EGVM 142 0 0 21 Nov 2024
Safety Without Semantic Disruptions: Editing-free Safe Image Generation via Context-preserving Dual Latent Reconstruction Jordan Vice Naveed Akhtar Leonid Sigal Ajmal Mian Ajmal Mian DiffM 156 0 0 21 Nov 2024
Zero-Shot Automatic Annotation and Instance Segmentation using LLM-Generated Datasets: Eliminating Field Imaging and Manual Annotation for Deep Learning Model Development Ranjan Sapkota Achyut Paudel Manoj Karkee SyDa 188 6 0 18 Nov 2024
A Review of Fairness and A Practical Guide to Selecting Context-Appropriate Fairness Metrics in Machine Learning Caleb J. S. Barr Olivia Erdelyi Paul D. Docherty Randolph C. Grace FaML 204 0 0 10 Nov 2024
On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models Tariq Berrada Ifriqi Pietro Astolfi Melissa Hall Reyhane Askari Hemmat Yohann Benchetrit ... Matthew Muckley Karteek Alahari Adriana Romero Soriano Jakob Verbeek M. Drozdzal AI4CE VLM 139 4 0 05 Nov 2024
Evaluating Semantic Variation in Text-to-Image Synthesis: A Causal Perspective Xiangru Zhu Penglei Sun Yaoxian Song Yanghua Xiao Zhixu Li Chengyu Wang Jun Huang Bei Yang Xiaoxiao Xu EGVM 514 2 0 14 Oct 2024
Is What You Ask For What You Get? Investigating Concept Associations in Text-to-Image Models Salma Abdel Magid Weiwei Pan Simon Warchol Grace Guo Junsik Kim Mahia Rahman Hanspeter Pfister 191 0 0 06 Oct 2024
Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step Wenxuan Wang Kuiyi Gao Zihan Jia Youliang Yuan Jen-tse Huang S. Wang Wenxiang Jiao Zhaopeng Tu 386 3 0 04 Oct 2024
Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects Awal Ahmed Fime Saifuddin Mahmud Arpita Das Md. Sunzidul Islam Hong-Hoon Kim VGen 3DV 46 1 0 14 Sep 2024
REVISION: Rendering Tools Enable Spatial Fidelity in Vision-Language Models Agneet Chatterjee Yiran Luo Tejas Gokhale Yezhou Yang Chitta Baral LRM 101 5 0 05 Aug 2024
DOCCI: Descriptions of Connected and Contrasting Images Yasumasa Onoe Sunayana Rane Zachary Berger Yonatan Bitton Jaemin Cho ... Zarana Parekh Jordi Pont-Tuset Garrett Tanzer Su Wang Jason Baldridge 119 63 0 30 Apr 2024
Revisiting Text-to-Image Evaluation with Gecko: On Metrics, Prompts, and Human Ratings Olivia Wiles Chuhan Zhang Isabela Albuquerque Ivana Kajić Su Wang ... Jordi Pont-Tuset Aida Nematzadeh Anant Nawalgaria Jordi Pont-Tuset Aida Nematzadeh EGVM 261 22 0 25 Apr 2024
Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions Leena Mathur Paul Pu Liang Louis-Philippe Morency LLMAG 83 11 0 17 Apr 2024
Confidence-aware Reward Optimization for Fine-tuning Text-to-Image Models Kyuyoung Kim Jongheon Jeong Minyong An Mohammad Ghavamzadeh Krishnamurthy Dvijotham Jinwoo Shin Kimin Lee EGVM 81 6 0 02 Apr 2024
SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data Jialu Li Jaemin Cho Yi-Lin Sung Jaehong Yoon Mohit Bansal MoMe DiffM 103 9 0 11 Mar 2024
Multilingual Text-to-Image Generation Magnifies Gender Stereotypes and Prompt Engineering May Not Help You Felix Friedrich Katharina Hämmerl P. Schramowski Manuel Brack Jindrich Libovický Kristian Kersting Alexander Fraser EGVM 157 14 0 29 Jan 2024
Language Agents for Detecting Implicit Stereotypes in Text-to-image Models at Scale Qichao Wang Tian Bian Yian Yin Tingyang Xu Hong Cheng Helen M. Meng Zibin Zheng Liang Chen Bingzhe Wu VLM DiffM 60 3 0 18 Oct 2023
LayoutGPT: Compositional Visual Planning and Generation with Large Language Models Weixi Feng Wanrong Zhu Tsu-Jui Fu Varun Jampani Arjun Reddy Akula Xuehai He Sugato Basu Xinze Wang William Yang Wang MLLM 125 180 0 24 May 2023
Social Biases through the Text-to-Image Generation Lens Ranjita Naik Besmira Nushi 180 128 0 30 Mar 2023
Semantic Object Accuracy for Generative Text-to-Image Synthesis Tobias Hinz Stefan Heinrich S. Wermter EGVM 143 159 0 29 Oct 2019