I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphors

24 May 2023

Marianna Apidianaki

Smaranda Muresan

DiffM

ArXiv PDF HTML

Papers citing "I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphors"

25 / 25 papers shown

Title
Enhancing multimodal analogical reasoning with Logic Augmented Generation Anna Sofia Lippolis Andrea Giovanni Nuzzolese Aldo Gangemi ReLM LRM 49 0 0 15 Apr 2025
Leveraging Large Models for Evaluating Novel Content: A Case Study on Advertisement Creativity Zhaoyi Joey Hou Adriana Kovashka Xiang Lorraine Li 40 0 0 26 Feb 2025
Creative Blends of Visual Concepts Zhida Sun Z. Zhang Yue Zhang Min Lu Dani Lischinski Daniel Cohen-Or Hui Huang DiffM 36 0 0 22 Feb 2025
Exploring Automated Keyword Mnemonics Generation with Large Language Models via Overgenerate-and-Rank Jaewook Lee Hunter McNichols Andrew S. Lan 16 0 0 21 Sep 2024
Connecting Dreams with Visual Brainstorming Instruction Yasheng Sun Bohan Li Mingchen Zhuge Deng-Ping Fan Salman Khan F. Khan Hideki Koike DiffM 42 0 0 14 Aug 2024
StoryDiffusion: How to Support UX Storyboarding With Generative-AI Zhaohui Liang Xiaoyu Zhang Kevin Ma Zhao Liu Xipei Ren K. Goucher-Lambert Can Liu DiffM 40 6 0 10 Jul 2024
HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing Jing Chen Xinyu Zhu Cheng Yang Chufan Shi Yadong Xi ... Junjie Wang Jiashu Pu Rongsheng Zhang Yujiu Yang Tian Feng 48 6 0 17 Jun 2024
Seeing the Unseen: Visual Metaphor Captioning for Videos Abisek Rajakumar Kalarani Pushpak Bhattacharyya Sumit Shekhar VLM 32 1 0 07 Jun 2024
Generating Harder Cross-document Event Coreference Resolution Datasets using Metaphoric Paraphrasing Shafiuddin Rehan Ahmed Zhiyong Eric Wang George Baker Kevin Stowe James H. Martin 37 2 0 05 Jun 2024
A Survey on Human-AI Teaming with Large Pre-Trained Models Vanshika Vats Marzia Binta Nizam Minghao Liu Ziyuan Wang Richard Ho ... Celeste Shen Rachel Shen Nafisa Hussain Kesav Ravichandran James Davis LM&MA 42 8 0 07 Mar 2024
Learning to Follow Object-Centric Image Editing Instructions Faithfully Tuhin Chakrabarty Kanishk Singh Arkadiy Saakyan Smaranda Muresan DiffM 25 6 0 29 Oct 2023
Impressions: Understanding Visual Semiotics and Aesthetic Impact Julia Kruk Caleb Ziems Diyi Yang 30 2 0 27 Oct 2023
ViPE: Visualise Pretty-much Everything Hassan Shahmohammadi Adhiraj Ghosh Hendrik P. A. Lensch DiffM 28 1 0 16 Oct 2023
Guiding Instruction-based Image Editing via Multimodal Large Language Models Johannes Frey Wenze Hu Xianzhi Du William Yang Wang Yinfei Yang Zhe Gan 40 88 0 29 Sep 2023
ID.8: Co-Creating Visual Stories with Generative AI Victor Nikhil Antony Chien-Ming Huang 41 24 0 25 Sep 2023
MemeCap: A Dataset for Captioning and Interpreting Memes EunJeong Hwang Vered Shwartz VLM 19 34 0 23 May 2023
Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation Wanrong Zhu Xinyi Wang Yujie Lu Tsu-jui Fu Qing Guo Miguel P. Eckstein William Yang Wang 23 4 0 18 May 2023
Multimodal Procedural Planning via Dual Text-Image Prompting Yujie Lu Pan Lu Zhiyu Zoey Chen Wanrong Zhu Qing Guo William Yang Wang LM&Ro 62 43 0 02 May 2023
IRFL: Image Recognition of Figurative Language Ron Yosef Yonatan Bitton Dafna Shahaf 40 18 0 27 Mar 2023
DALL-E 2 Fails to Reliably Capture Common Syntactic Processes Evelina Leivada Elliot Murphy G. Marcus 138 37 0 23 Oct 2022
Underspecification in Scene Description-to-Depiction Tasks Ben Hutchinson Jason Baldridge Vinodkumar Prabhakaran DiffM 68 32 0 11 Oct 2022
FLUTE: Figurative Language Understanding through Textual Explanations Tuhin Chakrabarty Arkadiy Saakyan Debanjan Ghosh Smaranda Muresan 46 66 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 316 11,953 0 04 Mar 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 379 8,495 0 28 Jan 2022
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation Marzena Karpinska Nader Akoury Mohit Iyyer 220 106 0 14 Sep 2021