CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoders

28 June 2021

Papers citing "CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoders"

34 / 134 papers shown

Title
Towards Real-Time Text2Video via CLIP-Guided, Pixel-Level Optimization Peter Schaldenbrand Zhixuan Liu Jean Oh CLIP 27 0 0 23 Oct 2022
FRIDA: A Collaborative Robot Painter with a Differentiable, Real2Sim2Real Planning Environment Peter Schaldenbrand James McCann Jean Oh 30 27 0 03 Oct 2022
Draw Your Art Dream: Diverse Digital Art Synthesis with Multimodal Guided Diffusion Nisha Huang Fan Tang Weiming Dong Changsheng Xu DiffM 93 40 0 27 Sep 2022
A Collaborative, Interactive and Context-Aware Drawing Agent for Co-Creative Design F. Ibarrola Tomas Lawton Kazjon Grace 45 13 0 26 Sep 2022
StoryDALL-E: Adapting Pretrained Text-to-Image Transformers for Story Continuation A. Maharana Darryl Hannan Joey Tianyi Zhou DiffM 37 78 0 13 Sep 2022
Text-Driven Stylization of Video Objects Sebastian Loeschcke Serge Belongie Sagie Benaim VGen DiffM 30 16 0 24 Jun 2022
CLIP-Actor: Text-Driven Recommendation and Stylization for Animating Human Meshes Youwang Kim Ji-Yeon Kim Tae-Hyun Oh 3DH CLIP 36 48 0 09 Jun 2022
Covariance Matrix Adaptation MAP-Annealing Matthew C. Fontaine Stefanos Nikolaidis 48 25 0 22 May 2022
AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars Fangzhou Hong Mingyuan Zhang Liang Pan Zhongang Cai Lei Yang Ziwei Liu CLIP 98 79 0 17 May 2022
Conditional Vector Graphics Generation for Music Cover Images V. Efimova Ivan Jarsky Ilya Bizyaev Andrey Filchenkov GAN 27 3 0 15 May 2022
Can Foundation Models Perform Zero-Shot Task Specification For Robot Manipulation? Yuchen Cui S. Niekum Abhi Gupta Vikash Kumar Aravind Rajeswaran LM&Ro 30 74 0 23 Apr 2022
VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance Katherine Crowson Stella Biderman Daniel Kornis Dashiell Stander Eric Hallahan Louis Castricato Edward Raff CLIP 78 369 0 18 Apr 2022
Text2LIVE: Text-Driven Layered Image and Video Editing Omer Bar-Tal Dolev Ofri-Amar Rafail Fridman Yoni Kasten Tali Dekel VGen DiffM 16 308 0 05 Apr 2022
Learning to generate line drawings that convey geometry and semantics Caroline Chan F. Durand Phillip Isola GAN 31 89 0 23 Mar 2022
MotionCLIP: Exposing Human Motion Generation to CLIP Space Guy Tevet Brian Gordon Amir Hertz Amit H. Bermano Daniel Cohen-Or CLIP 39 325 0 15 Mar 2022
FlexIT: Towards Flexible Semantic Image Translation Guillaume Couairon Asya Grechka Jakob Verbeek Holger Schwenk Matthieu Cord DiffM 50 35 0 09 Mar 2022
CLIP-GEN: Language-Free Training of a Text-to-Image Generator with CLIP Zihao Wang Wei Liu Qian He Xin-ru Wu Zili Yi CLIP VLM 204 73 0 01 Mar 2022
StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translation Peter Schaldenbrand Zhixuan Liu Jean Oh CLIP 35 44 0 24 Feb 2022
CLIPasso: Semantically-Aware Object Sketching Yael Vinker Ehsan Pajouheshgar Jessica Y. Bo Roman Bachmann Amit H. Bermano Daniel Cohen-Or Amir Zamir Ariel Shamir 32 77 0 11 Feb 2022
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 152 14,738 0 20 Dec 2021
Intelli-Paint: Towards Developing Human-like Painting Agents Jaskirat Singh Cameron Smith J. Echevarria Liang Zheng 22 9 0 16 Dec 2021
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 226 353 0 06 Dec 2021
Zero-Shot Text-Guided Object Generation with Dream Fields Ajay Jain B. Mildenhall Jonathan T. Barron Pieter Abbeel Ben Poole 49 561 0 02 Dec 2021
CLIPstyler: Image Style Transfer with a Single Text Condition Gihyun Kwon Jong Chul Ye VLM CLIP 44 240 0 01 Dec 2021
Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model Zipeng Xu Tianwei Lin Hao Tang Fu Li Dongliang He N. Sebe Radu Timofte Luc Van Gool Errui Ding EGVM 38 41 0 26 Nov 2021
Simple but Effective: CLIP Embeddings for Embodied AI Apoorv Khandelwal Luca Weihs Roozbeh Mottaghi Aniruddha Kembhavi VLM LM&Ro 47 218 0 18 Nov 2021
StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Synthesis Peter Schaldenbrand Zhixuan Liu Jean Oh CLIP 11 20 0 04 Nov 2021
Telling Creative Stories Using Generative Visual Aids Safinah Ali Devi Parikh 21 12 0 27 Oct 2021
CLOOB: Modern Hopfield Networks with InfoLOOB Outperform CLIP Andreas Fürst Elisabeth Rumetshofer Johannes Lehner Viet-Hung Tran Fei Tang ... David P. Kreil Michael K Kopp Günter Klambauer Angela Bitto-Nemling Sepp Hochreiter VLM CLIP 209 102 0 21 Oct 2021
Shared Visual Representations of Drawing for Communication: How do different biases affect human interpretability and intent? Daniela Mihai Jonathon S. Hare FAtt 21 0 0 15 Oct 2021
CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation Aditya Sanghi Hang Chu Joseph G. Lambourne Ye Wang Chin-Yi Cheng Marco Fumero Kamal Rahimi Malekshan CLIP 57 289 0 06 Oct 2021
Modern Evolution Strategies for Creativity: Fitting Concrete Images and Abstract Concepts Yingtao Tian David R Ha 65 43 0 18 Sep 2021
Differentiable Quality Diversity Matthew C. Fontaine Stefanos Nikolaidis 51 89 0 07 Jun 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,805 0 24 Feb 2021