Multimodal Image Synthesis and Editing: The Generative AI Era

27 December 2021

Papers citing "Multimodal Image Synthesis and Editing: The Generative AI Era"

50 / 314 papers shown

Title
Semantic Image Synthesis via Diffusion Models Weilun Wang Weilun Wang Wen-gang Zhou Dongdong Chen Dong Chen Lu Yuan Houqiang Li DiffM 328 178 0 30 Jun 2022
Text-Driven Stylization of Video Objects Sebastian Loeschcke Serge Belongie Sagie Benaim VGen DiffM 64 16 0 24 Jun 2022
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation Jiahui Yu Yuanzhong Xu Jing Yu Koh Thang Luong Gunjan Baid ... Zarana Parekh Xin Li Han Zhang Jason Baldridge Yonghui Wu EGVM 187 1,121 0 22 Jun 2022
Compositional Visual Generation with Composable Diffusion Models Nan Liu Shuang Li Yilun Du Antonio Torralba J. Tenenbaum DiffM CoGe 167 521 0 03 Jun 2022
DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder Jie Shi Chenfei Wu Jian Liang Xiang Liu Nan Duan DiffM 58 26 0 01 Jun 2022
Improved Vector Quantized Diffusion Models Zhicong Tang Shuyang Gu Jianmin Bao Dong Chen Fang Wen DiffM 215 63 0 31 May 2022
EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model Xinya Ji Hang Zhou Kaisiyuan Wang Qianyi Wu Wayne Wu Feng Xu Xun Cao CVBM 83 164 0 30 May 2022
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang ... Raphael Gontijo-Lopes Tim Salimans Jonathan Ho David J Fleet Mohammad Norouzi VLM 428 6,023 0 23 May 2022
CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers Ming Ding Wendi Zheng Wenyi Hong Jie Tang VLM 101 331 0 28 Apr 2022
Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya A. Ramesh Prafulla Dhariwal Alex Nichol Casey Chu Mark Chen VLM DiffM 401 6,866 0 13 Apr 2022
SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image Dejia Xu Yi Ding Peihao Wang Zhiwen Fan Humphrey Shi Zhangyang Wang 95 190 0 02 Apr 2022
InstaFormer: Instance-Aware Image-to-Image Translation with Transformer Soohyun Kim Jongbeom Baek Jihye Park Gyeongnyeon Kim Seung Wook Kim ViT 79 47 0 30 Mar 2022
Towards Implicit Text-Guided 3D Shape Generation Zhengzhe Liu Yi Wang Xiaojuan Qi Chi-Wing Fu 66 92 0 28 Mar 2022
Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors Oran Gafni Adam Polyak Oron Ashual Shelly Sheynin Devi Parikh Yaniv Taigman DiffM 79 521 0 24 Mar 2022
Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memory Lian Siyao Weijiang Yu Tianpei Gu Chunze Lin Quan Wang Chao Qian Chen Change Loy Ziwei Liu SLR 127 192 0 24 Mar 2022
Sem2NeRF: Converting Single-View Semantic Masks to Neural Radiance Fields Yuedong Chen Qianyi Wu Chuanxia Zheng Tat-Jen Cham Jianfei Cai 95 37 0 21 Mar 2022
Autoregressive Image Generation using Residual Quantization Doyup Lee Chiheon Kim Saehoon Kim Minsu Cho Wook-Shin Han VGen 269 361 0 03 Mar 2022
3D-Aware Indoor Scene Synthesis with Depth Priors Zifan Shi Yujun Shen Jiapeng Zhu Dit-Yan Yeung Qifeng Chen GAN MDE 90 36 0 17 Feb 2022
NÜWA-LIP: Language Guided Image Inpainting with Defect-free VQGAN Minheng Ni Chenfei Wu Haoyang Huang Daxin Jiang W. Zuo Nan Duan 57 19 0 10 Feb 2022
MaskGIT: Masked Generative Image Transformer Huiwen Chang Han Zhang Lu Jiang Ce Liu William T. Freeman ViT 153 678 0 08 Feb 2022
Point-NeRF: Point-based Neural Radiance Fields Qiangeng Xu Zexiang Xu Julien Philip Sai Bi Zhixin Shu Kalyan Sunkavalli Ulrich Neumann 3DPC 106 577 0 21 Jan 2022
Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation Xian Liu Yinghao Xu Qianyi Wu Hang Zhou Wayne Wu Bolei Zhou VGen DiffM 3DH 80 142 0 19 Jan 2022
StyleSwin: Transformer-based GAN for High-resolution Image Generation Bo Zhang Shuyang Gu Bo Zhang Jianmin Bao Dong Chen Fang Wen Yong Wang B. Guo ViT 66 229 0 20 Dec 2021
High-Resolution Image Synthesis with Latent Diffusion Models Robin Rombach A. Blattmann Dominik Lorenz Patrick Esser Bjorn Ommer 3DV 422 15,515 0 20 Dec 2021
GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models Alex Nichol Prafulla Dhariwal Aditya A. Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever Mark Chen 341 3,605 0 20 Dec 2021
StyleMC: Multi-Channel Based Fast Text-Guided Image Generation and Manipulation Umut Kocasari Alara Dirik Mert Tiftikci Pinar Yanardag CLIP 64 62 0 15 Dec 2021
Score-Based Generative Modeling with Critically-Damped Langevin Diffusion Tim Dockhorn Arash Vahdat Karsten Kreis DiffM 83 234 0 14 Dec 2021
More Control for Free! Image Synthesis with Semantic Diffusion Guidance Xihui Liu Dong Huk Park S. Azadi Gong Zhang Arman Chopikyan Yuxiao Hu Humphrey Shi Anna Rohrbach Trevor Darrell DiffM 90 256 0 10 Dec 2021
HairCLIP: Design Your Hair by Text and Reference Image Tianyi Wei Dongdong Chen Wenbo Zhou Jing Liao Zhentao Tan Lu Yuan Weiming Zhang Nenghai Yu CLIP 57 109 0 09 Dec 2021
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields Can Wang Menglei Chai Mingming He Dongdong Chen Jing Liao CLIP 106 385 0 09 Dec 2021
Multimodal Conditional Image Synthesis with Product-of-Experts GANs Xun Huang Arun Mallya Ting-Chun Wang Xuan Li DiffM 75 90 0 09 Dec 2021
Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields Dor Verbin Peter Hedman B. Mildenhall Todd E. Zickler Jonathan T. Barron Pratul P. Srinivasan 96 601 0 07 Dec 2021
CG-NeRF: Conditional Generative Neural Radiance Fields Kyungmin Jo Gyumin Shim Sanghun Jung Soyoung Yang Jaegul Choo 50 24 0 07 Dec 2021
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 262 359 0 06 Dec 2021
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning Suzhe Wang Lincheng Li Yueqing Ding Xin Yu CVBM 92 119 0 06 Dec 2021
FuseDream: Training-Free Text-to-Image Generation with Improved CLIP+GAN Space Optimization Xingchao Liu Chengyue Gong Lemeng Wu Shujian Zhang Haoran Su Qiang Liu CLIP 77 91 0 02 Dec 2021
Zero-Shot Text-Guided Object Generation with Dream Fields Ajay Jain B. Mildenhall Jonathan T. Barron Pieter Abbeel Ben Poole 70 565 0 02 Dec 2021
CLIPstyler: Image Style Transfer with a Single Text Condition Gihyun Kwon Jong Chul Ye VLM CLIP 80 244 0 01 Dec 2021
3D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Image Fangzhou Mu Jian Wang Yichen Wu Yin Li DiffM 3DH 73 48 0 30 Nov 2021
FENeRF: Face Editing in Neural Radiance Fields Jingxiang Sun Xuan Wang Yong Zhang Xiaoyu Li Qi Zhang Yebin Liu Jue Wang 3DH CVBM 70 143 0 30 Nov 2021
Vector Quantized Diffusion Model for Text-to-Image Synthesis Shuyang Gu Dong Chen Jianmin Bao Fang Wen Bo Zhang Dongdong Chen Lu Yuan B. Guo DiffM 135 794 0 29 Nov 2021
Blended Diffusion for Text-driven Editing of Natural Images Omri Avrahami Dani Lischinski Ohad Fried DiffM 116 947 0 29 Nov 2021
LAFITE: Towards Language-Free Training for Text-to-Image Generation Yufan Zhou Ruiyi Zhang Changyou Chen Chunyuan Li Chris Tensmeyer Tong Yu Jiuxiang Gu Jinhui Xu Tong Sun VLM 74 168 0 27 Nov 2021
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu Baining Guo ViT 101 243 0 24 Nov 2021
NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion Chenfei Wu Jian Liang Lei Ji Fan Yang Yuejian Fang Daxin Jiang Nan Duan ViT VGen 72 294 0 24 Nov 2021
Neural Fields in Visual Computing and Beyond Yiheng Xie Towaki Takikawa Shunsuke Saito Or Litany Shiqin Yan Numair Khan Federico Tombari James Tompkin Vincent Sitzmann Srinath Sridhar 3DH 169 628 0 22 Nov 2021
Compositional Transformers for Scene Generation Drew A. Hudson C. L. Zitnick ViT 75 34 0 17 Nov 2021
Contrastive Feature Loss for Image Prediction A. Andonian Taesung Park Bryan C. Russell Phillip Isola Jun-Yan Zhu Richard Y. Zhang GAN SSL 78 19 0 12 Nov 2021
Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis Tianchang Shen Jun Gao K. Yin Xuan Li Sanja Fidler 3DV 91 463 0 08 Nov 2021
LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs Christoph Schuhmann Richard Vencu Romain Beaumont R. Kaczmarczyk Clayton Mullis Aarush Katta Theo Coombes J. Jitsev Aran Komatsuzaki VLM MLLM CLIP 229 1,429 0 03 Nov 2021