Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering

18 October 2020

Antonio Torralba

Sanja Fidler

DRL

ArXiv PDF HTML

Papers citing "Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Rendering"

36 / 36 papers shown

Title
SpaceMesh: A Continuous Representation for Learning Manifold Surface Meshes Tianchang Shen Zheng Li Marc Law Matan Atzmon Sanja Fidler James Lucas Jun Gao Nicholas Sharp 3DH 49 4 0 30 Sep 2024
UrbanIR: Large-Scale Urban Scene Inverse Rendering from a Single Video Zhi-Hao Lin Bohan Liu Yi-Ting Chen David A. Forsyth Jia-Bin Huang Jia-Bin Huang Anand Bhattad Shenlong Wang VGen 47 10 0 15 Jun 2023
Learning Deformable Tetrahedral Meshes for 3D Reconstruction Jun Gao Wenzheng Chen Tommy Xiang Clement Fuji-Tsang Alec Jacobson M. McGuire Sanja Fidler 71 107 0 03 Nov 2020
InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs Yujun Shen Ceyuan Yang Xiaoou Tang Bolei Zhou GAN CVBM 49 596 0 18 May 2020
GANSpace: Discovering Interpretable GAN Controls Erik Härkönen Aaron Hertzmann J. Lehtinen Sylvain Paris 84 900 0 06 Apr 2020
StyleRig: Rigging StyleGAN for 3D Control over Portrait Images A. Tewari Mohamed A. Elgharib Gaurav Bharaj Florian Bernard Hans-Peter Seidel P. Pérez Michael Zollhöfer Christian Theobalt 3DH 100 408 0 31 Mar 2020
Self-supervised Single-view 3D Reconstruction via Semantic Consistency Xueting Li Sifei Liu Kihwan Kim Shalini De Mello Varun Jampani Ming-Hsuan Yang Jan Kautz 3DV 36 148 0 13 Mar 2020
High-Fidelity Synthesis with Disentangled Representation Wonkwang Lee Donggyun Kim Seunghoon Hong Honglak Lee DRL 40 66 0 13 Jan 2020
Analyzing and Improving the Image Quality of StyleGAN Tero Karras S. Laine M. Aittala Janne Hellsten J. Lehtinen Timo Aila GAN 245 5,769 0 03 Dec 2019
Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wild Shangzhe Wu Christian Rupprecht Andrea Vedaldi OCL 61 310 0 25 Nov 2019
Self-supervised Learning of 3D Objects from Natural Images Hiroharu Kato Tatsuya Harada 34 7 0 20 Nov 2019
Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Research Krishna Murthy Jatavallabhula Edward James Smith Jean-Francois Lafleche Clement Fuji-Tsang Artem Rozantsev Wenzheng Chen Tommy Xiang Rev Lebaredian Sanja Fidler 3DPC AI4CE 48 126 0 12 Nov 2019
Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer Wenzheng Chen Jun Gao Huan Ling Edward James Smith J. Lehtinen Alec Jacobson Sanja Fidler 3DH 3DV 44 362 0 03 Aug 2019
InfoGAN-CR and ModelCentrality: Self-supervised Model Training and Selection for Disentangling GANs Zinan Lin K. K. Thekumparampil Giulia Fanti Sewoong Oh DRL 45 37 0 14 Jun 2019
Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations Vincent Sitzmann Michael Zollhoefer Gordon Wetzstein 3DPC 3DV 126 1,274 0 04 Jun 2019
DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstruction Qiangeng Xu Weiyue Wang Duygu Ceylan R. Měch Ulrich Neumann 3DH 3DV 82 562 0 26 May 2019
Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? Rameen Abdal Yipeng Qin Peter Wonka GAN 86 1,109 0 05 Apr 2019
Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning Shichen Liu Tianye Li Weikai Chen Hao Li 3DV 63 691 0 03 Apr 2019
Pix2Vex: Image-to-Geometry Reconstruction using a Smooth Differentiable Renderer Felix Petersen Amit H. Bermano Oliver Deussen Daniel Cohen-Or 3DV 25 55 0 26 Mar 2019
DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation Jeong Joon Park Peter R. Florence Julian Straub Richard Newcombe S. Lovegrove 3DV 73 3,654 0 16 Jan 2019
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 477 10,466 0 12 Dec 2018
Occupancy Networks: Learning 3D Reconstruction in Function Space L. Mescheder Michael Oechsle Michael Niemeyer Sebastian Nowozin Andreas Geiger 3DV 209 2,875 0 10 Dec 2018
Visual Object Networks: Image Generation with Disentangled 3D Representation Jun-Yan Zhu Zhoutong Zhang Chengkai Zhang Jiajun Wu Antonio Torralba J. Tenenbaum Bill Freeman DRL CoGe OCL 54 252 0 06 Dec 2018
3D-Aware Scene Manipulation via Inverse Graphics Shunyu Yao T. Hsu Jun-Yan Zhu Jiajun Wu Antonio Torralba William T. Freeman J. Tenenbaum 3DPC 3DV 32 86 0 28 Aug 2018
Learning to Generate and Reconstruct 3D Meshes with only 2D Supervision Paul Henderson Vittorio Ferrari 3DV 33 81 0 24 Jul 2018
Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images Nanyang Wang Yinda Zhang Zhuwen Li Yanwei Fu Wen Liu Yu-Gang Jiang 3DV 67 1,323 0 05 Apr 2018
Learning Category-Specific Mesh Reconstruction from Image Collections Angjoo Kanazawa Shubham Tulsiani Alexei A. Efros Jitendra Malik 3DV 39 605 0 20 Mar 2018
Neural 3D Mesh Renderer Hiroharu Kato Yoshitaka Ushiku Tatsuya Harada 3DV 55 1,042 0 20 Nov 2017
Mask R-CNN Kaiming He Georgia Gkioxari Piotr Dollár Ross B. Girshick ObjD 227 27,018 0 20 Mar 2017
Learning to Generate Images of Outdoor Scenes from Attributes and Semantic Layouts Levent Karacan Zeynep Akata Aykut Erdem Erkut Erdem GAN 47 186 0 01 Dec 2016
Invertible Conditional GANs for image editing Guim Perarnau Joost van de Weijer Bogdan Raducanu J. Álvarez GAN 63 648 0 19 Nov 2016
InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets Xi Chen Yan Duan Rein Houthooft John Schulman Ilya Sutskever Pieter Abbeel GAN 123 4,224 0 12 Jun 2016
Generative Adversarial Text to Image Synthesis Scott E. Reed Zeynep Akata Xinchen Yan Lajanugen Logeswaran Bernt Schiele Honglak Lee GAN 113 3,136 0 17 May 2016
3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction Chris Choy Danfei Xu JunYoung Gwak Kevin Chen Silvio Savarese 3DV 49 1,710 0 02 Apr 2016
ShapeNet: An Information-Rich 3D Model Repository Angel X. Chang Thomas Funkhouser Leonidas Guibas Pat Hanrahan Qi-Xing Huang ... Shuran Song Hao Su Jianxiong Xiao L. Yi Feng Yu 3DV 49 5,482 0 09 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 418 149,474 0 22 Dec 2014