IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes

16 June 2022

Rui Zhu

Fatih Porikli

ArXiv (abs)PDF HTML Github (16★)

Papers citing "IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes"

39 / 39 papers shown

Title
ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusion Zitian Zhang Frédéric Fortier-Chouinard Mathieu Garon Anand Bhattad Jean-François Lalonde DiffM 100 4 0 10 Oct 2024
IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Images Zhi-Hao Lin Jia-Bin Huang Zhengqin Li Zhao Dong Christian Richardt Tuotuo Li Michael Zollhöfer Johannes Kopf Shenlong Wang Changil Kim 3DV 84 2 0 23 Jan 2024
Learning Indoor Inverse Rendering with 3D Spatially-Varying Lighting Zian Wang Jonah Philion Sanja Fidler Jan Kautz 3DV 153 82 0 13 Sep 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 447 21,439 0 25 Mar 2021
Vision Transformers for Dense Prediction René Ranftl Alexey Bochkovskiy V. Koltun ViT MDE 136 1,734 0 24 Mar 2021
You Only Group Once: Efficient Point-Cloud Processing with Token Representation and Relation Inference Module Chenfeng Xu Bohan Zhai Bichen Wu Tian Li Wei Zhan Peter Vajda Kurt Keutzer Masayoshi Tomizuka ViT 72 23 0 18 Mar 2021
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang Enze Xie Xiang Li Deng-Ping Fan Kaitao Song Ding Liang Tong Lu Ping Luo Ling Shao ViT 530 3,724 0 24 Feb 2021
UniT: Multimodal Multitask Learning with a Unified Transformer Ronghang Hu Amanpreet Singh ViT 82 300 0 22 Feb 2021
GMLight: Lighting Estimation via Geometric Distribution Approximation Fangneng Zhan Yingchen Yu Changgong Zhang Rongliang Wu Wenbo Hu Shijian Lu Feiying Ma Xuansong Xie Ling Shao 3DV 47 36 0 20 Feb 2021
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet Li-xin Yuan Yunpeng Chen Tao Wang Weihao Yu Yujun Shi Zihang Jiang Francis E. H. Tay Jiashi Feng Shuicheng Yan ViT 133 1,939 0 28 Jan 2021
Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding Mike Roberts Jason Ramapuram Anurag Ranjan Atulit Kumar Miguel Angel Bautista Nathan Paczan Russ Webb Joshua M. Susskind 118 387 0 04 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 657 41,103 0 22 Oct 2020
Shape, Illumination, and Reflectance from Shading Jonathan T. Barron Jitendra Malik 3DV 40 727 0 07 Oct 2020
OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasets Zhengqin Li Ting Yu S. Sang Sarah Wang Meng Song ... Hong-Xing Yu Kalyan Sunkavalli Milovs Havsan R. Ramamoorthi Manmohan Chandraker 3DV 67 85 0 25 Jul 2020
Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data Ning Yu Vladislav Skripniuk Sahar Abdelnabi Mario Fritz WIGM 63 218 0 16 Jul 2020
Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illumination Pratul P. Srinivasan B. Mildenhall Matthew Tancik Jonathan T. Barron Richard Tucker Noah Snavely 3DV 65 94 0 18 Mar 2020
Deep Parametric Indoor Lighting Estimation Marc-André Gardner Yannick Hold-Geoffroy Kalyan Sunkavalli Christian Gagné Jean-François Lalonde 3DPC 3DV 49 131 0 19 Oct 2019
Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer René Ranftl Katrin Lasinger David Hafner Konrad Schindler V. Koltun MDE 204 1,793 0 02 Jul 2019
Fast Spatially-Varying Indoor Lighting Estimation Mathieu Garon Kalyan Sunkavalli Sunil Hadap N. Carr Jean-François Lalonde 59 131 0 10 Jun 2019
Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Image Zhengqin Li Mohammad Shafiei R. Ramamoorthi Kalyan Sunkavalli Manmohan Chandraker 3DV 53 261 0 07 May 2019
DeepLight: Learning Illumination for Unconstrained Mobile Mixed Reality Chloe LeGendre Wan-Chun Ma Graham Fyffe John Flynn Laurent Charbonnel Jay Busch P. Debevec 47 122 0 02 Apr 2019
Neural Inverse Rendering of an Indoor Scene from a Single Image Soumyadip Sengupta Liang Feng Kihwan Kim Guilin Liu David Jacobs Jan Kautz 3DV AI4CE 73 145 0 08 Jan 2019
PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Image Chen Liu Kihwan Kim Liang Feng Yasutaka Furukawa Jan Kautz 3DV 58 221 0 10 Dec 2018
Single-Image SVBRDF Capture with a Rendering-Aware Deep Network Valentin Deschaintre M. Aittala F. Durand G. Drettakis Adrien Bousseau 3DH 51 268 0 23 Oct 2018
CGIntrinsics: Better Intrinsic Image Decomposition through Physically-Based Rendering Zhengqi Li Noah Snavely 77 165 0 26 Aug 2018
Self-Attention Generative Adversarial Networks Han Zhang Ian Goodfellow Dimitris N. Metaxas Augustus Odena GAN 148 3,726 0 21 May 2018
Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image Zhengqin Li Kalyan Sunkavalli Manmohan Chandraker 48 174 0 16 Apr 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 701 131,652 0 12 Jun 2017
Learning to Predict Indoor Illumination from a Single Image Marc-André Gardner Kalyan Sunkavalli Ersin Yumer Xiaohui Shen Emiliano Gambaretto Christian Gagné Jean-François Lalonde 3DV 67 347 0 01 Apr 2017
Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks Yinda Zhang Shuran Song Ersin Yumer Manolis Savva Joon-Young Lee Hailin Jin Thomas Funkhouser AI4CE SSL 3DV 3DPC 54 262 0 22 Dec 2016
Semantic Scene Completion from a Single Depth Image Shuran Song Feng Yu Andy Zeng Angel X. Chang Manolis Savva Thomas Funkhouser 3DV 84 1,243 0 28 Nov 2016
Layer Normalization Jimmy Lei Ba J. Kiros Geoffrey E. Hinton 413 10,494 0 21 Jul 2016
Gaussian Error Linear Units (GELUs) Dan Hendrycks Kevin Gimpel 172 5,011 0 27 Jun 2016
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs Liang-Chieh Chen George Papandreou Iasonas Kokkinos Kevin Patrick Murphy Alan Yuille SSeg 251 18,240 0 02 Jun 2016
Stacked Hourglass Networks for Human Pose Estimation Alejandro Newell Kaiyu Yang Jia Deng 3DH 119 5,032 0 22 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,020 0 10 Dec 2015
Multi-Scale Context Aggregation by Dilated Convolutions Feng Yu V. Koltun SSeg 268 8,446 0 23 Nov 2015
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 1.8K 77,196 0 18 May 2015
Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture David Eigen Rob Fergus VLM MDE 209 2,680 0 18 Nov 2014