LightIt: Illumination Modeling and Control for Diffusion Models

15 March 2024

Peter Kocsis

Julien Philip

Kalyan Sunkavalli

Matthias Nießner

Yannick Hold-Geoffroy

ArXiv PDF HTML

Papers citing "LightIt: Illumination Modeling and Control for Diffusion Models"

22 / 22 papers shown

Title
LightLab: Controlling Light Sources in Images with Diffusion Models Nadav Magar Amir Hertz Eric Tabellion Yael Pritch Alex Rav Acha Ariel Shamir Yedid Hoshen 24 0 0 14 May 2025
IntrinsicEdit: Precise generative image manipulation in intrinsic space Linjie Lyu Valentin Deschaintre Yannick Hold-Geoffroy Miloš Hašan Jae Shin Yoon Thomas Leimkuhler C. Theobalt Iliyan Georgiev DiffM 28 0 0 13 May 2025
IntrinsiX: High-Quality PBR Generation using Image Priors Peter Kocsis Lukas Höllein Matthias Nießner 39 0 0 01 Apr 2025
Exploring the Evolution of Physics Cognition in Video Generation: A Survey Minghui Lin Xiang Wang Y. Wang Shu Wang Fengqi Dai ... Cunxiang Wang Zhengrong Zuo Nong Sang Siteng Huang Donglin Wang EGVM VGen 87 3 0 27 Mar 2025
Parametric Shadow Control for Portrait Generation in Text-to-Image Diffusion Models Haoming Cai Tsung-Wei Huang Shiv Gehlot Brandon Yushan Feng Sachin Shah Guan-Ming Su Christopher A. Metzler DiffM 38 0 0 27 Mar 2025
LBM: Latent Bridge Matching for Fast Image-to-Image Translation Clement Chadebec O. Tasar Sanjeev Sreetharan Benjamin Aubin 37 0 0 10 Mar 2025
MatSwap: Light-aware material transfers in images Ivan Lopes Valentin Deschaintre Yannick Hold-Geoffroy Raoul de Charette DiffM 84 0 0 11 Feb 2025
GenLit: Reformulating Single-Image Relighting as Video Generation Shrisha Bharadwaj Haiwen Feng Victoria Fernandez-Abrevaya Michael J. Black VGen 77 2 0 15 Dec 2024
MLI-NeRF: Multi-Light Intrinsic-Aware Neural Radiance Fields Yixiong Yang Shilin Hu Haoyu Wu Ramón Baldrich Dimitris Samaras M. Vanrell 70 0 0 26 Nov 2024
Boosting 3D Object Generation through PBR Materials Yitong Wang Xudong Xu Li Ma H. Wang Bo Dai 76 3 0 25 Nov 2024
ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusion Zitian Zhang Frédéric Fortier-Chouinard Mathieu Garon Anand Bhattad Jean-François Lalonde DiffM 34 4 0 10 Oct 2024
Conditional Image Synthesis with Diffusion Models: A Survey Zheyuan Zhan Defang Chen Jian-Ping Mei Zhenghe Zhao Jiawei Chen Chun Chen Siwei Lyu Can Wang VLM 42 5 0 28 Sep 2024
Retinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theory Xiaoyan Xing Vincent Tao Hu J. H. Metzen Konrad Groh Sezer Karaoglu Theo Gevers 34 4 0 29 Jul 2024
Learning Relighting and Intrinsic Decomposition in Neural Radiance Fields Yixiong Yang Shilin Hu Haoyu Wu Ramón Baldrich Dimitris Samaras M. Vanrell 24 0 0 16 Jun 2024
IllumiNeRF: 3D Relighting without Inverse Rendering Xiaoming Zhao Pratul P. Srinivasan Dor Verbin Keunhong Park Ricardo Martín Brualla Philipp Henzler 28 5 0 10 Jun 2024
Latent Intrinsics Emerge from Training to Relight Xiao Zhang William Gao Seemandhar Jain Michael Maire David.A.Forsyth Anand Bhattad 42 3 0 31 May 2024
Diffusion Model-Based Image Editing: A Survey Yi Huang Jiancheng Huang Yifan Liu Mingfu Yan Jiaxi Lv Jianzhuang Liu Wei Xiong He Zhang Liangliang Cao Liangliang Cao EGVM 66 85 0 27 Feb 2024
Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenes Zian Wang Tianchang Shen Jun Gao S. Huang Jacob Munkberg J. Hasselgren Zan Gojcic Wenzheng Chen Sanja Fidler AI4CE 99 86 0 06 Apr 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 270 4,229 0 30 Jan 2023
On the detection of synthetic images generated by diffusion models Riccardo Corvi D. Cozzolino Giada Zingarini Giovanni Poggi Koki Nagano L. Verdoliva 130 218 0 01 Nov 2022
A Style-Based Generator Architecture for Generative Adversarial Networks Tero Karras S. Laine Timo Aila 279 10,354 0 12 Dec 2018
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 212 19,447 0 21 Nov 2016