|国家预印本平台
首页|Physically Controllable Relighting of Photographs

Physically Controllable Relighting of Photographs

Physically Controllable Relighting of Photographs

来源:Arxiv_logoArxiv
英文摘要

We present a self-supervised approach to in-the-wild image relighting that enables fully controllable, physically based illumination editing. We achieve this by combining the physical accuracy of traditional rendering with the photorealistic appearance made possible by neural rendering. Our pipeline works by inferring a colored mesh representation of a given scene using monocular estimates of geometry and intrinsic components. This representation allows users to define their desired illumination configuration in 3D. The scene under the new lighting can then be rendered using a path-tracing engine. We send this approximate rendering of the scene through a feed-forward neural renderer to predict the final photorealistic relighting result. We develop a differentiable rendering process to reconstruct in-the-wild scene illumination, enabling self-supervised training of our neural renderer on raw image collections. Our method represents a significant step in bringing the explicit physical control over lights available in typical 3D computer graphics tools, such as Blender, to in-the-wild relighting.

Chris Careaga、Yağız Aksoy

10.1145/3721238.3730666

计算技术、计算机技术

Chris Careaga,Yağız Aksoy.Physically Controllable Relighting of Photographs[EB/OL].(2025-08-07)[2025-08-18].https://arxiv.org/abs/2508.05626.点此复制

评论