Wang Miao, Zhou Jin-Chao, Feng Wei-Qi, Jiang Yu-Zhu, Serrano Ana
IEEE Trans Vis Comput Graph. 2024 Sep;30(9):6468-6480. doi: 10.1109/TVCG.2023.3347560. Epub 2024 Jul 31.
Understanding and modeling perceived properties of sky-dome illumination is an important but challenging problem due to the interplay of several factors such as the materials and geometries of the objects present in the scene being observed. Existing models of sky-dome illumination focus on the physical properties of the sky. However, these parametric models often do not align well with the properties perceived by a human observer. In this work, drawing inspiration from the Hosek-Wilkie sky-dome model, we investigate the perceptual properties of outdoor illumination. For this purpose, we perform a large-scale user study via crowdsourcing to collect a dataset of perceived illumination properties (scattering, glare, and brightness) for different combinations of geometries and materials under a variety of outdoor illuminations, totaling 5,000 distinct images. We perform a thorough statistical analysis of the collected data which reveals several interesting effects. For instance, our analysis shows that when there are objects in the scene made of rough materials, the perceived scattering of the sky increases. Furthermore, we utilize our extensive collection of images and their corresponding perceptual attributes to train a predictor. This predictor, when provided with a single image as input, generates an estimation of perceived illumination properties that align with human perceptual judgments. Accurately estimating perceived illumination properties can greatly enhance the overall quality of integrating virtual objects into real scene photographs. Consequently, we showcase various applications of our predictor. For instance, we demonstrate its utility as a luminance editing tool for showcasing virtual objects in outdoor scenes.
理解并建模天空穹顶光照的感知属性是一个重要但具有挑战性的问题,这是由于多种因素相互作用所致,比如被观察场景中存在的物体的材质和几何形状。现有的天空穹顶光照模型聚焦于天空的物理属性。然而,这些参数模型往往与人类观察者所感知的属性不太相符。在这项工作中,我们从霍塞克-威尔基天空穹顶模型中汲取灵感,研究户外光照的感知属性。为此,我们通过众包进行了一项大规模用户研究,以收集在各种户外光照条件下,不同几何形状和材质组合的感知光照属性(散射、眩光和亮度)的数据集,总共5000张不同的图像。我们对收集到的数据进行了全面的统计分析,揭示了一些有趣的效应。例如,我们的分析表明,当场景中有由粗糙材料制成的物体时,天空的感知散射会增加。此外,我们利用大量收集的图像及其相应的感知属性来训练一个预测器。当这个预测器以单张图像作为输入时,它会生成与人类感知判断相符的感知光照属性估计值。准确估计感知光照属性可以极大地提高将虚拟物体融入真实场景照片的整体质量。因此,我们展示了预测器的各种应用。例如,我们展示了它作为一种亮度编辑工具在户外场景中展示虚拟物体的效用。