IEEE Trans Pattern Anal Mach Intell. 2023 Aug;45(8):10129-10142. doi: 10.1109/TPAMI.2023.3244658. Epub 2023 Jun 30.
Recently, many advances in inverse rendering are achieved by high-dimensional lighting representations and differentiable rendering. However, multi-bounce lighting effects can hardly be handled correctly in scene editing using high-dimensional lighting representations, and light source model deviation and ambiguities exist in differentiable rendering methods. These problems limit the applications of inverse rendering. In this paper, we present a multi-bounce inverse rendering method based on Monte Carlo path tracing, to enable correct complex multi-bounce lighting effects rendering in scene editing. We propose a novel light source model that is more suitable for light source editing in indoor scenes, and design a specific neural network with corresponding disambiguation constraints to alleviate ambiguities during the inverse rendering. We evaluate our method on both synthetic and real indoor scenes through virtual object insertion, material editing, relighting tasks, and so on. The results demonstrate that our method achieves better photo-realistic quality.
最近,通过高维光照表示和可微渲染技术,反向渲染取得了许多进展。然而,在使用高维光照表示进行场景编辑时,很难正确处理多次反射光照效果,并且可微渲染方法存在光源模型偏差和歧义。这些问题限制了反向渲染的应用。在本文中,我们提出了一种基于蒙特卡罗路径追踪的多次反射反向渲染方法,以实现在场景编辑中正确渲染复杂的多次反射光照效果。我们提出了一种更适合室内场景光源编辑的新型光源模型,并设计了具有相应去歧义约束的特定神经网络,以减轻反向渲染过程中的歧义。我们通过虚拟物体插入、材质编辑、重光照任务等,在合成和真实室内场景上对我们的方法进行了评估。实验结果表明,我们的方法能够获得更好的照片级真实感质量。