Yan Tao, Gao Jiahui, Xu Ke, Zhu Xiangjie, Huang Hao, Li Helong, Wah Benjamin, Lau Rynson W H
IEEE Trans Pattern Anal Mach Intell. 2025 Jan;47(1):323-337. doi: 10.1109/TPAMI.2024.3463490. Epub 2024 Dec 4.
Ghosting effects typically appear on glass surfaces, as each piece of glass has two contact surfaces causing two slightly offset layers of reflections. In this paper, we propose to take advantage of this intrinsic property of glass surfaces and apply it to glass surface detection, with two main technical novelties. First, we formulate a ghosting image formation model to describe the intensity and spatial relations among the main reflections and the background transmission within the glass region. Based on this model, we construct a new Glass Surface Ghosting Dataset (GSGD) to facilitate glass surface detection, with glass images and corresponding ghosting masks and glass surface masks. Second, we propose a novel method, called GhostingNet, for glass surface detection. Our method consists of a Ghosting Effects Detection (GED) module and a Glass Surface Detection (GSD) module. The key component of our GED module is a novel Double Reflection Estimation (DRE) block that models the spatial offsets of reflection layers for ghosting effect detection. The detected ghosting effects are then used to guide the GSD module for glass surface detection. Extensive experiments demonstrate that our method outperforms the state-of-the-art methods. We will release our code and dataset.
重影效应通常出现在玻璃表面，因为每块玻璃都有两个接触面，会产生两个略有偏移的反射层。在本文中，我们建议利用玻璃表面的这种固有特性，并将其应用于玻璃表面检测，有两个主要的技术创新点。首先，我们制定了一个重影图像形成模型，以描述玻璃区域内主要反射和背景透射之间的强度和空间关系。基于此模型，我们构建了一个新的玻璃表面重影数据集（GSGD），以促进玻璃表面检测，其中包括玻璃图像以及相应的重影掩码和玻璃表面掩码。其次，我们提出了一种名为GhostingNet的新颖方法用于玻璃表面检测。我们的方法由一个重影效应检测（GED）模块和一个玻璃表面检测（GSD）模块组成。我们GED模块的关键组件是一个新颖的双反射估计（DRE）块，它对用于重影效应检测的反射层的空间偏移进行建模。然后，将检测到的重影效应用于指导GSD模块进行玻璃表面检测。大量实验表明，我们的方法优于现有方法。我们将发布我们的代码和数据集。
