IEEE Trans Cybern. 2019 Jan;49(1):233-246. doi: 10.1109/TCYB.2017.2771488. Epub 2017 Nov 21.
As a newly emerging and significant topic in computer vision community, co-saliency detection aims at discovering the common salient objects in multiple related images. The existing methods often generate the co-saliency map through a direct forward pipeline which is based on the designed cues or initialization, but lack the refinement-cycle scheme. Moreover, they mainly focus on RGB image and ignore the depth information for RGBD images. In this paper, we propose an iterative RGBD co-saliency framework, which utilizes the existing single saliency maps as the initialization, and generates the final RGBD co-saliency map by using a refinement-cycle model. Three schemes are employed in the proposed RGBD co-saliency framework, which include the addition scheme, deletion scheme, and iteration scheme. The addition scheme is used to highlight the salient regions based on intra-image depth propagation and saliency propagation, while the deletion scheme filters the saliency regions and removes the non-common salient regions based on interimage constraint. The iteration scheme is proposed to obtain more homogeneous and consistent co-saliency map. Furthermore, a novel descriptor, named depth shape prior, is proposed in the addition scheme to introduce the depth information to enhance identification of co-salient objects. The proposed method can effectively exploit any existing 2-D saliency model to work well in RGBD co-saliency scenarios. The experiments on two RGBD co-saliency datasets demonstrate the effectiveness of our proposed framework.
作为计算机视觉领域的一个新兴重要课题,协同显著目标检测旨在发现多个相关图像中的共同显著目标。现有的方法通常通过基于设计线索或初始化的直接正向管道生成协同显著图,但缺乏细化循环方案。此外,它们主要关注 RGB 图像,而忽略了 RGBD 图像的深度信息。在本文中,我们提出了一种迭代 RGBD 协同显著框架,该框架利用现有的单显著图作为初始化,并使用细化循环模型生成最终的 RGBD 协同显著图。所提出的 RGBD 协同显著框架采用了三种方案,包括添加方案、删除方案和迭代方案。添加方案用于基于图像内深度传播和显著传播来突出显著区域,而删除方案则基于图像间约束来过滤显著区域并去除非共同显著区域。迭代方案用于获得更均匀一致的协同显著图。此外,在添加方案中提出了一种新的描述符,称为深度形状先验,以引入深度信息来增强对协同显著目标的识别。所提出的方法可以有效地利用任何现有的 2D 显著模型,在 RGBD 协同显著场景中取得良好的效果。在两个 RGBD 协同显著数据集上的实验证明了所提出框架的有效性。