IEEE Trans Cybern. 2014 Sep;44(9):1661-72. doi: 10.1109/TCYB.2013.2292054.
Visual saliency is attracting more and more research attention since it is beneficial to many computer vision applications. In this paper, we propose a novel bottom-up saliency model for detecting salient objects in natural images. First, inspired by the recent advance in the realm of statistical thermodynamics, we adopt a novel mathematical model, namely, the maximal entropy random walk (MERW) to measure saliency. We analyze the rationality and superiority of MERW for modeling visual saliency. Then, based on the MERW model, we establish a generic framework for saliency detection. Different from the vast majority of existing saliency models, our method is built on a purely region-based strategy, which is able to yield high-resolution saliency maps with well preserved object shapes and uniformly highlighted salient regions. In the proposed framework, the input image is first over-segmented into superpixels, which are taken as the primary units for subsequent procedures, and regional features are extracted. Then, saliency is measured according to two principles, i.e., uniqueness and visual organization, both implemented in a unified approach, i.e., the MERW model based on graph representation. Intensive experimental results on publicly available datasets demonstrate that our method outperforms the state-of-the-art saliency models.
视觉显著性吸引了越来越多的研究关注,因为它有益于许多计算机视觉应用。在本文中,我们提出了一种新颖的自下而上的显著性模型,用于检测自然图像中的显著对象。首先,受统计热力学领域最新进展的启发,我们采用了一种新颖的数学模型,即最大熵随机游走(MERW)来衡量显著性。我们分析了 MERW 用于建模视觉显著性的合理性和优越性。然后,基于 MERW 模型,我们建立了一个用于显著性检测的通用框架。与绝大多数现有的显著性模型不同,我们的方法基于纯粹的基于区域的策略,能够生成具有良好保留对象形状和均匀突出显著区域的高分辨率显著性图。在提出的框架中,输入图像首先被过度分割成超像素,这些超像素作为后续步骤的主要单元,并提取区域特征。然后,根据两个原则来衡量显著性,即独特性和视觉组织,这两个原则都在一个统一的方法中实现,即基于图表示的 MERW 模型。在公开可用的数据集上进行的大量实验结果表明,我们的方法优于最先进的显著性模型。