IEEE Trans Pattern Anal Mach Intell. 2018 Mar;40(3):653-666. doi: 10.1109/TPAMI.2017.2686857. Epub 2017 Mar 23.
Superpixels are perceptually meaningful atomic regions that can effectively capture image features. Among various methods for computing uniform superpixels, simple linear iterative clustering (SLIC) is popular due to its simplicity and high performance. In this paper, we extend SLIC to compute content-sensitive superpixels, i.e., small superpixels in content-dense regions with high intensity or colour variation and large superpixels in content-sparse regions. Rather than using the conventional SLIC method that clusters pixels in , we map the input image to a 2-dimensional manifold , whose area elements are a good measure of the content density in . We propose a simple method, called intrinsic manifold SLIC (IMSLIC), for computing a geodesic centroidal Voronoi tessellation (GCVT)-a uniform tessellation-on , which induces the content-sensitive superpixels in . In contrast to the existing algorithms, IMSLIC characterizes the content sensitivity by measuring areas of Voronoi cells on . Using a simple and fast approximation to a closed-form solution, the method can compute the GCVT at a very low cost and guarantees that all Voronoi cells are simply connected. We thoroughly evaluate IMSLIC and compare it with eleven representative methods on the BSDS500 dataset and seven representative methods on the NYUV2 dataset. Computational results show that IMSLIC outperforms existing methods in terms of commonly used quality measures pertaining to superpixels such as compactness, adherence to boundaries, and achievable segmentation accuracy. We also evaluate IMSLIC and seven representative methods in an image contour closure application, and the results on two datasets, WHD and WSD, show that IMSLIC achieves the best foreground segmentation performance.
超像素是具有感知意义的原子区域,可以有效地捕获图像特征。在计算均匀超像素的各种方法中,由于其简单性和高性能,简单线性迭代聚类 (SLIC) 很受欢迎。在本文中,我们将 SLIC 扩展到计算内容敏感的超像素,即在内容密集区域具有高强度或颜色变化的小超像素和内容稀疏区域的大超像素。我们不是使用传统的 SLIC 方法对像素进行聚类,而是将输入图像映射到二维流形 ,其面积元素是 中内容密度的良好度量。我们提出了一种简单的方法,称为内在流形 SLIC(IMSLIC),用于计算测地线重心 Voronoi 细分(GCVT)-一种在 上的均匀细分,这会在 中产生内容敏感的超像素。与现有算法相比,IMSLIC 通过测量 上的 Voronoi 细胞的面积来描述内容敏感性。该方法使用对闭式解的简单快速逼近,可以以非常低的成本计算 GCVT,并保证所有 Voronoi 细胞都是简单连通的。我们对 IMSLIC 进行了全面评估,并在 BSDS500 数据集上的 11 种代表性方法和 NYUV2 数据集上的 7 种代表性方法上对其进行了比较。计算结果表明,在与超像素相关的常用质量度量方面,如紧凑性、边界贴合度和可实现的分割精度,IMSLIC 优于现有方法。我们还在图像轮廓闭合应用程序中评估了 IMSLIC 和七种代表性方法,在 WHD 和 WSD 两个数据集上的结果表明,IMSLIC 实现了最佳的前景分割性能。