Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, PR China.
IEEE Trans Pattern Anal Mach Intell. 2010 May;32(5):910-24. doi: 10.1109/TPAMI.2009.40.
In this work, we address the problem of performing class-specific unsupervised object segmentation, i.e., automatic segmentation without annotated training images. Object segmentation can be regarded as a special data clustering problem where both class-specific information and local texture/color similarities have to be considered. To this end, we propose a hybrid graph model (HGM) that can make effective use of both symmetric and asymmetric relationship among samples. The vertices of a hybrid graph represent the samples and are connected by directed edges and/or undirected ones, which represent the asymmetric and/or symmetric relationship between them, respectively. When applied to object segmentation, vertices are superpixels, the asymmetric relationship is the conditional dependence of occurrence, and the symmetric relationship is the color/texture similarity. By combining the Markov chain formed by the directed subgraph and the minimal cut of the undirected subgraph, the object boundaries can be determined for each image. Using the HGM, we can conveniently achieve simultaneous segmentation and recognition by integrating both top-down and bottom-up information into a unified process. Experiments on 42 object classes (9,415 images in total) show promising results.
在这项工作中,我们解决了执行特定于类别的无监督目标分割的问题,即无需注释训练图像的自动分割。目标分割可以被视为一个特殊的数据聚类问题,其中必须考虑特定于类别的信息和局部纹理/颜色相似性。为此,我们提出了一种混合图模型(HGM),它可以有效地利用样本之间的对称和非对称关系。混合图的顶点表示样本,通过有向边和/或无向边连接,分别表示它们之间的非对称和/或对称关系。当应用于目标分割时,顶点是超像素,非对称关系是发生的条件依赖性,对称关系是颜色/纹理相似性。通过组合有向子图形成的马尔可夫链和无向子图的最小割,可以为每张图像确定目标边界。使用 HGM,我们可以通过将自上而下和自下而上的信息集成到一个统一的过程中,方便地实现同时分割和识别。在 42 个目标类(共 9415 张图像)上的实验表明了该方法具有良好的效果。