College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, China.
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 211106, China.
Comput Biol Med. 2023 Nov;166:107542. doi: 10.1016/j.compbiomed.2023.107542. Epub 2023 Oct 6.
Medical images, especially intricate vascular structures, are costly and time-consuming to annotate manually. It is beneficial to investigate an unsupervised method for vessel segmentation, one that circumvents the manual annotation yet remains valuable for disease detection. In this study, we design an unsupervised retinal vessel segmentation model based on the Swin-Unet framework and game theory. First, we construct two extreme pseudo-mapping functions by changing the contrast of the images and obtain their corresponding pseudo-masks based the on binary segmentation method and mathematical morphology, then we prove that there exists a mapping function between pseudo-mappings such that its corresponding mask is closest to the ground true mask. To acquire the best-predicted mask, based on which, we second develop a model based on the Swin-Unet frame to solve the optimal mapping function, and introduce an Image Colorization proxy task to assist the learning of pixel-level feature representations. Third, since to the instability of two pseudo-masks, the predicted mask will inevitably have errors, inspired by the two-player, non-zero-sum, non-cooperative Neighbor's Collision game in game theory, a game filter is proposed in this paper to reduce the errors in the final predicted mask. Finally, we verify the effectiveness of the presented unsupervised retinal vessel segmentation model on DRIVE, STARE and CHASE_DB1 datasets, and extensive experiments show that has obvious advantages over image segmentation and conventional unsupervised models.
医学图像,特别是复杂的血管结构,手动注释既昂贵又耗时。研究一种无需手动注释的血管分割的无监督方法是有益的,这种方法可以避免手动注释,同时仍然有助于疾病检测。在这项研究中,我们设计了一种基于 Swin-Unet 框架和博弈论的无监督视网膜血管分割模型。首先,我们通过改变图像对比度构建两个极端的伪映射函数,并根据二值分割方法和数学形态学获得它们对应的伪掩码,然后证明存在一个映射函数,其对应的掩码最接近地面真实掩码。为了获得最佳预测掩码,我们基于此,其次开发了一种基于 Swin-Unet 框架的模型来解决最优映射函数,并引入图像着色代理任务来辅助像素级特征表示的学习。第三,由于两个伪掩码的不稳定性,预测掩码不可避免地会有误差,受博弈论中两个玩家、非零和、非合作邻居碰撞游戏的启发,本文提出了一种游戏过滤器,以减少最终预测掩码中的误差。最后,我们在 DRIVE、STARE 和 CHASE_DB1 数据集上验证了所提出的无监督视网膜血管分割模型的有效性,广泛的实验表明,该模型明显优于图像分割和传统的无监督模型。