Zhang Qi, Liang Yinglu, Zhang Yi, Tao Zihao, Li Rui, Bi Hai
School of Information Technology & Management, University of International Business & Economics, Beijing 100029, China.
Department of Urology, Peking University Third Hospital, Beijing 100191, China.
Int J Med Inform. 2023 Mar;171:104984. doi: 10.1016/j.ijmedinf.2023.104984. Epub 2023 Jan 5.
Artificial intelligence aided tumor segmentation has been applied in various medical scenarios and showed effectiveness in helping physicians observe the potential malignant tissues. However, little research has been conducted for the cystoscopic image segmentation problem.
This paper provided a comprehensive comparison of various attention modules for improving the bladder tumor segmentation performance by utilizing the cystoscopic images from Peking University Third Hospital within 2017-2022. Furthermore, this paper presented an attention mechanism based cystoscopic images segmentation (ACS) model, which was featured by the following points: (1) A mixed attention module including both the channel and spatial attention modules was integrated in the encoder-decoder path, which helped to exploit the global information of the tumor area more effectively. (2) A guidance and fusion attention module was introduced in the skip connection part, facilitating the integration of the high-level semantic features with low-level fine-grained features and the discarding of irrelevant features. (3) An inception attention module was added to enhance the feature expression in the scale of pixel level, so as to better discriminate multi-scale targets.
The proposed ACS model showed obviously better tumor segmentation performance than the compared models, with Dice of 82.7% and MIoU of 69% achieved.
The proposed ACS model achieved significantly better diagnostic performance than the previous bladder tumor segmentation method based on U-Net. Our ACS model is expected to be a useful support tool to assist the tumor segmentation under cystoscopy.
人工智能辅助肿瘤分割已应用于各种医学场景,并在帮助医生观察潜在恶性组织方面显示出有效性。然而,针对膀胱镜图像分割问题的研究较少。
本文利用北京大学第三医院2017 - 2022年的膀胱镜图像,对各种注意力模块进行了全面比较,以提高膀胱肿瘤分割性能。此外,本文提出了一种基于注意力机制的膀胱镜图像分割(ACS)模型,其特点如下:(1)在编码器 - 解码器路径中集成了一个同时包含通道注意力模块和空间注意力模块的混合注意力模块,有助于更有效地利用肿瘤区域的全局信息。(2)在跳跃连接部分引入了引导与融合注意力模块,促进高级语义特征与低级细粒度特征的融合,并摒弃无关特征。(3)添加了一个Inception注意力模块,以增强像素级别的特征表达,从而更好地区分多尺度目标。
所提出的ACS模型在肿瘤分割性能上明显优于比较模型,Dice系数达到82.7%,平均交并比达到69%。
所提出的ACS模型在诊断性能上显著优于先前基于U-Net的膀胱肿瘤分割方法。我们的ACS模型有望成为辅助膀胱镜下肿瘤分割的有用支持工具。