Peng Yuanyuan, Zhu Weifang, Chen Zhongyue, Shi Fei, Wang Meng, Zhou Yi, Wang Lianyu, Shen Yuhe, Xiang Daoman, Chen Feng, Chen Xinjian
Analysis and Visualization Lab, School of Electronics and Information Engineering and Medical Image Processing, Soochow University, Suzhou, China.
Guangzhou Women and Children's Medical Center, Guangzhou, China.
Front Neurosci. 2022 Apr 19;16:836327. doi: 10.3389/fnins.2022.836327. eCollection 2022.
Retinopathy of prematurity and ischemic brain injury resulting in periventricular white matter damage are the main causes of visual impairment in premature infants. Accurate optic disc (OD) segmentation has important prognostic significance for the auxiliary diagnosis of the above two diseases of premature infants. Because of the complexity and non-uniform illumination and low contrast between background and the target area of the fundus images, the segmentation of OD for infants is challenging and rarely reported in the literature. In this article, to tackle these problems, we propose a novel attention fusion enhancement network (AFENet) for the accurate segmentation of OD in the fundus images of premature infants by fusing adjacent high-level semantic information and multiscale low-level detailed information from different levels based on encoder-decoder network. Specifically, we first design a dual-scale semantic enhancement (DsSE) module between the encoder and the decoder inspired by self-attention mechanism, which can enhance the semantic contextual information for the decoder by reconstructing skip connection. Then, to reduce the semantic gaps between the high-level and low-level features, a multiscale feature fusion (MsFF) module is developed to fuse multiple features of different levels at the top of encoder by using attention mechanism. Finally, the proposed AFENet was evaluated on the fundus images of preterm infants for OD segmentation, which shows that the proposed two modules are both promising. Based on the baseline (Res34UNet), using DsSE or MsFF module alone can increase Dice similarity coefficients by 1.51 and 1.70%, respectively, whereas the integration of the two modules together can increase 2.11%. Compared with other state-of-the-art segmentation methods, the proposed AFENet achieves a high segmentation performance.
早产儿视网膜病变和缺血性脑损伤导致的脑室周围白质损伤是早产儿视力障碍的主要原因。准确的视盘(OD)分割对于上述两种早产儿疾病的辅助诊断具有重要的预后意义。由于眼底图像背景与目标区域之间光照复杂、不均匀且对比度低,婴儿OD的分割具有挑战性,且在文献中鲜有报道。在本文中,为了解决这些问题,我们基于编码器 - 解码器网络,通过融合不同层次的相邻高层语义信息和多尺度低层细节信息,提出了一种新颖的注意力融合增强网络(AFENet),用于准确分割早产儿眼底图像中的OD。具体而言,我们首先受自注意力机制启发,在编码器和解码器之间设计了一个双尺度语义增强(DsSE)模块,该模块可以通过重构跳跃连接来增强解码器的语义上下文信息。然后,为了减少高层和低层特征之间的语义差距,开发了一个多尺度特征融合(MsFF)模块,通过注意力机制在编码器顶部融合不同层次的多个特征。最后,在所提出的AFENet上对早产儿眼底图像进行OD分割评估,结果表明所提出的两个模块都很有前景。基于基线(Res34UNet),单独使用DsSE或MsFF模块可分别将Dice相似系数提高1.51%和1.70%,而将两个模块结合使用可提高2.11%。与其他先进的分割方法相比,所提出的AFENet具有较高的分割性能。