Peng Yuanyuan, Chen Zhongyue, Zhu Weifang, Shi Fei, Wang Meng, Zhou Yi, Xiang Daoman, Chen Xinjian, Chen Feng
MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China.
Guangzhou Women and Children's Medical Center, Guangzhou 510623, China.
Biomed Opt Express. 2022 Mar 9;13(4):1968-1984. doi: 10.1364/BOE.447224. eCollection 2022 Apr 1.
Retinopathy of prematurity (ROP) is an eye disease, which affects prematurely born infants with low birth weight and is one of the main causes of children's blindness globally. In recent years, there are many studies on automatic ROP diagnosis, mainly focusing on ROP screening such as "Yes/No ROP" or "Mild/Severe ROP" and presence/absence detection of "plus disease". Due to the lack of corresponding high-quality annotations, there are few studies on ROP zoning, which is one of the important indicators to evaluate the severity of ROP. Moreover, how to effectively utilize the unlabeled data to train model is also worth studying. Therefore, we propose a novel semi-supervised feature calibration adversarial learning network (SSFC-ALN) for 3-level ROP zoning, which consists of two subnetworks: a generative network and a compound network. The generative network is a U-shape network for producing the reconstructed images and its output is taken as one of the inputs of the compound network. The compound network is obtained by extending a common classification network with a discriminator, introducing adversarial mechanism into the whole training process. Because the definition of ROP tells us where and what to focus on in the fundus images, which is similar to the attention mechanism. Therefore, to further improve classification performance, a new attention mechanism based feature calibration module (FCM) is designed and embedded in the compound network. The proposed method was evaluated on 1013 fundus images of 108 patients with 3-fold cross validation strategy. Compared with other state-of-the-art classification methods, the proposed method achieves high classification performance.
早产儿视网膜病变(ROP)是一种眼病,影响低体重早产儿,是全球儿童失明的主要原因之一。近年来,有许多关于ROP自动诊断的研究,主要集中在ROP筛查,如“是否患有ROP”或“轻度/重度ROP”以及“plus病”的有无检测。由于缺乏相应的高质量标注,关于ROP分区的研究很少,而ROP分区是评估ROP严重程度的重要指标之一。此外,如何有效利用未标记数据训练模型也值得研究。因此,我们提出了一种用于三级ROP分区的新型半监督特征校准对抗学习网络(SSFC-ALN),它由两个子网络组成:一个生成网络和一个复合网络。生成网络是一个用于生成重建图像的U形网络,其输出作为复合网络的输入之一。复合网络是通过用一个判别器扩展一个普通分类网络得到的,在整个训练过程中引入了对抗机制。因为ROP的定义告诉我们在眼底图像中关注的位置和内容,这类似于注意力机制。因此,为了进一步提高分类性能,设计了一种基于注意力机制的新特征校准模块(FCM)并嵌入到复合网络中。所提出的方法采用3折交叉验证策略在108例患者的1013张眼底图像上进行了评估。与其他现有分类方法相比,该方法取得了较高的分类性能。