Department of Obstetrics, Gynecology and Women's Health, Taichung Veterans General Hospital, No. 1650 Sec. 4 Taiwan Blvd. Xitun Dist., Taichung, 407, Taiwan.
Master's Program of Biomedical Infomatics and Biomedical Engineering, Feng Chia University, No. 100 Wenhua Rd. Xitun Dist., Taichung, 407, Taiwan.
BMC Med Inform Decis Mak. 2022 Nov 17;22(1):298. doi: 10.1186/s12911-022-02047-6.
Upon the discovery of ovarian cysts, obstetricians, gynecologists, and ultrasound examiners must address the common clinical challenge of distinguishing between benign and malignant ovarian tumors. Numerous types of ovarian tumors exist, many of which exhibit similar characteristics that increase the ambiguity in clinical diagnosis. Using deep learning technology, we aimed to develop a method that rapidly and accurately assists the different diagnosis of ovarian tumors in ultrasound images.
Based on deep learning method, we used ten well-known convolutional neural network models (e.g., Alexnet, GoogleNet, and ResNet) for training of transfer learning. To ensure method stability and robustness, we repeated the random sampling of the training and validation data ten times. The mean of the ten test results was set as the final assessment data. After the training process was completed, the three models with the highest ratio of calculation accuracy to time required for classification were used for ensemble learning pertaining. Finally, the interpretation results of the ensemble classifier were used as the final results. We also applied ensemble gradient-weighted class activation mapping (Grad-CAM) technology to visualize the decision-making results of the models.
The highest mean accuracy, mean sensitivity, and mean specificity of ten single CNN models were 90.51 ± 4.36%, 89.77 ± 4.16%, and 92.00 ± 5.95%, respectively. The mean accuracy, mean sensitivity, and mean specificity of the ensemble classifier method were 92.15 ± 2.84%, 91.37 ± 3.60%, and 92.92 ± 4.00%, respectively. The performance of the ensemble classifier is better than that of a single classifier in three evaluation metrics. Moreover, the standard deviation is also better which means the ensemble classifier is more stable and robust.
From the comprehensive perspective of data quantity, data diversity, robustness of validation strategy, and overall accuracy, the proposed method outperformed the methods used in previous studies. In future studies, we will continue to increase the number of authenticated images and apply our proposed method in clinical settings to increase its robustness and reliability.
在发现卵巢囊肿后,产科医生、妇科医生和超声检查医师必须应对区分良性和恶性卵巢肿瘤这一常见临床挑战。存在许多种卵巢肿瘤,其中许多肿瘤具有增加临床诊断不确定性的相似特征。我们使用深度学习技术,旨在开发一种可快速准确辅助超声图像中卵巢肿瘤不同诊断的方法。
基于深度学习方法,我们使用了十种著名的卷积神经网络模型(例如,Alexnet、GoogleNet 和 ResNet)进行迁移学习训练。为确保方法的稳定性和鲁棒性,我们对训练和验证数据进行了十次随机抽样。十次测试结果的平均值被设置为最终评估数据。完成训练过程后,使用分类所需计算时间与准确率比值最高的三个模型进行集成学习。最后,将集成分类器的解释结果用作最终结果。我们还应用了集成梯度加权类激活映射(Grad-CAM)技术来可视化模型的决策结果。
十种单 CNN 模型的最高平均准确率、平均敏感度和平均特异性分别为 90.51±4.36%、89.77±4.16%和 92.00±5.95%。集成分类器方法的平均准确率、平均敏感度和平均特异性分别为 92.15±2.84%、91.37±3.60%和 92.92±4.00%。在三个评估指标中,集成分类器方法的性能均优于单一分类器。此外,其标准差也更好,这意味着集成分类器更加稳定和鲁棒。
从数据量、数据多样性、验证策略稳健性和整体准确性的综合角度来看,所提出的方法优于以往研究中使用的方法。在未来的研究中,我们将继续增加经过认证的图像数量,并将我们提出的方法应用于临床实践中,以提高其稳健性和可靠性。