Department of Electrical and Computer Engineering, Rutgers University, Piscataway, NJ, USA.
Department of Surgery, Rutgers New Jersey Medical School, Newark, NJ, USA.
Int J Comput Assist Radiol Surg. 2021 Feb;16(2):197-206. doi: 10.1007/s11548-020-02305-w. Epub 2021 Jan 9.
Recently, the outbreak of the novel coronavirus disease 2019 (COVID-19) pandemic has seriously endangered human health and life. In fighting against COVID-19, effective diagnosis of infected patient is critical for preventing the spread of diseases. Due to limited availability of test kits, the need for auxiliary diagnostic approach has increased. Recent research has shown radiography of COVID-19 patient, such as CT and X-ray, contains salient information about the COVID-19 virus and could be used as an alternative diagnosis method. Chest X-ray (CXR) due to its faster imaging time, wide availability, low cost, and portability gains much attention and becomes very promising. In order to reduce intra- and inter-observer variability, during radiological assessment, computer-aided diagnostic tools have been used in order to supplement medical decision making and subsequent management. Computational methods with high accuracy and robustness are required for rapid triaging of patients and aiding radiologist in the interpretation of the collected data.
In this study, we design a novel multi-feature convolutional neural network (CNN) architecture for multi-class improved classification of COVID-19 from CXR images. CXR images are enhanced using a local phase-based image enhancement method. The enhanced images, together with the original CXR data, are used as an input to our proposed CNN architecture. Using ablation studies, we show the effectiveness of the enhanced images in improving the diagnostic accuracy. We provide quantitative evaluation on two datasets and qualitative results for visual inspection. Quantitative evaluation is performed on data consisting of 8851 normal (healthy), 6045 pneumonia, and 3323 COVID-19 CXR scans.
In Dataset-1, our model achieves 95.57% average accuracy for a three classes classification, 99% precision, recall, and F1-scores for COVID-19 cases. For Dataset-2, we have obtained 94.44% average accuracy, and 95% precision, recall, and F1-scores for detection of COVID-19.
Our proposed multi-feature-guided CNN achieves improved results compared to single-feature CNN proving the importance of the local phase-based CXR image enhancement. Future work will involve further evaluation of the proposed method on a larger-size COVID-19 dataset as they become available.
最近,新型冠状病毒病 2019(COVID-19)大流行的爆发严重威胁着人类的健康和生命。在与 COVID-19 作斗争中,对感染患者进行有效诊断对于防止疾病传播至关重要。由于检测试剂盒的供应有限,对辅助诊断方法的需求增加了。最近的研究表明,COVID-19 患者的影像学检查,如 CT 和 X 光,包含有关 COVID-19 病毒的重要信息,可作为替代诊断方法。由于成像时间更快、可用性更广、成本更低、便携性更高,胸部 X 光(CXR)受到了更多关注,并且极具应用前景。为了减少观察者内和观察者间的变异性,在放射学评估中,已经使用计算机辅助诊断工具来辅助医学决策和后续管理。需要具有高精度和鲁棒性的计算方法来快速对患者进行分诊,并帮助放射科医生对所收集的数据进行解释。
在这项研究中,我们设计了一种新颖的基于多特征的卷积神经网络(CNN)架构,用于从 CXR 图像中对 COVID-19 进行多类改进分类。使用基于局部相位的图像增强方法增强 CXR 图像。增强后的图像与原始 CXR 数据一起作为我们提出的 CNN 架构的输入。通过消融研究,我们展示了增强图像在提高诊断准确性方面的有效性。我们对两个数据集进行了定量评估,并对视觉检查进行了定性结果展示。定量评估是在包含 8851 例正常(健康)、6045 例肺炎和 3323 例 COVID-19 CXR 扫描的数据上进行的。
在数据集 1 中,我们的模型在三类分类中实现了 95.57%的平均准确率,COVID-19 病例的准确率、召回率和 F1 分数均达到 99%。在数据集 2 中,我们获得了 94.44%的平均准确率,COVID-19 检测的准确率、召回率和 F1 分数均达到 95%。
与仅使用单特征 CNN 相比,我们提出的基于多特征引导的 CNN 取得了更好的结果,证明了基于局部相位的 CXR 图像增强的重要性。未来的工作将涉及在更大规模的 COVID-19 数据集上进一步评估所提出的方法,随着数据集的增加,这些方法将变得更加可用。