School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan, 454000, PR China.
School of Computer Science and Technology, Henan Polytechnic University, Jiaozuo, Henan, 454000, PR China; School of Architecture Building and Civil Engineering, Loughborough University, Loughborough, LE11 3TU, UK; School of Computing and Mathematical Sciences, University of Leicester, Leicester, LE1 7RH, UK.
Comput Biol Med. 2022 Nov;150:106151. doi: 10.1016/j.compbiomed.2022.106151. Epub 2022 Sep 30.
Corona Virus Disease 2019 (COVID-19) was a lung disease with high mortality and was highly contagious. Early diagnosis of COVID-19 and distinguishing it from pneumonia was beneficial for subsequent treatment.
Recently, Graph Convolutional Network (GCN) has driven a significant contribution to disease diagnosis. However, limited by the nature of the graph convolution algorithm, deep GCN has an over-smoothing problem. Most of the current GCN models are shallow neural networks, which do not exceed five layers. Furthermore, the objective of this study is to develop a novel deep GCN model based on the DenseGCN and the pre-trained model of deep Convolutional Neural Network (CNN) to complete the diagnosis of chest X-ray (CXR) images.
We apply the pre-trained model of deep CNN to perform feature extraction on the data to complete the extraction of pixel-level features in the image. And then, to extract the potential relationship between the obtained features, we propose Neighbourhood Feature Reconstruction Algorithm to reconstruct them into graph-structured data. Finally, we design a deep GCN model that exploits the graph-structured data to diagnose COVID-19 effectively. In the deep GCN model, we propose a Node-Self Convolution Algorithm (NSC) based on feature fusion to construct a deep GCN model called NSCGCN (Node-Self Convolution Graph Convolutional Network).
Experiments were carried out on the Computed Tomography (CT) and CXR datasets. The results on the CT dataset confirmed that: compared with the six state-of-the-art (SOTA) shallow GCN models, the accuracy and sensitivity of the proposed NSCGCN had improve 8% as sensitivity (Sen.) = 87.50%, F1 score = 97.37%, precision (Pre.) = 89.10%, accuracy (Acc.) = 97.50%, area under the ROC curve (AUC) = 97.09%. Moreover, the results on the CXR dataset confirmed that: compared with the fourteen SOTA GCN models, sixteen SOTA CNN transfer learning models and eight SOTA COVID-19 diagnosis methods on the COVID-19 dataset. Our proposed method had best performances as Sen. = 96.45%, F1 score = 96.45%, Pre. = 96.61%, Acc. = 96.45%, AUC = 99.22%.
Our proposed NSCGCN model is effective and performed better than the thirty-eight SOTA methods. Thus, the proposed NSC could help build deep GCN models. Our proposed COVID-19 diagnosis method based on the NSCGCN model could help radiologists detect pneumonia from CXR images and distinguish COVID-19 from Ordinary Pneumonia (OPN). The source code of this work will be publicly available at https://github.com/TangChaosheng/NSCGCN.
2019 年冠状病毒病(COVID-19)是一种高死亡率的肺部疾病,具有高度传染性。早期诊断 COVID-19 并将其与肺炎区分开来,有利于后续治疗。
最近,图卷积网络(GCN)在疾病诊断方面做出了重大贡献。然而,受图卷积算法性质的限制,深度 GCN 存在过平滑问题。目前大多数 GCN 模型都是浅层神经网络,不超过五层。此外,本研究的目的是开发一种基于 DenseGCN 和深度卷积神经网络(CNN)预训练模型的新型深度 GCN 模型,以完成对胸部 X 射线(CXR)图像的诊断。
我们应用深度 CNN 的预训练模型对数据进行特征提取,以完成图像中像素级特征的提取。然后,为了提取获得的特征之间的潜在关系,我们提出了邻域特征重建算法将它们重建为图结构数据。最后,我们设计了一个深度 GCN 模型,利用图结构数据有效地诊断 COVID-19。在深度 GCN 模型中,我们提出了一种基于特征融合的节点自卷积算法(NSC),构建了一种称为 NSCGCN(节点自卷积图卷积网络)的深度 GCN 模型。
在 CT 和 CXR 数据集上进行了实验。在 CT 数据集上的结果证实,与六个最先进的(SOTA)浅层 GCN 模型相比,所提出的 NSCGCN 在灵敏度(Sen.)提高了 8%,达到 87.50%,F1 得分(F1 score)为 97.37%,精度(Pre.)为 89.10%,准确率(Acc.)为 97.50%,ROC 曲线下面积(AUC)为 97.09%。此外,在 CXR 数据集上的结果证实,与 14 个 SOTA GCN 模型、16 个 SOTA CNN 迁移学习模型和 8 个 SOTA COVID-19 诊断方法在 COVID-19 数据集上的结果相比,我们的方法具有最佳性能,灵敏度(Sen.)为 96.45%,F1 得分(F1 score)为 96.45%,精度(Pre.)为 96.61%,准确率(Acc.)为 96.45%,AUC 为 99.22%。
我们提出的 NSCGCN 模型是有效的,性能优于 38 种 SOTA 方法。因此,所提出的 NSC 可以帮助构建深度 GCN 模型。我们提出的基于 NSCGCN 模型的 COVID-19 诊断方法可以帮助放射科医生从 CXR 图像中检测肺炎,并将 COVID-19 与普通肺炎(OPN)区分开来。本工作的源代码将在 https://github.com/TangChaosheng/NSCGCN 上公开。