Hao Jinkui, Liu Jiang, Pereira Ella, Liu Ri, Zhang Jiong, Zhang Yangfan, Yan Kun, Gong Yan, Zheng Jianjun, Zhang Jingfeng, Liu Yonghuai, Zhao Yitian
Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo, China; University of Chinese Academy of Sciences, Beijing, China.
Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China.
Med Image Anal. 2022 Jan;75:102217. doi: 10.1016/j.media.2021.102217. Epub 2021 Nov 3.
Parapneumonic effusion (PPE) is a common condition that causes death in patients hospitalized with pneumonia. Rapid distinction of complicated PPE (CPPE) from uncomplicated PPE (UPPE) in Computed Tomography (CT) scans is of great importance for the management and medical treatment of PPE. However, UPPE and CPPE display similar appearances in CT scans, and it is challenging to distinguish CPPE from UPPE via a single 2D CT image, whether attempted by a human expert, or by any of the existing disease classification approaches. 3D convolutional neural networks (CNNs) can utilize the entire 3D volume for classification: however, they typically suffer from the intrinsic defect of over-fitting. Therefore, it is important to develop a method that not only overcomes the heavy memory and computational requirements of 3D CNNs, but also leverages the 3D information. In this paper, we propose an uncertainty-guided graph attention network (UG-GAT) that can automatically extract and integrate information from all CT slices in a 3D volume for classification into UPPE, CPPE, and normal control cases. Specifically, we frame the distinction of different cases as a graph classification problem. Each individual is represented as a directed graph with a topological structure, where vertices represent the image features of slices, and edges encode the spatial relationship between them. To estimate the contribution of each slice, we first extract the slice representations with uncertainty, using a Bayesian CNN: we then make use of the uncertainty information to weight each slice during the graph prediction phase in order to enable more reliable decision-making. We construct a dataset consisting of 302 chest CT volumetric data from different subjects (99 UPPE, 99 CPPE and 104 normal control cases) in this study, and to the best of our knowledge, this is the first attempt to classify UPPE, CPPE and normal cases using a deep learning method. Extensive experiments show that our approach is lightweight in demands, and outperforms accepted state-of-the-art methods by a large margin. Code is available at https://github.com/iMED-Lab/UG-GAT.
类肺炎性胸腔积液(PPE)是一种常见病症,可导致肺炎住院患者死亡。在计算机断层扫描(CT)中快速区分复杂性PPE(CPPE)和非复杂性PPE(UPPE)对于PPE的管理和治疗至关重要。然而,UPPE和CPPE在CT扫描中表现相似,无论是由人类专家还是通过任何现有的疾病分类方法,仅通过单个二维CT图像区分CPPE和UPPE都具有挑战性。三维卷积神经网络(CNN)可以利用整个三维体积进行分类:然而,它们通常存在过拟合的固有缺陷。因此,开发一种不仅能克服三维CNN对内存和计算的高要求,还能利用三维信息的方法非常重要。在本文中,我们提出了一种不确定性引导的图注意力网络(UG-GAT),它可以自动从三维体积中的所有CT切片中提取和整合信息,以将其分类为UPPE、CPPE和正常对照病例。具体而言,我们将不同病例的区分构建为一个图分类问题。每个个体都表示为具有拓扑结构的有向图,其中顶点代表切片的图像特征,边编码它们之间的空间关系。为了估计每个切片的贡献,我们首先使用贝叶斯CNN提取具有不确定性的切片表示:然后在图预测阶段利用不确定性信息对每个切片进行加权,以便做出更可靠的决策。在本研究中,我们构建了一个由来自不同受试者的302例胸部CT体积数据组成的数据集(99例UPPE、99例CPPE和104例正常对照病例),据我们所知,这是首次尝试使用深度学习方法对UPPE、CPPE和正常病例进行分类。大量实验表明,我们的方法需求轻量级,并且在很大程度上优于公认的现有最先进方法。代码可在https://github.com/iMED-Lab/UG-GAT获取。