Chikontwe Philip, Luna Miguel, Kang Myeongkyun, Hong Kyung Soo, Ahn June Hong, Park Sang Hyun
Department of Robotics Engineering, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Daegu, South Korea.
Division of Pulmonology and Allergy, Department of Internal Medicine, Regional Center for Respiratory Diseases, Yeungnam University Medical Center, College of Medicine, Yeungnam University, Daegu, Korea.
Med Image Anal. 2021 Aug;72:102105. doi: 10.1016/j.media.2021.102105. Epub 2021 May 24.
Chest computed tomography (CT) based analysis and diagnosis of the Coronavirus Disease 2019 (COVID-19) plays a key role in combating the outbreak of the pandemic that has rapidly spread worldwide. To date, the disease has infected more than 18 million people with over 690k deaths reported. Reverse transcription polymerase chain reaction (RT-PCR) is the current gold standard for clinical diagnosis but may produce false positives; thus, chest CT based diagnosis is considered more viable. However, accurate screening is challenging due to the difficulty in annotation of infected areas, curation of large datasets, and the slight discrepancies between COVID-19 and other viral pneumonia. In this study, we propose an attention-based end-to-end weakly supervised framework for the rapid diagnosis of COVID-19 and bacterial pneumonia based on multiple instance learning (MIL). We further incorporate unsupervised contrastive learning for improved accuracy with attention applied both in spatial and latent contexts, herein we propose Dual Attention Contrastive based MIL (DA-CMIL). DA-CMIL takes as input several patient CT slices (considered as bag of instances) and outputs a single label. Attention based pooling is applied to implicitly select key slices in the latent space, whereas spatial attention learns slice spatial context for interpretable diagnosis. A contrastive loss is applied at the instance level to encode similarity of features from the same patient against representative pooled patient features. Empirical results show that our algorithm achieves an overall accuracy of 98.6% and an AUC of 98.4%. Moreover, ablation studies show the benefit of contrastive learning with MIL.
基于胸部计算机断层扫描(CT)对2019冠状病毒病(COVID-19)进行分析和诊断,在抗击这场迅速在全球蔓延的大流行病爆发中发挥着关键作用。截至目前,该疾病已感染超过1800万人,报告死亡人数超过69万。逆转录聚合酶链反应(RT-PCR)是目前临床诊断的金标准,但可能会产生假阳性;因此,基于胸部CT的诊断被认为更可行。然而,由于感染区域标注困难、大型数据集管理以及COVID-19与其他病毒性肺炎之间存在细微差异,准确筛查具有挑战性。在本研究中,我们提出了一种基于注意力的端到端弱监督框架,用于基于多实例学习(MIL)快速诊断COVID-19和细菌性肺炎。我们进一步纳入无监督对比学习以提高准确性,在空间和潜在上下文中都应用了注意力,在此我们提出基于双注意力对比的MIL(DA-CMIL)。DA-CMIL将多个患者CT切片(视为实例包)作为输入,并输出单个标签。基于注意力的池化用于在潜在空间中隐式选择关键切片,而空间注意力学习切片空间上下文以进行可解释的诊断。在实例级别应用对比损失,以编码来自同一患者的特征与代表性池化患者特征之间的相似性。实证结果表明,我们的算法总体准确率达到98.6%,AUC为98.4%。此外,消融研究表明了对比学习与MIL相结合的好处。