College of Computer Science and Engineering, Northeastern University, Shenyang, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China.
College of Computer Science and Engineering, Northeastern University, Shenyang, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Shenyang, China.
Comput Biol Med. 2023 Mar;154:106587. doi: 10.1016/j.compbiomed.2023.106587. Epub 2023 Jan 24.
Computer-aided lung cancer diagnosis (CAD) system on computed tomography (CT) helps radiologists guide preoperative planning and prognosis assessment. The flexibility and scalability of deep learning methods are limited in lung CAD. In essence, two significant challenges to be solved are (1) Label scarcity due to cost annotations of CT images by experienced domain experts, and (2) Label inconsistency between the observed nodule malignancy and the patients' pathology evaluation. These two issues can be considered weak label problems. We address these issues in this paper by introducing a weakly-supervised lung cancer detection and diagnosis network (WS-LungNet), consisting of a semi-supervised computer-aided detection (Semi-CADe) that can segment 3D pulmonary nodules based on unlabeled data through adversarial learning to reduce label scarcity, as well as a cross-nodule attention computer-aided diagnosis (CNA-CADx) for evaluating malignancy at the patient level by modeling correlations between nodules via cross-attention mechanisms and thereby eliminating label inconsistency. Through extensive evaluations on the LIDC-IDRI public database, we show that our proposed method achieves 82.99% competition performance metric (CPM) on pulmonary nodule detection and 88.63% area under the curve (AUC) on lung cancer diagnosis. Extensive experiments demonstrate the advantage of WS-LungNet on nodule detection and malignancy evaluation tasks. Our promising results demonstrate the benefits and flexibility of the semi-supervised segmentation with adversarial learning and the nodule instance correlation learning with the attention mechanism. The results also suggest that making use of the unlabeled data and taking the relationship among nodules in a case into account are essential for lung cancer detection and diagnosis.
计算机辅助肺癌诊断(CAD)系统在 CT 上有助于放射科医生指导术前规划和预后评估。深度学习方法的灵活性和可扩展性在肺部 CAD 中受到限制。本质上,需要解决两个重大挑战是:(1)由于经验丰富的领域专家对 CT 图像进行成本注释,因此标签稀缺;(2)观察到的结节恶性程度与患者的病理评估之间的标签不一致。这两个问题可以被认为是弱标签问题。我们通过引入一个弱监督肺癌检测和诊断网络(WS-LungNet)来解决这些问题,该网络由一个半监督计算机辅助检测(Semi-CADe)组成,该网络可以通过对抗学习基于未标记的数据分割 3D 肺结节,从而减少标签稀缺性,以及一个跨结节注意力计算机辅助诊断(CNA-CADx),通过跨注意力机制建模结节之间的相关性,从而在患者水平上评估恶性程度,从而消除标签不一致性。通过对 LIDC-IDRI 公共数据库的广泛评估,我们表明我们提出的方法在肺结节检测上达到了 82.99%的竞争性能指标(CPM),在肺癌诊断上达到了 88.63%的曲线下面积(AUC)。广泛的实验证明了 WS-LungNet 在结节检测和恶性评估任务上的优势。我们有希望的结果表明,利用未标记的数据并考虑病例中结节之间的关系对于肺癌检测和诊断是至关重要的。