Department of Radiology, Columbia University Irving Medical Center, 3-124B Milstein Hospital Bldg, 177 Fort Washington Avenue, New York, NY, 10032, USA.
Department of Pathology, Columbia University Irving Medical Center, New York, NY, USA.
J Transl Med. 2024 Jan 13;22(1):51. doi: 10.1186/s12967-023-04798-w.
Chest Computed tomography (CT) scans detect lung nodules and assess pulmonary fibrosis. While pulmonary fibrosis indicates increased lung cancer risk, current clinical practice characterizes nodule risk of malignancy based on nodule size and smoking history; little consideration is given to the fibrotic microenvironment.
To evaluate the effect of incorporating fibrotic microenvironment into classifying malignancy of lung nodules in chest CT images using deep learning techniques.
We developed a visualizable 3D classification model trained with in-house CT dataset for the nodule malignancy classification task. Three slightly-modified datasets were created: (1) nodule alone (microenvironment removed); (2) nodule with surrounding lung microenvironment; and (3) nodule in microenvironment with semantic fibrosis metadata. For each of the models, tenfold cross-validation was performed. Results were evaluated using quantitative measures, such as accuracy, sensitivity, specificity, and area-under-curve (AUC), as well as qualitative assessments, such as attention maps and class activation maps (CAM).
The classification model trained with nodule alone achieved 75.61% accuracy, 50.00% sensitivity, 88.46% specificity, and 0.78 AUC; the model trained with nodule and microenvironment achieved 79.03% accuracy, 65.46% sensitivity, 85.86% specificity, and 0.84 AUC. The model trained with additional semantic fibrosis metadata achieved 80.84% accuracy, 74.67% sensitivity, 84.95% specificity, and 0.89 AUC. Our visual evaluation of attention maps and CAM suggested that both the nodules and the microenvironment contributed to the task.
The nodule malignancy classification performance was found to be improving with microenvironment data. Further improvement was found when incorporating semantic fibrosis information.
胸部计算机断层扫描(CT)可发现肺部结节并评估肺纤维化。虽然肺纤维化表明肺癌风险增加,但目前的临床实践是根据结节大小和吸烟史来判断恶性肿瘤的风险,而很少考虑纤维化的微环境。
利用深度学习技术评估将纤维化微环境纳入胸部 CT 图像中肺结节恶性肿瘤分类的效果。
我们开发了一个可视化的 3D 分类模型,使用内部 CT 数据集进行结节恶性肿瘤分类任务的训练。创建了三个稍作修改的数据集:(1)仅结节(去除微环境);(2)结节伴周围肺微环境;(3)结节伴纤维化语义元数据的微环境。对每个模型都进行了十折交叉验证。使用定量指标(如准确性、敏感度、特异性和曲线下面积(AUC))以及定性评估(如注意力图和类激活图(CAM))来评估结果。
仅使用结节训练的分类模型的准确率为 75.61%,敏感度为 50.00%,特异性为 88.46%,AUC 为 0.78;使用结节和微环境训练的模型的准确率为 79.03%,敏感度为 65.46%,特异性为 85.86%,AUC 为 0.84。使用额外的语义纤维化元数据训练的模型的准确率为 80.84%,敏感度为 74.67%,特异性为 84.95%,AUC 为 0.89。我们对注意力图和 CAM 的可视化评估表明,结节和微环境都对任务有贡献。
随着微环境数据的增加,结节恶性肿瘤分类性能得到了提高。当纳入语义纤维化信息时,性能进一步提高。