Liang Baoyu, Tong Chao, Nong Jingying, Zhang Yi
School of Computer Science and Engineering, Beihang University, 37 Xueyuan Road, Haidian District, 100191, Beijing, China.
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, 37 Xueyuan Road, Haidian District, 100191, Beijing, China.
J Imaging Inform Med. 2024 Dec;37(6):2895-2909. doi: 10.1007/s10278-024-01152-4. Epub 2024 Jun 11.
Non-small cell lung carcinoma (NSCLC) is the most common type of pulmonary cancer, one of the deadliest malignant tumors worldwide. Given the increased emphasis on the precise management of lung cancer, identifying various subtypes of NSCLC has become pivotal for enhancing diagnostic standards and patient prognosis. In response to the challenges presented by traditional clinical diagnostic methods for NSCLC pathology subtypes, which are invasive, rely on physician experience, and consume medical resources, we explore the potential of radiomics and deep learning to automatically and non-invasively identify NSCLC subtypes from computed tomography (CT) images. An integrated model is proposed that investigates both radiomic features and deep learning features and makes comprehensive decisions based on the combination of these two features. To extract deep features, a three-dimensional convolutional neural network (3D CNN) is proposed to fully utilize the 3D nature of CT images while radiomic features are extracted by radiomics. These two types of features are combined and classified with multi-head attention (MHA) in our proposed model. To our knowledge, this is the first work that integrates different learning methods and features from varied sources in histological subtype classification of lung cancer. Experiments are organized on a mixed dataset comprising NSCLC Radiomics and Radiogenomics. The results show that our proposed model achieves 0.88 in accuracy and 0.89 in the area under the receiver operating characteristic curve (AUC) when distinguishing lung adenocarcinoma (ADC) and lung squamous cell carcinoma (SqCC), indicating the potential of being a non-invasive way for predicting histological subtypes of lung cancer.
非小细胞肺癌(NSCLC)是最常见的肺癌类型,也是全球最致命的恶性肿瘤之一。鉴于对肺癌精准管理的重视程度不断提高,识别NSCLC的各种亚型对于提高诊断标准和患者预后已变得至关重要。针对传统NSCLC病理亚型临床诊断方法存在的侵入性、依赖医生经验且消耗医疗资源等挑战,我们探索了放射组学和深度学习从计算机断层扫描(CT)图像中自动、非侵入性识别NSCLC亚型的潜力。提出了一种综合模型,该模型研究放射组学特征和深度学习特征,并基于这两种特征的组合做出综合决策。为了提取深度特征,提出了一种三维卷积神经网络(3D CNN)以充分利用CT图像的三维特性,同时通过放射组学提取放射组学特征。在我们提出的模型中,这两种类型的特征通过多头注意力(MHA)进行组合和分类。据我们所知,这是第一项在肺癌组织学亚型分类中整合不同学习方法和来自不同来源特征的工作。在一个由NSCLC放射组学和放射基因组学组成的混合数据集上进行了实验。结果表明,我们提出的模型在区分肺腺癌(ADC)和肺鳞状细胞癌(SqCC)时,准确率达到0.88,受试者操作特征曲线下面积(AUC)达到0.89,表明其具有作为预测肺癌组织学亚型的非侵入性方法的潜力。