Fang W, Xiao H, Wang S, Lin X, Chen C
School of Biomedical Engineering, Southern Medical University, Guangzhou 510515, China.
Guangdong Shunde Innovative Design Institute, Foshan 528300, China.
Nan Fang Yi Ke Da Xue Xue Bao. 2024 Sep 20;44(9):1738-1751. doi: 10.12122/j.issn.1673-4254.2024.09.14.
To establish a deep learning model for testing the feasibility of combining magnetic resonance imaging (MRI) deep learning features with clinical features for preoperative prediction of cytokeratin 19 (CK19) status of hepatocellular carcinoma (HCC).
A retrospective experiment was conducted based on the data of 116 HCC patients with confirmed CK19 status. A single sequence multi-scale feature fusion deep learning model (MSFF-IResnet) and a multi-scale and multimodality feature fusion model (MMFF-IResnet) were established based on the hepatobiliary phase (HBP), diffusion weighted imaging (DWI) sequences of enhanced MRI images, and the clinical features significantly correlated with CK19 status. The classification performance of the models were evaluated to assess the effectiveness of the deep learning models for predicting CK19 status of HCC before surgery.
Multivariate analysis showed that an increased neutrophil-to-lymphocyte ratio (=0.029) and incomplete tumor capsule (=0.028) were independent predictors of CK19 expression in HCC. The deep learning models improved by multi-scale feature fusion and multi-modality feature fusion methods achieved better classification results than the traditional machine learning models and baseline models, and the final MMFF-IResnet model showed the best classification performance with an AUC of 84.2%, an accuracy of 80.6%, a sensitivity of 80.1% and a specificity of 81.2%.
The multi-scale and multi-modality feature fusion model based on MRI and clinical parameters is capable of predicting CK19 status of HCC, demonstrating the feasibility of combining deep learning methods with MRI and clinical features for preoperative prediction of CK19 status.
建立一种深度学习模型,以测试将磁共振成像(MRI)深度学习特征与临床特征相结合用于术前预测肝细胞癌(HCC)细胞角蛋白19(CK19)状态的可行性。
基于116例CK19状态确诊的HCC患者的数据进行回顾性实验。基于肝胆期(HBP)、增强MRI图像的扩散加权成像(DWI)序列以及与CK19状态显著相关的临床特征,建立了单序列多尺度特征融合深度学习模型(MSFF-IResnet)和多尺度多模态特征融合模型(MMFF-IResnet)。评估模型的分类性能,以评估深度学习模型在术前预测HCC患者CK19状态方面的有效性。
多因素分析显示,中性粒细胞与淋巴细胞比值升高(=0.029)和肿瘤包膜不完整(=0.028)是HCC中CK19表达的独立预测因素。通过多尺度特征融合和多模态特征融合方法改进的深度学习模型比传统机器学习模型和基线模型取得了更好的分类结果,最终的MMFF-IResnet模型表现出最佳的分类性能,曲线下面积(AUC)为84.2%,准确率为80.6%,灵敏度为80.1%,特异性为81.2%。
基于MRI和临床参数的多尺度多模态特征融合模型能够预测HCC的CK19状态,证明了将深度学习方法与MRI和临床特征相结合用于术前预测CK19状态的可行性。