Engineering Research Center of Text Computing & Cognitive Intelligence, Ministry of Education, Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang 550025, China.
Engineering Research Center of Text Computing & Cognitive Intelligence, Ministry of Education, Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province, State Key Laboratory of Public Big Data, College of Computer Science and Technology, Guizhou University, Guiyang 550025, China.
Comput Biol Med. 2023 Nov;166:107493. doi: 10.1016/j.compbiomed.2023.107493. Epub 2023 Sep 18.
Accurately predicting the isocitrate dehydrogenase (IDH) mutation status of gliomas is greatly significant for formulating appropriate treatment plans and evaluating the prognoses of gliomas. Although existing studies can accurately predict the IDH mutation status of gliomas based on multimodal magnetic resonance (MR) images and machine learning methods, most of these methods cannot fully explore multimodal information and effectively predict IDH status for datasets acquired from multiple centers. To address this issue, a novel wavelet scattering (WS)-based orthogonal fusion network (WSOFNet) was proposed in this work to predict the IDH mutation status of gliomas from multiple centers. First, transformation-invariant features were extracted from multimodal MR images with a WS network, and then the multimodal WS features were used instead of the original images as the inputs of WSOFNet and were fully fused through an adaptive multimodal feature fusion module (AMF2M) and an orthogonal projection module (OPM). Finally, the fused features were input into a fully connected classifier to predict IDH mutation status. In addition, to achieve improved prediction accuracy, four auxiliary losses were also used in the feature extraction modules. The comparison results showed that the prediction area under the curve (AUC) of WSOFNet on a single-center dataset was 0.9966 and that on a multicenter dataset was approximately 0.9655, which was at least 3.9% higher than that of state-of-the-art methods. Moreover, the ablation experimental results also proved that the adaptive multimodal feature fusion strategy based on orthogonal projection could effectively improve the prediction performance of the model, especially for an external validation dataset.
准确预测脑胶质瘤的异柠檬酸脱氢酶 (IDH) 突变状态对于制定适当的治疗计划和评估脑胶质瘤的预后具有重要意义。虽然现有的研究可以基于多模态磁共振 (MR) 图像和机器学习方法准确预测脑胶质瘤的 IDH 突变状态,但这些方法大多不能充分挖掘多模态信息,无法有效地预测来自多个中心的数据集中的 IDH 状态。为了解决这个问题,本研究提出了一种基于小波散射 (WS) 的正交融合网络 (WSOFNet),用于从多个中心预测脑胶质瘤的 IDH 突变状态。首先,利用 WS 网络从多模态 MR 图像中提取具有变换不变性的特征,然后将多模态 WS 特征代替原始图像作为 WSOFNet 的输入,并通过自适应多模态特征融合模块 (AMF2M) 和正交投影模块 (OPM) 进行充分融合。最后,将融合后的特征输入全连接分类器来预测 IDH 突变状态。此外,为了提高预测精度,还在特征提取模块中使用了四种辅助损失。结果表明,WSOFNet 在单中心数据集上的预测曲线下面积 (AUC) 为 0.9966,在多中心数据集上的 AUC 约为 0.9655,至少比现有方法高 3.9%。此外,消融实验结果还证明了基于正交投影的自适应多模态特征融合策略可以有效提高模型的预测性能,特别是对于外部验证数据集。