Musigmann Manfred, Nacul Nabila Gala, Kasap Dilek N, Heindel Walter, Mannil Manoj
University Clinic for Radiology, University Hospital Muenster, WWU Muenster, Albert-Schweitzer-Campus 1, DE-48149 Muenster, Germany.
Diagnostics (Basel). 2023 Jul 8;13(14):2315. doi: 10.3390/diagnostics13142315.
Our aim is to investigate the added value of automated machine learning (AutoML) for potential future applications in cancer diagnostics. Using two important diagnostic questions, the non-invasive determination of IDH mutation status and ATRX status, we analyze whether it is possible to use AutoML to develop models that are comparable in performance to conventional machine learning models (ML) developed by experts. For this purpose, we develop AutoML models using different feature preselection methods and compare the results with previously developed conventional ML models. The cohort used for our study comprises T2-weighted MRI images of 124 patients with histologically confirmed gliomas. Using AutoML, we were able to develop sophisticated models in a very short time with only a few lines of computer code. In predicting IDH mutation status, we obtained a mean AUC of 0.7400 and a mean AUPRC of 0.8582. ATRX mutation status was predicted with very similar discriminatory power, with a mean AUC of 0.7810 and a mean AUPRC of 0.8511. In both cases, AutoML was even able to achieve a discriminatory power slightly above that of the respective conventionally developed models in a very short computing time, thus making such methods accessible to non-experts in the near future.
我们的目标是研究自动机器学习(AutoML)在癌症诊断潜在未来应用中的附加价值。通过两个重要的诊断问题,即异柠檬酸脱氢酶(IDH)突变状态和α-地中海贫血/智力发育迟缓综合征X连锁基因(ATRX)状态的非侵入性测定,我们分析是否有可能使用AutoML开发出在性能上与专家开发的传统机器学习模型(ML)相当的模型。为此,我们使用不同的特征预选方法开发AutoML模型,并将结果与先前开发的传统ML模型进行比较。我们研究使用的队列包括124例经组织学证实的胶质瘤患者的T2加权磁共振成像(MRI)图像。使用AutoML,我们能够在很短的时间内用几行计算机代码开发出复杂的模型。在预测IDH突变状态时,我们获得的平均曲线下面积(AUC)为0.7400,平均精确率-召回率曲线下面积(AUPRC)为0.8582。预测ATRX突变状态时也具有非常相似的鉴别能力,平均AUC为0.7810,平均AUPRC为0.8511。在这两种情况下,AutoML甚至能够在非常短的计算时间内实现略高于各自传统开发模型的鉴别能力,从而在不久的将来使非专家也能使用这些方法。