Struttura Semplice Dipartimentale di Fisica Sanitaria, I.R.C.C.S. Istituto Tumori "Giovanni Paolo II", Viale Orazio Flacco 65, 70124, Bari, Italy.
Dipartimento di Matematica, Università Degli Studi di Bari, 70121, Bari, Italy.
Sci Rep. 2021 Jul 8;11(1):14123. doi: 10.1038/s41598-021-93592-z.
The dynamic contrast-enhanced MR imaging plays a crucial role in evaluating the effectiveness of neoadjuvant chemotherapy (NAC) even since its early stage through the prediction of the final pathological complete response (pCR). In this study, we proposed a transfer learning approach to predict if a patient achieved pCR (pCR) or did not (non-pCR) by exploiting, separately or in combination, pre-treatment and early-treatment exams from I-SPY1 TRIAL public database. First, low-level features, i.e., related to local structure of the image, were automatically extracted by a pre-trained convolutional neural network (CNN) overcoming manual feature extraction. Next, an optimal set of most stable features was detected and then used to design an SVM classifier. A first subset of patients, called fine-tuning dataset (30 pCR; 78 non-pCR), was used to perform the optimal choice of features. A second subset not involved in the feature selection process was employed as an independent test (7 pCR; 19 non-pCR) to validate the model. By combining the optimal features extracted from both pre-treatment and early-treatment exams with some clinical features, i.e., ER, PgR, HER2 and molecular subtype, an accuracy of 91.4% and 92.3%, and an AUC value of 0.93 and 0.90, were returned on the fine-tuning dataset and the independent test, respectively. Overall, the low-level CNN features have an important role in the early evaluation of the NAC efficacy by predicting pCR. The proposed model represents a first effort towards the development of a clinical support tool for an early prediction of pCR to NAC.
动态对比增强磁共振成像在评估新辅助化疗 (NAC) 的疗效方面发挥着关键作用,甚至可以通过预测最终的病理完全缓解 (pCR) 来早期预测。在这项研究中,我们提出了一种迁移学习方法,通过利用 I-SPY1 TRIAL 公共数据库中的预处理和早期治疗检查,分别或联合预测患者是否达到 pCR(pCR)或未达到 pCR(非 pCR)。首先,通过预训练的卷积神经网络 (CNN) 自动提取与图像局部结构相关的低级特征,克服了手动特征提取。接下来,检测出最稳定的特征集,并用于设计 SVM 分类器。第一个患者子集称为微调数据集 (30 个 pCR;78 个非 pCR),用于执行特征的最佳选择。第二个子集未参与特征选择过程,用作独立测试 (7 个 pCR;19 个非 pCR) 以验证模型。通过将从预处理和早期治疗检查中提取的最优特征与一些临床特征(ER、PgR、HER2 和分子亚型)相结合,在微调数据集和独立测试中分别获得了 91.4%和 92.3%的准确率和 0.93 和 0.90 的 AUC 值。总之,低级 CNN 特征在通过预测 pCR 对 NAC 疗效的早期评估中具有重要作用。所提出的模型代表了开发用于早期预测 pCR 对 NAC 的临床支持工具的初步尝试。