School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, xi'an 710121, People's Republic of China.
Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi'an University of Posts and Telecommunications, Xi'an, 710121, People's Republic of China.
Phys Med Biol. 2023 Dec 1;68(23). doi: 10.1088/1361-6560/ad0d46.
Accurate response prediction allows for personalized cancer treatment of locally advanced rectal cancer (LARC) with neoadjuvant chemoradiation. In this work, we designed a convolutional neural network (CNN) feature extractor with switchable 3D and 2D convolutional kernels to extract deep learning features for response prediction. Compared with radiomics features, convolutional kernels may adaptively extract local or global image features from multi-modal MR sequences without the need of feature predefinition. We then developed an unsupervised clustering based evaluation method to improve the feature selection operation in the feature space formed by the combination of CNN features and radiomics features. While normal process of feature selection generally includes the operations of classifier training and classification execution, the process needs to be repeated many times after new feature combinations were found to evaluate the model performance, which incurs a significant time cost. To address this issue, we proposed a cost effective process to use a constructed unsupervised clustering analysis indicator to replace the classifier training process by indirectly evaluating the quality of new found feature combinations in feature selection process. We evaluated the proposed method using 43 LARC patients underwent neoadjuvant chemoradiation. Our prediction model achieved accuracy, area-under-curve (AUC), sensitivity and specificity of 0.852, 0.871, 0.868, and 0.735 respectively. Compared with traditional radiomics methods, the prediction models (AUC = 0.846) based on deep learning-based feature sets are significantly better than traditional radiomics methods (AUC = 0.714). The experiments also showed following findings: (1) the features with higher predictive power are mainly from high-order abstract features extracted by CNN on ADC images and T2 images; (2) both ADC_Radiomics and ADC_CNN features are more advantageous for predicting treatment responses than the radiomics and CNN features extracted from T2 images; (3) 3D CNN features are more effective than 2D CNN features in the treatment response prediction. The proposed unsupervised clustering indicator is feasible with low computational cost, which facilitates the discovery of valuable solutions by highlighting the correlation and complementarity between different types of features.
准确的预测有助于对接受新辅助放化疗的局部晚期直肠癌(LARC)进行个体化治疗。在这项工作中,我们设计了一个具有可切换的 3D 和 2D 卷积核的卷积神经网络(CNN)特征提取器,用于提取用于预测反应的深度学习特征。与放射组学特征相比,卷积核可以自适应地从多模态 MR 序列中提取局部或全局图像特征,而无需对特征进行预定义。然后,我们开发了一种基于无监督聚类的评估方法,以改善由 CNN 特征和放射组学特征组合形成的特征空间中的特征选择操作。而正常的特征选择过程通常包括分类器训练和分类执行的操作,在发现新的特征组合后,需要多次重复该过程以评估模型性能,这会带来巨大的时间成本。为了解决这个问题,我们提出了一种经济高效的过程,使用构建的无监督聚类分析指标来替代分类器训练过程,通过间接评估特征选择过程中发现的新特征组合的质量来实现。我们使用 43 名接受新辅助放化疗的 LARC 患者来评估所提出的方法。我们的预测模型的准确性、曲线下面积(AUC)、敏感性和特异性分别为 0.852、0.871、0.868 和 0.735。与传统的放射组学方法相比,基于深度学习特征集的预测模型(AUC = 0.846)明显优于传统的放射组学方法(AUC = 0.714)。实验还发现:(1)预测能力较高的特征主要来自于 CNN 对 ADC 图像和 T2 图像提取的高阶抽象特征;(2)ADC_Radiomics 和 ADC_CNN 特征在预测治疗反应方面都比从 T2 图像提取的放射组学和 CNN 特征更有优势;(3)在治疗反应预测方面,3D CNN 特征比 2D CNN 特征更有效。所提出的无监督聚类指标具有较低的计算成本,通过突出不同类型特征之间的相关性和互补性,为发现有价值的解决方案提供了便利。