School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122, China.
Cancer Center, Faculty of Health Sciences, University of Macau, Macau SAR, China.
Comput Methods Programs Biomed. 2024 Jan;243:107857. doi: 10.1016/j.cmpb.2023.107857. Epub 2023 Oct 12.
Tumor microenvironment (TME) is a determining factor in decision-making and personalized treatment for breast cancer, which is highly intra-tumor heterogeneous (ITH). However, the noninvasive imaging phenotypes of TME are poorly understood, even invasive genotypes have been largely known in breast cancer.
Here, we develop an artificial intelligence (AI)-driven approach for noninvasively characterizing TME by integrating the predictive power of deep learning with the explainability of human-interpretable imaging phenotypes (IMPs) derived from 4D dynamic imaging (DCE-MRI) of 342 breast tumors linked to genomic and clinical data, which connect cancer phenotypes to genotypes. An unsupervised dual-attention deep graph clustering model (DGCLM) is developed to divide bulk tumor into multiple spatially segregated and phenotypically consistent subclusters. The IMPs ranging from spatial heterogeneity to kinetic heterogeneity are leveraged to capture architecture, interaction, and proximity between intratumoral subclusters.
We demonstrate that our IMPs correlate with well-known markers of TME and also can predict distinct molecular signatures, including expression of hormone receptor, epithelial growth factor receptor and immune checkpoint proteins, with the performance of accuracy, reliability and transparency superior to recent state-of-the-art radiomics and 'black-box' deep learning methods. Moreover, prognostic value is confirmed by survival analysis accounting for IMPs.
Our approach provides an interpretable, quantitative, and comprehensive perspective to characterize TME in a noninvasive and clinically relevant manner.
肿瘤微环境(TME)是乳腺癌决策制定和个性化治疗的决定因素,其具有高度的肿瘤内异质性(ITH)。然而,TME 的非侵入性成像表型仍知之甚少,即使在乳腺癌中,侵袭性基因型也在很大程度上被了解。
在这里,我们通过整合深度学习的预测能力和从与基因组和临床数据相关的 342 个乳腺癌肿瘤的 4D 动态成像(DCE-MRI)中得出的人类可解释的成像表型(IMP)的可解释性,开发了一种人工智能(AI)驱动的方法,以无创方式对 TME 进行特征描述,将癌症表型与基因型联系起来。开发了一种无监督的双注意深度图聚类模型(DGCLM),将整体肿瘤分为多个空间分离且表型一致的亚群。利用从空间异质性到动力学异质性的 IMP 来捕获肿瘤内亚群之间的结构、相互作用和接近程度。
我们证明了我们的 IMP 与 TME 的已知标志物相关,并且还可以预测不同的分子特征,包括激素受体、表皮生长因子受体和免疫检查点蛋白的表达,其准确性、可靠性和透明度均优于最新的放射组学和“黑盒”深度学习方法。此外,通过考虑 IMP 进行生存分析来确认预后价值。
我们的方法以无创和临床相关的方式提供了对 TME 进行可解释、定量和全面描述的视角。