Li Qiang, Teodoro George, Jiang Yi, Kong Jun
Department of Mathematics and Statistics, Georgia State University, Atlanta, 30303, GA, USA.
Department of Computer Science, Federal University of Minas Gerais, Belo Horizonte, 31270, Minas Gerais, Brazil.
Comput Med Imaging Graph. 2024 Dec;118:102467. doi: 10.1016/j.compmedimag.2024.102467. Epub 2024 Nov 17.
Neoadjuvant chemotherapy (NAC) response prediction for triple negative breast cancer (TNBC) patients is a challenging task clinically as it requires understanding complex histology interactions within the tumor microenvironment (TME). Digital whole slide images (WSIs) capture detailed tissue information, but their giga-pixel size necessitates computational methods based on multiple instance learning, which typically analyze small, isolated image tiles without the spatial context of the TME. To address this limitation and incorporate TME spatial histology interactions in predicting NAC response for TNBC patients, we developed a histology context-aware transformer graph convolution network (NACNet). Our deep learning method identifies the histopathological labels on individual image tiles from WSIs, constructs a spatial TME graph, and represents each node with features derived from tissue texture and social network analysis. It predicts NAC response using a transformer graph convolution network model enhanced with graph isomorphism network layers. We evaluate our method with WSIs of a cohort of TNBC patient (N=105) and compared its performance with multiple state-of-the-art machine learning and deep learning models, including both graph and non-graph approaches. Our NACNet achieves 90.0% accuracy, 96.0% sensitivity, 88.0% specificity, and an AUC of 0.82, through eight-fold cross-validation, outperforming baseline models. These comprehensive experimental results suggest that NACNet holds strong potential for stratifying TNBC patients by NAC response, thereby helping to prevent overtreatment, improve patient quality of life, reduce treatment cost, and enhance clinical outcomes, marking an important advancement toward personalized breast cancer treatment.
三阴性乳腺癌(TNBC)患者的新辅助化疗(NAC)反应预测在临床上是一项具有挑战性的任务,因为它需要了解肿瘤微环境(TME)内复杂的组织学相互作用。数字全切片图像(WSIs)可捕获详细的组织信息,但其千兆像素大小需要基于多实例学习的计算方法,这种方法通常分析小的、孤立的图像块,而不考虑TME的空间背景。为了解决这一局限性,并在预测TNBC患者的NAC反应时纳入TME空间组织学相互作用,我们开发了一种组织学上下文感知变压器图卷积网络(NACNet)。我们的深度学习方法可识别WSIs中各个图像块上的组织病理学标签,构建空间TME图,并用从组织纹理和社会网络分析中得出的特征表示每个节点。它使用通过图同构网络层增强的变压器图卷积网络模型来预测NAC反应。我们用一组TNBC患者(N = 105)的WSIs评估了我们的方法,并将其性能与多种先进的机器学习和深度学习模型进行了比较,包括基于图和非基于图的方法。通过八折交叉验证,我们的NACNet实现了90.0%的准确率、96.0%的灵敏度、88.0%的特异性和0.82的AUC,优于基线模型。这些全面的实验结果表明,NACNet在根据NAC反应对TNBC患者进行分层方面具有强大潜力,从而有助于防止过度治疗、提高患者生活质量、降低治疗成本并改善临床结果,标志着个性化乳腺癌治疗取得了重要进展。