Department of Computer Science and EngineeringNational Institute of Technology Karnataka Surathkal 575025 India.
Department of Computer Science and EngineeringThe National Institute of Engineering Mysuru 570008 India.
IEEE J Transl Eng Health Med. 2023 Feb 6;11:161-169. doi: 10.1109/JTEHM.2023.3241613. eCollection 2023.
Molecular subtyping is an important procedure for prognosis and targeted therapy of breast carcinoma, the most common type of malignancy affecting women. Immunohistochemistry (IHC) analysis is the widely accepted method for molecular subtyping. It involves the assessment of the four molecular biomarkers namely estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor 2 (HER2), and antigen Ki67 using appropriate antibody reagents. Conventionally, these biomarkers are assessed manually by a pathologist, who finally combines individual results to identify the molecular subtype. Molecular subtyping necessitates the status of all the four biomarkers together, and to the best of our knowledge, no such automated method exists. This paper proposes a novel deep learning framework for automatic molecular subtyping of breast cancer from IHC images.
A modified LadderNet architecture is proposed to segment the immunopositive elements from ER, PR, HER2, and Ki67 biomarker slides. This architecture uses long skip connections to pass encoder feature space from different semantic levels to the decoder layers, allowing concurrent learning with multi-scale features. The entire architecture is an ensemble of multiple fully convolutional neural networks, and learning pathways are chosen adaptively based on input data. The segmentation stage is followed by a post-processing stage to quantify the extent of immunopositive elements to predict the final status for each biomarker.
The performance of segmentation models for each IHC biomarker is evaluated qualitatively and quantitatively. Furthermore, the biomarker prediction results are also evaluated. The results obtained by our method are highly in concordance with manual assessment by pathologists.
Accurate automated molecular subtyping can speed up this pathology procedure, reduce pathologists' workload and associated costs, and facilitate targeted treatment to obtain better outcomes.
分子亚型分类是乳腺癌(女性最常见的恶性肿瘤类型)预后和靶向治疗的重要程序。免疫组织化学(IHC)分析是分子亚型分类的广泛接受的方法。它涉及使用适当的抗体试剂评估四个分子生物标志物,即雌激素受体(ER)、孕激素受体(PR)、人表皮生长因子受体 2(HER2)和抗原 Ki67。传统上,这些生物标志物由病理学家手动评估,病理学家最终将个体结果结合起来确定分子亚型。分子亚型分类需要所有四个生物标志物的状态,据我们所知,目前还没有这样的自动化方法。本文提出了一种基于深度学习的自动乳腺癌 IHC 图像分子亚型分类框架。
提出了一种改进的 LadderNet 架构,用于从 ER、PR、HER2 和 Ki67 生物标志物切片中分割免疫阳性元素。该架构使用长跳跃连接将不同语义级别的编码器特征空间传递到解码器层,允许多尺度特征的并发学习。整个架构是多个全卷积神经网络的集合,学习路径根据输入数据自适应选择。分割阶段之后是后处理阶段,用于量化免疫阳性元素的程度,以预测每个生物标志物的最终状态。
对每个 IHC 生物标志物的分割模型进行了定性和定量评估。此外,还评估了生物标志物预测结果。我们的方法得到的结果与病理学家的手动评估高度一致。
准确的自动分子亚型分类可以加快这一病理过程,减轻病理学家的工作量和相关成本,并促进靶向治疗以获得更好的结果。