State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, Innovation Academy for Precision Measurement Science and Technology, Chinese Academy of Sciences, Wuhan, P.R. China.
School of Information Engineering, Wuhan University of Technology, Wuhan, P.R. China.
Med Phys. 2023 Jun;50(6):3445-3458. doi: 10.1002/mp.16343. Epub 2023 Mar 16.
Multiparametric magnetic resonance imaging (mp-MRI) is introduced and established as a noninvasive alternative for prostate cancer (PCa) detection and characterization.
To develop and evaluate a mutually communicated deep learning segmentation and classification network (MC-DSCN) based on mp-MRI for prostate segmentation and PCa diagnosis.
The proposed MC-DSCN can transfer mutual information between segmentation and classification components and facilitate each other in a bootstrapping way. For classification task, the MC-DSCN can transfer the masks produced by the coarse segmentation component to the classification component to exclude irrelevant regions and facilitate classification. For segmentation task, this model can transfer the high-quality localization information learned by the classification component to the fine segmentation component to mitigate the impact of inaccurate localization on segmentation results. Consecutive MRI exams of patients were retrospectively collected from two medical centers (referred to as center A and B). Two experienced radiologists segmented the prostate regions, and the ground truth of the classification refers to the prostate biopsy results. MC-DSCN was designed, trained, and validated using different combinations of distinct MRI sequences as input (e.g., T2-weighted and apparent diffusion coefficient) and the effect of different architectures on the network's performance was tested and discussed. Data from center A were used for training, validation, and internal testing, while another center's data were used for external testing. The statistical analysis is performed to evaluate the performance of the MC-DSCN. The DeLong test and paired t-test were used to assess the performance of classification and segmentation, respectively.
In total, 134 patients were included. The proposed MC-DSCN outperforms the networks that were designed solely for segmentation or classification. Regarding the segmentation task, the classification localization information helped to improve the IOU in center A: from 84.5% to 87.8% (p < 0.01) and in center B: from 83.8% to 87.1% (p < 0.01), while the area under curve (AUC) of PCa classification was improved in center A: from 0.946 to 0.991 (p < 0.02) and in center B: from 0.926 to 0.955 (p < 0.01) as a result of the additional information provided by the prostate segmentation.
The proposed architecture could effectively transfer mutual information between segmentation and classification components and facilitate each other in a bootstrapping way, thus outperforming the networks designed to perform only one task.
多参数磁共振成像(mp-MRI)作为一种非侵入性的前列腺癌(PCa)检测和特征分析方法已经被引入并确立。
开发并评估一种基于 mp-MRI 的相互通信深度学习分割和分类网络(MC-DSCN),用于前列腺分割和 PCa 诊断。
所提出的 MC-DSCN 可以在分割和分类组件之间传递相互信息,并以自举的方式相互促进。对于分类任务,MC-DSCN 可以将粗分割组件生成的掩模传输到分类组件,以排除不相关区域并促进分类。对于分割任务,该模型可以将分类组件学习到的高质量定位信息传输到精细分割组件,以减轻定位不准确对分割结果的影响。连续的 MRI 检查从两个医疗中心(分别称为中心 A 和 B)回顾性地收集。两位有经验的放射科医生对前列腺区域进行了分割,分类的ground truth 参考前列腺活检结果。使用不同的 MRI 序列(例如 T2 加权和表观扩散系数)作为输入来设计、训练和验证 MC-DSCN,并测试和讨论不同架构对网络性能的影响。来自中心 A 的数据用于训练、验证和内部测试,而另一个中心的数据用于外部测试。使用统计分析来评估 MC-DSCN 的性能。使用 DeLong 检验和配对 t 检验分别评估分类和分割的性能。
共纳入 134 例患者。所提出的 MC-DSCN 优于仅用于分割或分类的网络。在分割任务中,分类的定位信息有助于提高中心 A 的 IOU:从 84.5%提高到 87.8%(p<0.01)和中心 B:从 83.8%提高到 87.1%(p<0.01),而中心 A 的前列腺癌分类 AUC 从 0.946 提高到 0.991(p<0.02)和中心 B:从 0.926 提高到 0.955(p<0.01),因为前列腺分割提供了额外的信息。
所提出的架构可以有效地在分割和分类组件之间传递相互信息,并以自举的方式相互促进,从而优于仅执行一项任务的网络。