Li Lin, Shiradkar Rakesh, Gottlieb Noah, Buzzy Christina, Hiremath Amogh, Viswanathan Vidya Sankar, MacLennan Gregory T, Lima Danly Omil, Gupta Karishma, Shen Daniel Lee, Tirumani Sree Harsha, Magi-Galluzzi Cristina, Purysko Andrei, Madabhushi Anant
Deptartment of Biomedical Engineering, Case Western Reserve University, Cleveland, Ohio, USA.
Wallace H Coulter Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, Georgia, USA.
Med Phys. 2024 Apr;51(4):2549-2562. doi: 10.1002/mp.16753. Epub 2023 Sep 24.
Accurate delineations of regions of interest (ROIs) on multi-parametric magnetic resonance imaging (mpMRI) are crucial for development of automated, machine learning-based prostate cancer (PCa) detection and segmentation models. However, manual ROI delineations are labor-intensive and susceptible to inter-reader variability. Histopathology images from radical prostatectomy (RP) represent the "gold standard" in terms of the delineation of disease extents, for example, PCa, prostatitis, and benign prostatic hyperplasia (BPH). Co-registering digitized histopathology images onto pre-operative mpMRI enables automated mapping of the ground truth disease extents onto mpMRI, thus enabling the development of machine learning tools for PCa detection and risk stratification. Still, MRI-histopathology co-registration is challenging due to various artifacts and large deformation between in vivo MRI and ex vivo whole-mount histopathology images (WMHs). Furthermore, the artifacts on WMHs, such as tissue loss, may introduce unrealistic deformation during co-registration.
This study presents a new registration pipeline, MSERgSDM, a multi-scale feature-based registration (MSERg) with a statistical deformation (SDM) constraint, which aims to improve accuracy of MRI-histopathology co-registration.
In this study, we collected 85 pairs of MRI and WMHs from 48 patients across three cohorts. Cohort 1 (D), comprised of a unique set of 3D printed mold data from six patients, facilitated the generation of ground truth deformations between ex vivo WMHs and in vivo MRI. The other two clinically acquired cohorts (D and D) included 42 patients. Affine and nonrigid registrations were employed to minimize the deformation between ex vivo WMH and ex vivo T2-weighted MRI (T2WI) in D. Subsequently, ground truth deformation between in vivo T2WI and ex vivo WMH was approximated as the deformation between in vivo T2WI and ex vivo T2WI. In D and D, the prostate anatomical annotations, for example, tumor and urethra, were made by a pathologist and a radiologist in collaboration. These annotations included ROI boundary contours and landmark points. Before applying the registration, manual corrections were made for flipping and rotation of WMHs. MSERgSDM comprises two main components: (1) multi-scale representation construction, and (2) SDM construction. For the SDM construction, we collected N = 200 reasonable deformation fields generated using MSERg, verified through visual inspection. Three additional methods, including intensity-based registration, ProsRegNet, and MSERg, were also employed for comparison against MSERgSDM.
Our results suggest that MSERgSDM performed comparably to the ground truth (p > 0.05). Additionally, MSERgSDM (ROI Dice ratio = 0.61, landmark distance = 3.26 mm) exhibited significant improvement over MSERg (ROI Dice ratio = 0.59, landmark distance = 3.69 mm) and ProsRegNet (ROI Dice ratio = 0.56, landmark distance = 4.00 mm) in local alignment.
This study presents a novel registration method, MSERgSDM, for mapping ex vivo WMH onto in vivo prostate MRI. Our preliminary results demonstrate that MSERgSDM can serve as a valuable tool to map ground truth disease annotations from histopathology images onto MRI, thereby assisting in the development of machine learning models for PCa detection on MRI.
在多参数磁共振成像(mpMRI)上准确勾勒感兴趣区域(ROI)对于基于机器学习的前列腺癌(PCa)自动检测和分割模型的开发至关重要。然而,手动勾勒ROI需要耗费大量人力,并且易受阅片者间差异的影响。根治性前列腺切除术(RP)的组织病理学图像在疾病范围(如PCa、前列腺炎和良性前列腺增生(BPH))的勾勒方面代表了“金标准”。将数字化组织病理学图像与术前mpMRI进行配准,能够将真实疾病范围自动映射到mpMRI上,从而有助于开发用于PCa检测和风险分层的机器学习工具。尽管如此,由于各种伪影以及体内MRI与离体全层组织病理学图像(WMH)之间的巨大变形,MRI - 组织病理学配准仍具有挑战性。此外,WMH上的伪影,如组织丢失,可能在配准过程中引入不切实际的变形。
本研究提出一种新的配准流程,即MSERgSDM,一种基于多尺度特征的配准(MSERg)与统计变形(SDM)约束相结合的方法,旨在提高MRI - 组织病理学配准的准确性。
在本研究中,我们从三个队列的48名患者中收集了85对MRI和WMH。队列1(D)由来自6名患者的一组独特的3D打印模具数据组成,有助于生成离体WMH与体内MRI之间的真实变形。另外两个临床采集队列(D和D)包括42名患者。在队列D中,采用仿射和非刚性配准来最小化离体WMH与离体T2加权MRI(T2WI)之间的变形。随后,将体内T2WI与离体WMH之间的真实变形近似为体内T2WI与离体T2WI之间的变形。在队列D和D中,前列腺的解剖学标注(如肿瘤和尿道)由病理学家和放射科医生合作完成。这些标注包括ROI边界轮廓和地标点。在应用配准之前,对WMH的翻转和旋转进行了手动校正。MSERgSDM包括两个主要组件:(1)多尺度表示构建,和(2)SDM构建。对于SDM构建,我们收集了使用MSERg生成的N = 200个合理变形场,并通过目视检查进行了验证。还采用了另外三种方法,包括基于强度的配准、ProsRegNet和MSERg,与MSERgSDM进行比较。
我们的结果表明,MSERgSDM的表现与真实情况相当(p > 0.05)。此外,在局部对齐方面,MSERgSDM(ROI骰子系数 = 0.61,地标距离 = 3.26 mm)相较于MSERg(ROI骰子系数 = 0.59,地标距离 = 3.69 mm)和ProsRegNet(ROI骰子系数 = 0.56,地标距离 = 4.00 mm)有显著改善。
本研究提出了一种将离体WMH映射到体内前列腺MRI上的新型配准方法MSERgSDM。我们的初步结果表明,MSERgSDM可作为一种有价值的工具,将组织病理学图像中的真实疾病标注映射到MRI上,从而有助于开发用于在MRI上检测PCa的机器学习模型。