Northwestern University, Department of Pathology, Chicago, IL, USA.
Northwestern University, Department of Pathology, Chicago, IL, USA.
Placenta. 2023 Apr;135:43-50. doi: 10.1016/j.placenta.2023.03.003. Epub 2023 Mar 15.
Placental parenchymal lesions are commonly encountered and carry significant clinical associations. However, they are frequently missed or misclassified by general practice pathologists. Interpretation of pathology slides has emerged as one of the most successful applications of machine learning (ML) in medicine with applications ranging from cancer detection and prognostication to transplant medicine. The goal of this study was to use a whole-slide learning model to identify and classify placental parenchymal lesions including villous infarctions, intervillous thrombi (IVT), and perivillous fibrin deposition (PVFD).
We generated whole slide images from placental discs examined at our institution with infarct, IVT, PVFD, or no macroscopic lesion. Slides were analyzed as a set of overlapping patches. We extracted feature vectors from each patch using a pretrained convolutional neural network (EfficientNetV2L). We trained a model to assign attention to each vector and used the attentions as weights to produce a pooled feature vector. The pooled vector was classified as normal or 1 of 3 lesions using a fully connected network. Patch attention was plotted to highlight informative areas of the slide.
Overall balanced accuracy in a test set of held-out slides was 0.86 with receiver-operator characteristic areas under the curve of 0.917-0.993. Cases of PVFD were frequently miscalled as normal or infarcts, the latter possibly due to the perivillous fibrin found at the periphery of infarctions. We used attention maps to further understand some errors, including one most likely due to poor tissue fixation and processing.
We used a whole-slide learning paradigm to train models to recognize three of the most common placental parenchymal lesions. We used attention maps to gain insight into model function, which differed from intuitive explanations.
胎盘实质病变很常见,与重要的临床关联。然而,它们经常被普通病理学家忽视或误诊。病理学幻灯片的解释已经成为机器学习(ML)在医学中最成功的应用之一,应用范围从癌症检测和预后到移植医学。本研究的目的是使用全幻灯片学习模型来识别和分类胎盘实质病变,包括绒毛梗死、绒毛间血栓(IVT)和绒毛周围纤维蛋白沉积(PVFD)。
我们从我院检查的胎盘片生成全幻灯片图像,这些图像有梗死、IVT、PVFD 或无明显病变。幻灯片作为一组重叠的斑块进行分析。我们使用预训练的卷积神经网络(EfficientNetV2L)从每个斑块中提取特征向量。我们训练一个模型来为每个向量分配注意力,并使用注意力作为权重来生成一个聚合特征向量。使用全连接网络将聚合向量分类为正常或 3 种病变之一。绘制斑块注意力图以突出幻灯片的信息区域。
在一个保留幻灯片的测试集中,整体平衡准确率为 0.86,接收器操作特征曲线下面积为 0.917-0.993。PVFD 病例常被误诊为正常或梗死,后者可能是由于梗死边缘的绒毛周围纤维蛋白。我们使用注意力图来进一步了解一些错误,包括一个可能是由于组织固定和处理不良引起的错误。
我们使用全幻灯片学习范例来训练模型识别三种最常见的胎盘实质病变。我们使用注意力图来深入了解模型功能,这与直观解释不同。