Division of Cardiology, Department of Medicine II, Kansai Medical University, Hirakata, Japan.
Division of Cardiology, Department of Medicine II, Kansai Medical University, Hirakata, Japan.
Atherosclerosis. 2021 Jul;328:100-105. doi: 10.1016/j.atherosclerosis.2021.06.003. Epub 2021 Jun 7.
We developed a deep learning (DL) model for automated atherosclerotic plaque categorization using optical frequency domain imaging (OFDI) and performed quantitative and visual evaluations.
A total of 1103 histological cross-sections from 45 autopsy hearts were examined to compare the ex vivo OFDI scans. The images were segmented and annotated considering four histological categories: pathological intimal thickening (PIT), fibrous cap atheroma (FA), fibrocalcific plaque (FC), and healed erosion/rupture (HER). The DL model was developed based on pyramid scene parsing network (PSPNet). Given an input image, a convolutional neural network (ResNet50) was used as an encoder to generate feature maps of the last convolutional layer.
For the quantitative evaluation, the mean F-score and IoU values, which are used to evaluate how close the predicted results are to the ground truth, were used. The validation and test dataset had F-score and IoU values of 0.63, 0.49, and 0.66, 0.52, respectively. For the section-level diagnostic accuracy, the areas under the receiver-operating characteristic curve produced by the DL model for FC, PIT, FA, and HER were 0.91, 0.85, 0.86, and 0.86, respectively, and were comparable to those of an expert observer.
DL semantic segmentation of coronary plaques in OFDI images was used as a tool to automatically categorize atherosclerotic plaques using histological findings as the gold standard. The proposed method can support interventional cardiologists in understanding histological properties of plaques.
我们开发了一种基于深度学习(DL)的模型,用于使用光频域成像(OFDI)自动对动脉粥样硬化斑块进行分类,并进行了定量和可视化评估。
共对 45 例尸检心脏的 1103 个组织学横断面进行了检查,以比较离体 OFDI 扫描。考虑到四个组织学类别:病理性内膜增厚(PIT)、纤维帽粥样斑块(FA)、纤维钙化斑块(FC)和愈合性侵蚀/破裂(HER),对图像进行了分割和注释。该 DL 模型基于金字塔场景解析网络(PSPNet)开发。给定输入图像,卷积神经网络(ResNet50)作为编码器,用于生成最后一层卷积的特征图。
对于定量评估,使用平均 F-score 和 IoU 值来评估预测结果与真实结果的接近程度。验证和测试数据集的 F-score 和 IoU 值分别为 0.63、0.49 和 0.66、0.52。对于节段水平的诊断准确性,DL 模型对 FC、PIT、FA 和 HER 的接收者操作特征曲线下面积分别为 0.91、0.85、0.86 和 0.86,与专家观察者相当。
DL 对 OFDI 图像中冠状动脉斑块的语义分割可作为一种工具,使用组织学发现作为金标准自动对动脉粥样硬化斑块进行分类。该方法可以帮助介入心脏病学家了解斑块的组织学特性。