Lee Juhwan, Kim Justin N, Gomez-Perez Lia, Gharaibeh Yazan, Motairek Issam, Pereira Gabriel T R, Zimin Vladislav N, Dallan Luis A P, Hoori Ammar, Al-Kindi Sadeer, Guagliumi Giulio, Bezerra Hiram G, Wilson David L
Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH 44106, USA.
Department of Biomedical Engineering, The Ohio State University, Columbus, OH 43210, USA.
Bioengineering (Basel). 2022 Nov 3;9(11):648. doi: 10.3390/bioengineering9110648.
Microvessels in vascular plaque are associated with plaque progression and are found in plaque rupture and intra-plaque hemorrhage. To analyze this characteristic of vulnerability, we developed an automated deep learning method for detecting microvessels in intravascular optical coherence tomography (IVOCT) images. A total of 8403 IVOCT image frames from 85 lesions and 37 normal segments were analyzed. Manual annotation was performed using a dedicated software (OCTOPUS) previously developed by our group. Data augmentation in the polar (,) domain was applied to raw IVOCT images to ensure that microvessels appear at all possible angles. Pre-processing methods included guidewire/shadow detection, lumen segmentation, pixel shifting, and noise reduction. DeepLab v3+ was used to segment microvessel candidates. A bounding box on each candidate was classified as either microvessel or non-microvessel using a shallow convolutional neural network. For better classification, we used data augmentation (i.e., angle rotation) on bounding boxes with a microvessel during network training. Data augmentation and pre-processing steps improved microvessel segmentation performance significantly, yielding a method with Dice of 0.71 ± 0.10 and pixel-wise sensitivity/specificity of 87.7 ± 6.6%/99.8 ± 0.1%. The network for classifying microvessels from candidates performed exceptionally well, with sensitivity of 99.5 ± 0.3%, specificity of 98.8 ± 1.0%, and accuracy of 99.1 ± 0.5%. The classification step eliminated the majority of residual false positives and the Dice coefficient increased from 0.71 to 0.73. In addition, our method produced 698 image frames with microvessels present, compared with 730 from manual analysis, representing a 4.4% difference. When compared with the manual method, the automated method improved microvessel continuity, implying improved segmentation performance. The method will be useful for research purposes as well as potential future treatment planning.
血管斑块中的微血管与斑块进展相关,且在斑块破裂和斑块内出血中存在。为分析这种易损性特征,我们开发了一种用于在血管内光学相干断层扫描(IVOCT)图像中检测微血管的自动化深度学习方法。共分析了来自85个病变和37个正常节段的8403个IVOCT图像帧。使用我们团队先前开发的专用软件(OCTOPUS)进行手动标注。对原始IVOCT图像应用极坐标(,)域中的数据增强,以确保微血管出现在所有可能的角度。预处理方法包括导丝/阴影检测、管腔分割、像素移位和降噪。使用DeepLab v3+分割微血管候选区域。使用浅层卷积神经网络将每个候选区域的边界框分类为微血管或非微血管。为了更好地分类,我们在网络训练期间对带有微血管的边界框使用数据增强(即角度旋转)。数据增强和预处理步骤显著提高了微血管分割性能,得到了一种Dice系数为0.71±0.10、像素级灵敏度/特异性为87.7±6.6%/99.8±0.1%的方法。从候选区域中分类微血管的网络表现出色,灵敏度为99.5±0.3%,特异性为98.8±1.0%,准确率为99.1±0.5%。分类步骤消除了大部分残留的假阳性,Dice系数从0.71提高到0.73。此外,我们的方法生成了698个存在微血管的图像帧,而手动分析为730个,相差4.4%。与手动方法相比,自动化方法改善了微血管的连续性,意味着分割性能得到了提高。该方法将对研究目的以及未来潜在的治疗规划有用。