Almasi Ramin, Vafaei Abbas, Ghasemi Zeinab, Ommani Mohammad Reza, Dehghani Ali Reza, Rabbani Hossein
Department of Computer Engineering, Faculty of Engineering, University of Isfahan, Isfahan, Iran.
Department of Electrical and Computer Engineering, University of Detroit Mercy, Detroit, MI 48202, USA.
Biomed Opt Express. 2020 Jun 2;11(7):3455-3476. doi: 10.1364/BOE.395784. eCollection 2020 Jul 1.
Accurate and automatic registration of multimodal retinal images such as fluorescein angiography (FA) and optical coherence tomography (OCT) enables utilization of supplementary information. FA is a gold standard imaging modality that depicts neurovascular structure of retina and is used for diagnosing neurovascular-related diseases such as diabetic retinopathy (DR). Unlike FA, OCT is non-invasive retinal imaging modality that provides cross-sectional data of retina. Due to differences in contrast, resolution and brightness of multimodal retinal images, the images resulted from vessel extraction of image pairs are not exactly the same. Also, prevalent feature detection, extraction and matching schemes do not result in perfect matches. In addition, the relationships between retinal image pairs are usually modeled by affine transformation, which cannot generate accurate alignments due to the non-planar retina surface. In this paper, a precise registration scheme is proposed to align FA and OCT images via scanning laser ophthalmoscopy (SLO) photographs as intermediate images. For this purpose, first a retinal vessel segmentation is applied to extract main blood vessels from the FA and SLO images. Next, a novel global registration is proposed based on the Gaussian model for curved surface of retina. For doing so, first a global rigid transformation is applied to FA vessel-map image using a new feature-based method to align it with SLO vessel-map photograph, in a way that outlier matched features resulted from not-perfect vessel segmentation are completely eliminated. After that, the transformed image is globally registered again considering Gaussian model for curved surface of retina to improve the precision of the previous step. Eventually a local non-rigid transformation is exploited to register two images perfectly. The experimental results indicate the presented scheme is more precise compared to other registration methods.
准确且自动地配准多模态视网膜图像,如荧光素血管造影(FA)和光学相干断层扫描(OCT),能够利用补充信息。FA是一种描绘视网膜神经血管结构的金标准成像方式,用于诊断糖尿病视网膜病变(DR)等神经血管相关疾病。与FA不同,OCT是一种提供视网膜横截面数据的非侵入性视网膜成像方式。由于多模态视网膜图像在对比度、分辨率和亮度上存在差异,从图像对的血管提取中得到的图像并不完全相同。此外,普遍的特征检测、提取和匹配方案也无法实现完美匹配。另外,视网膜图像对之间的关系通常由仿射变换建模,由于视网膜表面是非平面的,这种变换无法生成精确的对齐。本文提出了一种精确的配准方案,通过扫描激光检眼镜(SLO)照片作为中间图像来对齐FA和OCT图像。为此,首先应用视网膜血管分割从FA和SLO图像中提取主要血管。接下来,基于视网膜曲面的高斯模型提出了一种新颖的全局配准方法。具体做法是,首先使用一种基于新特征的方法对FA血管图图像进行全局刚性变换,使其与SLO血管图照片对齐,从而完全消除因血管分割不完美而导致的异常匹配特征。之后,考虑视网膜曲面高斯模型对变换后的图像再次进行全局配准,以提高上一步的精度。最终利用局部非刚性变换完美地配准两幅图像。实验结果表明,与其他配准方法相比,本文提出的方案更为精确。