Jalili Jalil, Rabbani Hossein, Dehnavi Alireza Mehri, Kafieh Raheleh, Akhlaghi Mohammadreza
Medical Physics and Biomedical Engineering Unit, Ophthalmic Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran.
Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran.
J Med Signals Sens. 2020 Apr 25;10(2):76-85. doi: 10.4103/jmss.JMSS_43_19. eCollection 2020 Apr-Jun.
Image fusion is the process of combining the information of several input images into one image. Projection images obtained from three-dimensional (3D) optical coherence tomography (OCT) can show inlier retinal pathology and abnormalities that are not visible in conventional fundus images. In recent years, the projection image is often made by an average on all retina that causes to lose many intraretinal details.
In this study, we focus on the formation of optimum projection images from retinal layers using Curvelet-based image fusion. The latter consists of three main steps. In the earlier studies, macular spectral 3D data using diffusion map-based OCT were segmented into 12 different boundaries identifying 11 retinal layers in three dimensions. In the second step, projection images are attained using conducting some statistical methods on the space between each pair of boundaries. In the next step, retinal layers are merged using Curvelet transform to make the final projection images.
These images contain integrated retinal depth information as well as an ideal opportunity to better extract retinal features such as vessels and the macula region. Finally, qualitative and quantitative evaluations show the superiority of this method to the average-based and wavelet-based fusion methods. Overall, our method obtains the best results for image fusion in all terms such as entropy (6.7744) and AG (9.5491).
Creating an image with more and detailed information made by the Curvelet-based image fusion has significantly higher contrast. There are also many thin veins in Curvelet-based fused image, which are absent in average-based and wavelet-based fused images.
图像融合是将多个输入图像的信息组合成一幅图像的过程。从三维(3D)光学相干断层扫描(OCT)获得的投影图像可以显示常规眼底图像中不可见的视网膜内层病变和异常。近年来,投影图像通常是通过对整个视网膜进行平均得到的,这导致许多视网膜内细节丢失。
在本研究中,我们专注于使用基于Curvelet变换的图像融合从视网膜层形成最佳投影图像。后者包括三个主要步骤。在早期研究中,使用基于扩散映射的OCT将黄斑光谱3D数据分割成12个不同的边界,在三维空间中识别出11个视网膜层。第二步,通过对每对边界之间的空间进行一些统计方法来获得投影图像。在下一步中,使用Curvelet变换合并视网膜层以制作最终的投影图像。
这些图像包含整合的视网膜深度信息,以及更好地提取视网膜特征(如血管和黄斑区域)的理想机会。最后,定性和定量评估表明该方法优于基于平均和基于小波的融合方法。总体而言,我们的方法在熵(6.7744)和AG(9.5491)等所有方面的图像融合中都取得了最佳结果。
基于Curvelet变换的图像融合创建的具有更多详细信息的图像具有显著更高的对比度。基于Curvelet变换的融合图像中也有许多细静脉,而基于平均和基于小波的融合图像中则没有。