Engineering Research Center of Intelligent Control for Underground Space, Ministry of Education, China University of Mining and Technology, Xuzhou, 221116, China; School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China.
Engineering Research Center of Intelligent Control for Underground Space, Ministry of Education, China University of Mining and Technology, Xuzhou, 221116, China; School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China.
Comput Methods Programs Biomed. 2022 Jun;219:106779. doi: 10.1016/j.cmpb.2022.106779. Epub 2022 Mar 27.
Cataract is one of the most common causes of vision loss. Light scattering due to clouding of the lens in cataract patients makes it extremely difficult to image the retina of cataract patients with fundus cameras, resulting in a serious decrease in the quality of the retinal images taken. Furthermore, the age of cataract patients is generally too old, in addition to cataracts, the patients often have other retinal diseases, which brings great challenges to experts in the clinical diagnosis of cataract patients using retinal imaging.
In this paper, we present the End-to-End Residual Attention Mechanism (ERAN) for Cataractous Retinal Image Dehazing, which it includes four modules: encoding module, multi-scale feature extraction module, feature fusion module, and decoding module. The encoding module encodes the input cataract haze image into an image, facilitating subsequent feature extraction and reducing memory usage. The multi-scale feature extraction module includes a hole convolution module, a residual block, and an adaptive skip connection, which can expand the receptive field and extract features of different scales through weighted screening for fusion. The feature fusion module uses adaptive skip connections to enhance the network's ability to extract haze density images to make haze removal more thorough. Furthermore, the decoding module performs non-linear mapping on the fused features to obtain the haze density image, and then restores the haze-free image.
The experimental results show that the proposed method has achieved better objective and subjective evaluation results, and has a better dehazing effect.
We proposed ERAN method not only provides visually better images, but also helps experts better diagnose other retinal diseases in cataract patients, leading to better care and treatment.
白内障是导致视力丧失的最常见原因之一。白内障患者的晶状体混浊导致光散射,使得使用眼底相机对白内障患者的视网膜进行成像变得极其困难,从而导致所拍摄的视网膜图像质量严重下降。此外,白内障患者的年龄通常较大,除了白内障外,患者通常还患有其他视网膜疾病,这给使用视网膜成像对白内障患者进行临床诊断的专家带来了巨大挑战。
本文提出了一种用于白内障视网膜图像去雾的端到端残差注意机制(ERAN),它包括四个模块:编码模块、多尺度特征提取模块、特征融合模块和解码模块。编码模块将输入的白内障雾图像编码成图像,便于后续的特征提取并减少内存使用。多尺度特征提取模块包括空洞卷积模块、残差块和自适应跳跃连接,通过加权筛选融合来扩展感受野并提取不同尺度的特征。特征融合模块使用自适应跳跃连接来增强网络提取雾密度图像的能力,从而使去雾更彻底。此外,解码模块对融合后的特征进行非线性映射,得到雾密度图像,然后恢复无雾图像。
实验结果表明,所提出的方法在客观和主观评估方面都取得了更好的结果,并且具有更好的去雾效果。
我们提出的 ERAN 方法不仅提供了视觉效果更好的图像,还有助于专家更好地诊断白内障患者的其他视网膜疾病,从而提供更好的护理和治疗。