School of Information Science and Engineering, Xinjiang University, Urumqi, China.
People's Hospital of Xinjiang Uygur Autonomous Region, Xinjiang University, Urumqi, China.
Med Phys. 2022 Dec;49(12):7609-7622. doi: 10.1002/mp.15872. Epub 2022 Jul 30.
Rapid and accurate segmentation of medical images can provide important guidance in the early stages of life-threatening diseases.
However, fuzzy edges and high similarity with the background in images usually cause undersegmentation or oversegmentation. To solve these problems.
We propose a novel edge features-reinforcement (EFR) module that uses relative frequency changes before and after warping images to extract edge information. Then, the EFR module leverages deep features to guide shallow features to produce a band-shaped edge attention map for reinforcing the edge region of all channels. We also propose a multiscale context exploration (MCE) module to fuse multiscale features and to extract channel and spatial correlations, which allows a model to focus on the parts that contribute most to the final segmentation. We construct EFR-Net by embedding EFR and MCE modules on the encoder-decoder architecture.
We verify EFR-Net's performance with four medical datasets: retinal vessel segmentation dataset DRIVE, endoscopic polyp segmentation dataset CVC-ClinicDB, dermoscopic image dataset ISIC2018, and aortic true lumen dataset Aorta-computed tomography (CT). The proposed model achieves Dice similarity coefficients (DSCs) of 81.61%, 92.87%, 89.87%, and 96.98% on DRIVE, CVC-ClinicDB, ISIC2018, and Aorta-CT, respectively, which are better than those of current mainstream methods. In particular, the DSC of polyp segmentation increased by 3.87%.
Through quantitative and qualitative research, our method is determined to surpass current mainstream segmentation methods, and EFR modules can effectively improve the edge prediction effect of color images and CT images. The proposed modules are easily embedded in other encoder-decoder architectures, which has the potential to be applied and expanded.
快速准确的医学图像分割可以在危及生命的疾病早期提供重要指导。
然而,图像中的边缘模糊和与背景高度相似通常会导致分割不足或过度分割。为了解决这些问题。
我们提出了一种新颖的边缘特征增强(EFR)模块,该模块使用图像变形前后的相对频率变化来提取边缘信息。然后,EFR 模块利用深度特征引导浅层特征生成带状边缘注意力图,以增强所有通道的边缘区域。我们还提出了一种多尺度上下文探索(MCE)模块,用于融合多尺度特征并提取通道和空间相关性,使模型能够专注于对最终分割贡献最大的部分。我们通过在编码器-解码器架构上嵌入 EFR 和 MCE 模块来构建 EFR-Net。
我们在四个医学数据集上验证了 EFR-Net 的性能:视网膜血管分割数据集 DRIVE、内窥镜息肉分割数据集 CVC-ClinicDB、皮肤镜图像数据集 ISIC2018 和主动脉计算机断层扫描(CT)数据集 Aorta-CT。所提出的模型在 DRIVE、CVC-ClinicDB、ISIC2018 和 Aorta-CT 上分别实现了 81.61%、92.87%、89.87%和 96.98%的 Dice 相似系数(DSC),优于当前主流方法。特别是,息肉分割的 DSC 提高了 3.87%。
通过定量和定性研究,我们的方法被确定超过了当前主流的分割方法,EFR 模块可以有效地提高彩色图像和 CT 图像的边缘预测效果。所提出的模块易于嵌入其他编码器-解码器架构,具有应用和扩展的潜力。