Peng Bincheng, Fan Chao
School of Artificial Intelligence and Big Data, Henan University of Technology, Zhengzhou, China.
J Imaging Inform Med. 2025 Feb;38(1):602-614. doi: 10.1007/s10278-024-01217-4. Epub 2024 Aug 6.
Currently, deep learning is developing rapidly in the field of image segmentation, and medical image segmentation is one of the key applications in this field. Conventional CNN has achieved great success in general medical image segmentation tasks, but it has feature loss in the feature extraction part and lacks the ability to explicitly model remote dependencies, which makes it difficult to adapt to the task of human organ segmentation. Although methods containing attention mechanisms have made good progress in the field of semantic segmentation, most of the current attention mechanisms are limited to a single sample, while the number of samples of human organ images is large, ignoring the correlation between the samples is not conducive to image segmentation. In order to solve these problems, an internal and external dual-attention segmentation network (IEA-Net) is proposed in this paper, and the ICSwR (interleaved convolutional system with residual) module and the IEAM module are designed in this network. The ICSwR contains interleaved convolution and hopping connection, which are used for the initial extraction of the features in the encoder part. The IEAM module (internal and external dual-attention module) consists of the LGGW-SA (local-global Gaussian-weighted self-attention) module and the EA module, which are in a tandem structure. The LGGW-SA module focuses on learning local-global feature correlations within individual samples for efficient feature extraction. Meanwhile, the EA module is designed to capture inter-sample connections, addressing multi-sample complexities. Additionally, skip connections will be incorporated into each IEAM module within both the encoder and decoder to reduce feature loss. We tested our method on the Synapse multi-organ segmentation dataset and the ACDC cardiac segmentation dataset, and the experimental results show that the proposed method achieves better performance than other state-of-the-art methods.
当前,深度学习在图像分割领域发展迅速,医学图像分割是该领域的关键应用之一。传统卷积神经网络(CNN)在一般医学图像分割任务中取得了巨大成功,但在特征提取部分存在特征损失,且缺乏对远程依赖进行显式建模的能力,这使得它难以适应人体器官分割任务。尽管包含注意力机制的方法在语义分割领域取得了良好进展,但目前大多数注意力机制仅限于单个样本,而人体器官图像的样本数量众多,忽略样本之间的相关性不利于图像分割。为了解决这些问题,本文提出了一种内外双注意力分割网络(IEA-Net),并在该网络中设计了ICSwR(带残差的交错卷积系统)模块和IEAM模块。ICSwR包含交错卷积和跳跃连接,用于编码器部分特征的初始提取。IEAM模块(内外双注意力模块)由LGGW-SA(局部-全局高斯加权自注意力)模块和EA模块组成,它们呈串联结构。LGGW-SA模块专注于学习单个样本内的局部-全局特征相关性以进行高效特征提取。同时,EA模块旨在捕捉样本间连接,解决多样本复杂性问题。此外,跳跃连接将被纳入编码器和解码器中的每个IEAM模块以减少特征损失。我们在Synapse多器官分割数据集和ACDC心脏分割数据集上测试了我们的方法,实验结果表明,所提出的方法比其他现有最先进方法具有更好的性能。