Deng Liwei, Lan Qi, Yang Xin, Wang Jing, Huang Sijuan
Harbin University of Science and Technology, Harbin, China.
Sun Yat-sen University Cancer Center, Guangzhou, China.
Abdom Radiol (NY). 2025 Apr;50(4):1876-1886. doi: 10.1007/s00261-024-04602-3. Epub 2024 Sep 26.
3D multimodal medical image deformable registration plays a significant role in medical image analysis and diagnosis. However, due to the substantial differences between images of different modalities, registration is challenging and requires high computational costs. Deep learning-based registration methods face these challenges. The primary aim of this paper is to design a 3D multimodal registration network that ensures high-quality registration results while reducing the number of parameters.
This study designed a Dual-Encoder More Lightweight Registration Network (DELR-Net). DELR-Net is a low-complexity network that integrates Mamba and ConvNet. The State Space Sequence Module and the Dynamic Large Kernel block are used as the main components of the dual encoders, while the Dynamic Feature Fusion block is used as the main component of the decoder.
This study conducted experiments on 3D brain MR images and abdominal MR and CT images. Compared to existing registration methods, DELR-Net achieved better registration results while maintaining a lower number of parameters. Additionally, generalization experiments on other modalities showed that DELR-Net has superior generalization capabilities.
DELR-Net significantly improves the limitations of 3D multimodal medical image deformable registration, achieving better registration performance with fewer parameters.
三维多模态医学图像可变形配准在医学图像分析与诊断中发挥着重要作用。然而,由于不同模态图像之间存在显著差异,配准具有挑战性且需要高昂的计算成本。基于深度学习的配准方法面临这些挑战。本文的主要目的是设计一种三维多模态配准网络,在减少参数数量的同时确保高质量的配准结果。
本研究设计了一种双编码器更轻量级配准网络(DELR-Net)。DELR-Net是一个集成了曼巴(Mamba)和卷积网络(ConvNet)的低复杂度网络。状态空间序列模块和动态大内核块用作双编码器的主要组件,而动态特征融合块用作解码器的主要组件。
本研究对三维脑磁共振图像以及腹部磁共振和计算机断层扫描图像进行了实验。与现有配准方法相比,DELR-Net在保持较少参数数量的同时取得了更好的配准结果。此外,在其他模态上的泛化实验表明,DELR-Net具有卓越的泛化能力。
DELR-Net显著改善了三维多模态医学图像可变形配准的局限性,以更少的参数实现了更好的配准性能。