Xu Aobo, Shen Shaofei, Chen Wenkang, Zhang Xuejun
School of Computer, Electronics and Information, Guangxi University, Nanning, China.
R&D Center, Digital Guangxi Group Ltd., Nanning, China.
Med Phys. 2025 Sep;52(9):e18104. doi: 10.1002/mp.18104.
Deformable medical image registration is a critical task in medical imaging-assisted diagnosis and treatment. In recent years, medical image registration methods based on deep learning have made significant success by leveraging prior knowledge, and the registration accuracy and computational efficiency have been greatly improved. Models based on Transformers have achieved better performance than convolutional neural network methods (ConvNet) in image registration. However, their secondary computational complexity leads to significant computational overhead, posing substantial challenges for deployment in resource-constrained medical environments. Recently, Mamba-2 introduced the structured state-space Duality (SSD) framework to address the high computational cost of Transformer, achieving state-of-the-art performance across multiple domains. Mamba-2 may be a more powerful competitor than Transformer in the field of image registration. The design of its global receptive field and linear computational complexity enable it to show substantial advantages and efficiency in accurately understanding the nonlinear spatial relationships between the moving images and fixed images.
To address the challenges of deployment in resource-constrained medical environments and further improve the efficiency and accuracy of medical image registration, we propose HybridMorph, a lightweight hybrid Mamba2 model for medical image registration. In this study, we also introduce three versions of HybridMorph with different parameter numbers.
We propose a Residual Hybrid Module (RHM) that reconstructs a feature extraction module for medical image registration tasks based on convolution and Mamba-2, along with a novel lightweight method called the parallel channel feature aggregator (PCFA), which extracts richer feature representations with lower computational overhead.
The proposed model was evaluated by comparing it with various existing baseline registration methods. The results show that HybridMorph achieves significant performance improvements over the baseline methods, achieving the highest average Dice scores of 0.780 and 0.824 in atlas-to-patient and inter-patient brain Magnetic Resonance Imaging (MRI) registration, respectively. Notably, compared to the renowned TransMorph, HybridMorph achieves superior registration performance while reducing the number of parameters and computational cost by 10.1 and 5.8 times, respectively.
HybridMorph brings significant performance improvements and lower computational overhead compared to baseline methods, demonstrating the potential of our model in promoting the lightweight design of medical image registration models.
可变形医学图像配准是医学影像辅助诊断和治疗中的一项关键任务。近年来,基于深度学习的医学图像配准方法通过利用先验知识取得了显著成功,配准精度和计算效率得到了极大提高。基于Transformer的模型在图像配准方面比卷积神经网络方法(ConvNet)表现更好。然而,其二次计算复杂度导致了巨大的计算开销,给在资源受限的医学环境中部署带来了重大挑战。最近,Mamba-2引入了结构化状态空间对偶(SSD)框架来解决Transformer的高计算成本问题,在多个领域取得了领先性能。在图像配准领域,Mamba-2可能是比Transformer更强大的竞争对手。其全局感受野设计和线性计算复杂度使其在准确理解移动图像和固定图像之间的非线性空间关系方面展现出显著优势和效率。
为应对在资源受限的医学环境中部署的挑战,并进一步提高医学图像配准的效率和准确性,我们提出了HybridMorph,一种用于医学图像配准的轻量级混合Mamba2模型。在本研究中,我们还介绍了具有不同参数数量的三个版本的HybridMorph。
我们提出了一种残差混合模块(RHM),它基于卷积和Mamba-2为医学图像配准任务重建一个特征提取模块,以及一种名为并行通道特征聚合器(PCFA)的新型轻量级方法,该方法以较低的计算开销提取更丰富的特征表示。
通过将所提出的模型与各种现有的基线配准方法进行比较来对其进行评估。结果表明,HybridMorph相对于基线方法实现了显著的性能提升,在图谱到患者和患者间脑磁共振成像(MRI)配准中分别达到了0.780和0.824的最高平均骰子系数得分。值得注意的是,与著名的TransMorph相比,HybridMorph在实现卓越配准性能的同时,参数数量和计算成本分别减少了10.1倍和5.8倍。
与基线方法相比,HybridMorph带来了显著的性能提升和更低的计算开销,证明了我们的模型在推动医学图像配准模型轻量级设计方面的潜力。