Suppr超能文献

基于自适应梯度引导的无监督多模态图像配准

UNSUPERVISED MULTIMODAL IMAGE REGISTRATION WITH ADAPTATIVE GRADIENT GUIDANCE.

作者信息

Xu Zhe, Yan Jiangpeng, Luo Jie, Li Xiu, Jagadeesan Jayender

机构信息

Shenzhen International Graduate School, Tsinghua University, Shenzhen, China.

Brigham and Women's Hospital, Harvard Medical School, Boston, USA.

出版信息

Proc IEEE Int Conf Acoust Speech Signal Process. 2021 Jun;2021. doi: 10.1109/icassp39728.2021.9414320. Epub 2021 May 13.

Abstract

Multimodal image registration (MIR) is a fundamental procedure in many image-guided therapies. Recently, unsupervised learning-based methods have demonstrated promising performance over accuracy and efficiency in deformable image registration. However, the estimated deformation fields of the existing methods fully rely on the to-be-registered image pair. It is difficult for the networks to be aware of the mismatched boundaries, resulting in unsatisfactory organ boundary alignment. In this paper, we propose a novel multimodal registration framework, which elegantly leverages the deformation fields estimated from both: (i) the original to-be-registered image pair, (ii) their corresponding gradient intensity maps, and adaptively fuses them with the proposed gated fusion module. With the help of auxiliary gradient-space guidance, the network can concentrate more on the spatial relationship of the organ boundary. Experimental results on two clinically acquired CT-MRI datasets demonstrate the effectiveness of our proposed approach.

摘要

多模态图像配准(MIR)是许多图像引导治疗中的一个基本过程。最近,基于无监督学习的方法在可变形图像配准的准确性和效率方面表现出了令人期待的性能。然而,现有方法估计的变形场完全依赖于待配准的图像对。网络很难察觉到不匹配的边界,导致器官边界对齐效果不理想。在本文中,我们提出了一种新颖的多模态配准框架,该框架巧妙地利用了从以下两方面估计的变形场:(i)原始待配准图像对;(ii)它们相应的梯度强度图,并通过提出的门控融合模块对其进行自适应融合。在辅助梯度空间引导的帮助下,网络可以更多地关注器官边界的空间关系。在两个临床采集的CT-MRI数据集上的实验结果证明了我们提出的方法的有效性。

相似文献

1
UNSUPERVISED MULTIMODAL IMAGE REGISTRATION WITH ADAPTATIVE GRADIENT GUIDANCE.基于自适应梯度引导的无监督多模态图像配准
Proc IEEE Int Conf Acoust Speech Signal Process. 2021 Jun;2021. doi: 10.1109/icassp39728.2021.9414320. Epub 2021 May 13.
2
Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration.用于多模态图像配准的对抗式单模态和多模态流网络
Med Image Comput Comput Assist Interv. 2020 Oct;12263:222-232. doi: 10.1007/978-3-030-59716-0_22. Epub 2020 Sep 29.
4
Self-Distilled Hierarchical Network for Unsupervised Deformable Image Registration.自蒸馏分层网络的无监督可变形图像配准。
IEEE Trans Med Imaging. 2023 Aug;42(8):2162-2175. doi: 10.1109/TMI.2023.3244333. Epub 2023 Aug 1.

本文引用的文献

1
2
Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration.用于多模态图像配准的对抗式单模态和多模态流网络
Med Image Comput Comput Assist Interv. 2020 Oct;12263:222-232. doi: 10.1007/978-3-030-59716-0_22. Epub 2020 Sep 29.
4
Adversarial learning for mono- or multi-modal registration.对抗学习的单模态或多模态配准。
Med Image Anal. 2019 Dec;58:101545. doi: 10.1016/j.media.2019.101545. Epub 2019 Aug 24.

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验