• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于多模态图像配准的对抗式单模态和多模态流网络

Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration.

作者信息

Xu Zhe, Luo Jie, Yan Jiangpeng, Pulya Ritvik, Li Xiu, Wells William, Jagadeesan Jayender

机构信息

Shenzhen International Graduate School, Tsinghua University, China.

Brigham and Women's Hospital, Harvard Medical School, USA.

出版信息

Med Image Comput Comput Assist Interv. 2020 Oct;12263:222-232. doi: 10.1007/978-3-030-59716-0_22. Epub 2020 Sep 29.

DOI:10.1007/978-3-030-59716-0_22
PMID:33283210
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7712495/
Abstract

Deformable image registration between Computed Tomography (CT) images and Magnetic Resonance (MR) imaging is essential for many image-guided therapies. In this paper, we propose a novel translation-based unsupervised deformable image registration method. Distinct from other translation-based methods that attempt to convert the multimodal problem (e.g., CT-to-MR) into a unimodal problem (e.g., MR-to-MR) via image-to-image translation, our method leverages the deformation fields estimated from both: (i) the translated MR image and (ii) the original CT image in a dual-stream fashion, and automatically learns how to fuse them to achieve better registration performance. The multimodal registration network can be effectively trained by computationally efficient similarity metrics without any ground-truth deformation. Our method has been evaluated on two clinical datasets and demonstrates promising results compared to state-of-the-art traditional and learning-based methods.

摘要

计算机断层扫描(CT)图像与磁共振(MR)成像之间的可变形图像配准对于许多图像引导治疗至关重要。在本文中,我们提出了一种基于平移的新型无监督可变形图像配准方法。与其他基于平移的方法不同,其他方法试图通过图像到图像的转换将多模态问题(例如,CT到MR)转换为单模态问题(例如,MR到MR),我们的方法以双流方式利用从以下两者估计的变形场:(i)平移后的MR图像和(ii)原始CT图像,并自动学习如何融合它们以实现更好的配准性能。多模态配准网络可以通过计算效率高的相似性度量进行有效训练,而无需任何地面真值变形。我们的方法已经在两个临床数据集上进行了评估,与当前最先进的传统方法和基于学习的方法相比,取得了有前景的结果。

相似文献

1
Adversarial Uni- and Multi-modal Stream Networks for Multimodal Image Registration.用于多模态图像配准的对抗式单模态和多模态流网络
Med Image Comput Comput Assist Interv. 2020 Oct;12263:222-232. doi: 10.1007/978-3-030-59716-0_22. Epub 2020 Sep 29.
2
Geometry-Consistent Adversarial Registration Model for Unsupervised Multi-Modal Medical Image Registration.基于几何一致性对抗的无监督多模态医学图像配准方法。
IEEE J Biomed Health Inform. 2023 Jul;27(7):3455-3466. doi: 10.1109/JBHI.2023.3270199. Epub 2023 Jun 30.
3
Adversarial learning for mono- or multi-modal registration.对抗学习的单模态或多模态配准。
Med Image Anal. 2019 Dec;58:101545. doi: 10.1016/j.media.2019.101545. Epub 2019 Aug 24.
4
F3RNet: full-resolution residual registration network for deformable image registration.F3RNet:用于可变形图像配准的全分辨率残差配准网络。
Int J Comput Assist Radiol Surg. 2021 Jun;16(6):923-932. doi: 10.1007/s11548-021-02359-4. Epub 2021 May 3.
5
Unsupervised registration for liver CT-MR images based on the multiscale integrated spatial-weight module and dual similarity guidance.基于多尺度集成空间权重模块和双相似性引导的肝脏 CT-MR 图像无监督配准。
Comput Med Imaging Graph. 2023 Sep;108:102260. doi: 10.1016/j.compmedimag.2023.102260. Epub 2023 Jun 14.
6
UNSUPERVISED MULTIMODAL IMAGE REGISTRATION WITH ADAPTATIVE GRADIENT GUIDANCE.基于自适应梯度引导的无监督多模态图像配准
Proc IEEE Int Conf Acoust Speech Signal Process. 2021 Jun;2021. doi: 10.1109/icassp39728.2021.9414320. Epub 2021 May 13.
7
UNIMODAL CYCLIC REGULARIZATION FOR TRAINING MULTIMODAL IMAGE REGISTRATION NETWORKS.用于训练多模态图像配准网络的单峰循环正则化
Proc IEEE Int Symp Biomed Imaging. 2021 Apr;2021. doi: 10.1109/isbi48211.2021.9433926. Epub 2021 May 25.
8
macJNet: weakly-supervised multimodal image deformable registration using joint learning framework and multi-sampling cascaded MIND.macJNet:基于联合学习框架和多采样级联 MIND 的弱监督多模态图像变形配准。
Biomed Eng Online. 2023 Sep 19;22(1):91. doi: 10.1186/s12938-023-01143-6.
9
Adversarial Similarity Network for Evaluating Image Alignment in Deep Learning based Registration.用于评估基于深度学习的配准中图像对齐的对抗相似性网络
Med Image Comput Comput Assist Interv. 2018 Sep;11070:739-746. doi: 10.1007/978-3-030-00928-1_83. Epub 2018 Sep 26.
10
Unsupervised learning for deformable registration of thoracic CT and cone-beam CT based on multiscale features matching with spatially adaptive weighting.基于多尺度特征匹配和空间自适应加权的非监督学习在胸 CT 和锥束 CT 变形配准中的应用。
Med Phys. 2020 Nov;47(11):5632-5647. doi: 10.1002/mp.14464. Epub 2020 Oct 7.

引用本文的文献

1
A survey on deep learning in medical image registration: New technologies, uncertainty, evaluation metrics, and beyond.医学图像配准中的深度学习综述:新技术、不确定性、评估指标及其他
Med Image Anal. 2025 Feb;100:103385. doi: 10.1016/j.media.2024.103385. Epub 2024 Nov 10.
2
Medical image registration and its application in retinal images: a review.医学图像配准及其在视网膜图像中的应用:综述
Vis Comput Ind Biomed Art. 2024 Aug 21;7(1):21. doi: 10.1186/s42492-024-00173-8.
3
DeepMesh: Mesh-Based Cardiac Motion Tracking Using Deep Learning.深网:基于网格的深度学习心脏运动跟踪。
IEEE Trans Med Imaging. 2024 Apr;43(4):1489-1500. doi: 10.1109/TMI.2023.3340118. Epub 2024 Apr 3.
4
macJNet: weakly-supervised multimodal image deformable registration using joint learning framework and multi-sampling cascaded MIND.macJNet:基于联合学习框架和多采样级联 MIND 的弱监督多模态图像变形配准。
Biomed Eng Online. 2023 Sep 19;22(1):91. doi: 10.1186/s12938-023-01143-6.
5
A transformer-based hierarchical registration framework for multimodality deformable image registration.基于变压器的多层次配准框架,用于多模态可变形图像配准。
Comput Med Imaging Graph. 2023 Sep;108:102286. doi: 10.1016/j.compmedimag.2023.102286. Epub 2023 Aug 10.
6
Double-Uncertainty Guided Spatial and Temporal Consistency Regularization Weighting for Learning-based Abdominal Registration.基于学习的腹部配准的双不确定性引导的时空一致性正则化加权
Med Image Comput Comput Assist Interv. 2022 Sep;2022:14-24. Epub 2022 Sep 17.
7
DuSFE: Dual-Channel Squeeze-Fusion-Excitation co-attention for cross-modality registration of cardiac SPECT and CT.双通挤压融合激励协同注意力在心脏 SPECT 和 CT 的跨模态配准中的应用。
Med Image Anal. 2023 Aug;88:102840. doi: 10.1016/j.media.2023.102840. Epub 2023 May 16.
8
Deep learning based registration of serial whole-slide histopathology images in different stains.基于深度学习的不同染色的连续全切片组织病理学图像配准
J Pathol Inform. 2023 Apr 23;14:100311. doi: 10.1016/j.jpi.2023.100311. eCollection 2023.
9
A review of deep learning-based deformable medical image registration.基于深度学习的可变形医学图像配准综述。
Front Oncol. 2022 Dec 7;12:1047215. doi: 10.3389/fonc.2022.1047215. eCollection 2022.
10
Review of Generative Adversarial Networks in mono- and cross-modal biomedical image registration.单模态和跨模态生物医学图像配准中生成对抗网络综述
Front Neuroinform. 2022 Nov 22;16:933230. doi: 10.3389/fninf.2022.933230. eCollection 2022.

本文引用的文献

1
Unsupervised 3D End-to-End Medical Image Registration With Volume Tweening Network.无监督的 3D 端到端医学图像配准方法,采用体素插值网络。
IEEE J Biomed Health Inform. 2020 May;24(5):1394-1404. doi: 10.1109/JBHI.2019.2951024. Epub 2019 Nov 1.
2
Deep Learning based Inter-Modality Image Registration Supervised by Intra-Modality Similarity.基于深度学习的模态内相似性监督的跨模态图像配准
Mach Learn Med Imaging. 2018 Sep;11046:55-63. doi: 10.1007/978-3-030-00919-9_7. Epub 2018 Sep 15.
3
A deep learning framework for unsupervised affine and deformable image registration.用于无监督仿射和变形图像配准的深度学习框架。
Med Image Anal. 2019 Feb;52:128-143. doi: 10.1016/j.media.2018.11.010. Epub 2018 Dec 8.
4
Weakly-supervised convolutional neural networks for multimodal image registration.基于弱监督卷积神经网络的多模态图像配准
Med Image Anal. 2018 Oct;49:1-13. doi: 10.1016/j.media.2018.07.002. Epub 2018 Jul 4.
5
Deformable Image Registration based on Similarity-Steered CNN Regression.基于相似性引导卷积神经网络回归的可变形图像配准
Med Image Comput Comput Assist Interv. 2017 Sep;10433:300-308. doi: 10.1007/978-3-319-66182-7_35. Epub 2017 Sep 4.
6
MIND: modality independent neighbourhood descriptor for multi-modal deformable registration.MIND:用于多模态可变形配准的模态无关邻域描述符。
Med Image Anal. 2012 Oct;16(7):1423-35. doi: 10.1016/j.media.2012.05.008. Epub 2012 May 31.
7
A reproducible evaluation of ANTs similarity metric performance in brain image registration.在脑影像配准中重复评估 ANTs 相似性度量性能。
Neuroimage. 2011 Feb 1;54(3):2033-44. doi: 10.1016/j.neuroimage.2010.09.025. Epub 2010 Sep 17.
8
Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain.基于互相关的对称微分同胚图像配准:评估老年人和神经退行性脑部的自动标记
Med Image Anal. 2008 Feb;12(1):26-41. doi: 10.1016/j.media.2007.06.004. Epub 2007 Jun 23.
9
Image quality assessment: from error visibility to structural similarity.图像质量评估:从误差可见性到结构相似性。
IEEE Trans Image Process. 2004 Apr;13(4):600-12. doi: 10.1109/tip.2003.819861.