Suppr超能文献

用于皮质表面联合配准与分割的深度网络。

A Deep Network for Joint Registration and Parcellation of Cortical Surfaces.

作者信息

Zhao Fenqiang, Wu Zhengwang, Wang Li, Lin Weili, Xia Shunren, Li Gang

机构信息

Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.

Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, China.

出版信息

Med Image Comput Comput Assist Interv. 2021 Sep-Oct;12904:171-181. doi: 10.1007/978-3-030-87202-1_17. Epub 2021 Sep 21.

Abstract

Cortical surface registration and parcellation are two essential steps in neuroimaging analysis. Conventionally, they are performed independently as two tasks, ignoring the inherent connections of these two closely-related tasks. Essentially, both tasks rely on meaningful cortical feature representations, so they can be jointly optimized by learning shared useful cortical features. To this end, we propose a deep learning framework for joint cortical surface registration and parcellation. Specifically, our approach leverages the spherical topology of cortical surfaces and uses a spherical network as the shared encoder to first learn shared features for both tasks. Then we train two task-specific decoders for registration and parcellation, respectively. We further exploit the more explicit connection between them by incorporating the novel parcellation map similarity loss to enforce the boundary consistency of regions, thereby providing extra supervision for the registration task. Conversely, parcellation network training also benefits from the registration, which provides a large amount of augmented data by warping one surface with manual parcellation map to another surface, especially when only few manually-labeled surfaces are available. Experiments on a dataset with more than 600 cortical surfaces show that our approach achieves large improvements on both parcellation and registration accuracy (over separately trained networks) and enables training high-quality parcellation and registration models using much fewer labeled data.

摘要

皮质表面配准和分割是神经影像分析中的两个基本步骤。传统上,它们作为两个独立的任务分别执行,忽略了这两个紧密相关任务的内在联系。本质上,这两个任务都依赖于有意义的皮质特征表示,因此可以通过学习共享的有用皮质特征来进行联合优化。为此,我们提出了一种用于联合皮质表面配准和分割的深度学习框架。具体而言,我们的方法利用皮质表面的球面拓扑结构,并使用球面网络作为共享编码器,首先为这两个任务学习共享特征。然后我们分别为配准和分割训练两个特定于任务的解码器。我们通过纳入新颖的分割图相似性损失来进一步利用它们之间更明确的联系,以强制区域的边界一致性,从而为配准任务提供额外的监督。相反,分割网络的训练也受益于配准,配准通过将带有手动分割图的一个表面扭曲到另一个表面来提供大量的增强数据,特别是在只有很少的手动标记表面可用时。在一个包含600多个皮质表面的数据集上进行的实验表明,我们的方法在分割和配准精度方面(相对于单独训练的网络)都取得了大幅提升,并且能够使用少得多的标记数据训练高质量的分割和配准模型。

相似文献

1
A Deep Network for Joint Registration and Parcellation of Cortical Surfaces.
Med Image Comput Comput Assist Interv. 2021 Sep-Oct;12904:171-181. doi: 10.1007/978-3-030-87202-1_17. Epub 2021 Sep 21.
2
Longitudinally consistent registration and parcellation of cortical surfaces using semi-supervised learning.
Med Image Anal. 2024 Aug;96:103193. doi: 10.1016/j.media.2024.103193. Epub 2024 May 7.
3
Registration-Free Infant Cortical Surface Parcellation using Deep Convolutional Neural Networks.
Med Image Comput Comput Assist Interv. 2018 Sep;11072:672-680. doi: 10.1007/978-3-030-00931-1_77. Epub 2018 Sep 13.
4
Intrinsic Patch-Based Cortical Anatomical Parcellation Using Graph Convolutional Neural Network on Surface Manifold.
Med Image Comput Comput Assist Interv. 2019 Oct;11766:492-500. doi: 10.1007/978-3-030-32248-9_55. Epub 2019 Oct 10.
5
Geometric Brain Surface Network For Brain Cortical Parcellation.
Graph Learn Med Imaging (2019). 2019;11849:120-129. doi: 10.1007/978-3-030-35817-4_15. Epub 2019 Nov 14.
6
Cortical Surface Parcellation using Spherical Convolutional Neural Networks.
Med Image Comput Comput Assist Interv. 2019 Oct;11766:501-509. doi: 10.1007/978-3-030-32248-9_56. Epub 2019 Oct 10.
7
A joint parcellation and boundary network with multi-rate-shared dilated graph attention for cortical surface parcellation.
Med Biol Eng Comput. 2024 Feb;62(2):537-549. doi: 10.1007/s11517-023-02942-8. Epub 2023 Nov 10.
8
AUTOMATIC PARCELLATION OF CORTICAL SURFACES USING RANDOM FORESTS.
Proc IEEE Int Symp Biomed Imaging. 2015 Apr;2015:810-813. doi: 10.1109/ISBI.2015.7163995.
9
Learning joint surface reconstruction and segmentation, from brain images to cortical surface parcellation.
Med Image Anal. 2023 Dec;90:102974. doi: 10.1016/j.media.2023.102974. Epub 2023 Sep 22.
10
DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation.
Med Image Comput Comput Assist Interv. 2019 Oct;11765:420-429. doi: 10.1007/978-3-030-32245-8_47. Epub 2019 Oct 10.

引用本文的文献

1
Application of improved graph convolutional network for cortical surface parcellation.
Sci Rep. 2025 May 12;15(1):16409. doi: 10.1038/s41598-025-00116-0.
2
Longitudinally consistent registration and parcellation of cortical surfaces using semi-supervised learning.
Med Image Anal. 2024 Aug;96:103193. doi: 10.1016/j.media.2024.103193. Epub 2024 May 7.
3
Fast Spherical Mapping of Cortical Surface Meshes Using Deep Unsupervised Learning.
Med Image Comput Comput Assist Interv. 2022 Sep;13436:163-173. doi: 10.1007/978-3-031-16446-0_16. Epub 2022 Sep 17.
5
A review of deep learning-based deformable medical image registration.
Front Oncol. 2022 Dec 7;12:1047215. doi: 10.3389/fonc.2022.1047215. eCollection 2022.

本文引用的文献

1
S3Reg: Superfast Spherical Surface Registration Based on Deep Learning.
IEEE Trans Med Imaging. 2021 Aug;40(8):1964-1976. doi: 10.1109/TMI.2021.3069645. Epub 2021 Jul 30.
2
Unsupervised Learning for Spherical Surface Registration.
Mach Learn Med Imaging. 2020 Oct;12436:373-383. doi: 10.1007/978-3-030-59861-7_38. Epub 2020 Sep 29.
3
Spherical Deformable U-Net: Application to Cortical Surface Parcellation and Development Prediction.
IEEE Trans Med Imaging. 2021 Apr;40(4):1217-1228. doi: 10.1109/TMI.2021.3050072. Epub 2021 Apr 1.
4
DIKA-Nets: Domain-invariant knowledge-guided attention networks for brain skull stripping of early developing macaques.
Neuroimage. 2021 Feb 15;227:117649. doi: 10.1016/j.neuroimage.2020.117649. Epub 2020 Dec 15.
5
Spherical U-Net on Cortical Surfaces: Methods and Applications.
Inf Process Med Imaging. 2019 Jun;11492:855-866. doi: 10.1007/978-3-030-20351-1_67. Epub 2019 May 22.
6
Harmonization of Infant Cortical Thickness Using Surface-to-Surface Cycle-Consistent Adversarial Networks.
Med Image Comput Comput Assist Interv. 2019 Oct;11767:475-483. doi: 10.1007/978-3-030-32251-9_52. Epub 2019 Oct 10.
7
Registration-Free Infant Cortical Surface Parcellation using Deep Convolutional Neural Networks.
Med Image Comput Comput Assist Interv. 2018 Sep;11072:672-680. doi: 10.1007/978-3-030-00931-1_77. Epub 2018 Sep 13.
9
Topological correction of infant white matter surfaces using anatomically constrained convolutional neural network.
Neuroimage. 2019 Sep;198:114-124. doi: 10.1016/j.neuroimage.2019.05.037. Epub 2019 May 18.
10
Volume-Based Analysis of 6-Month-Old Infant Brain MRI for Autism Biomarker Identification and Early Diagnosis.
Med Image Comput Comput Assist Interv. 2018 Sep;11072:411-419. doi: 10.1007/978-3-030-00931-1_47. Epub 2018 Sep 13.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验