Zhao Fenqiang, Wu Zhengwang, Wang Li, Lin Weili, Xia Shunren, Li Gang
Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, China.
Med Image Comput Comput Assist Interv. 2021 Sep-Oct;12904:171-181. doi: 10.1007/978-3-030-87202-1_17. Epub 2021 Sep 21.
Cortical surface registration and parcellation are two essential steps in neuroimaging analysis. Conventionally, they are performed independently as two tasks, ignoring the inherent connections of these two closely-related tasks. Essentially, both tasks rely on meaningful cortical feature representations, so they can be jointly optimized by learning shared useful cortical features. To this end, we propose a deep learning framework for joint cortical surface registration and parcellation. Specifically, our approach leverages the spherical topology of cortical surfaces and uses a spherical network as the shared encoder to first learn shared features for both tasks. Then we train two task-specific decoders for registration and parcellation, respectively. We further exploit the more explicit connection between them by incorporating the novel parcellation map similarity loss to enforce the boundary consistency of regions, thereby providing extra supervision for the registration task. Conversely, parcellation network training also benefits from the registration, which provides a large amount of augmented data by warping one surface with manual parcellation map to another surface, especially when only few manually-labeled surfaces are available. Experiments on a dataset with more than 600 cortical surfaces show that our approach achieves large improvements on both parcellation and registration accuracy (over separately trained networks) and enables training high-quality parcellation and registration models using much fewer labeled data.
皮质表面配准和分割是神经影像分析中的两个基本步骤。传统上,它们作为两个独立的任务分别执行,忽略了这两个紧密相关任务的内在联系。本质上,这两个任务都依赖于有意义的皮质特征表示,因此可以通过学习共享的有用皮质特征来进行联合优化。为此,我们提出了一种用于联合皮质表面配准和分割的深度学习框架。具体而言,我们的方法利用皮质表面的球面拓扑结构,并使用球面网络作为共享编码器,首先为这两个任务学习共享特征。然后我们分别为配准和分割训练两个特定于任务的解码器。我们通过纳入新颖的分割图相似性损失来进一步利用它们之间更明确的联系,以强制区域的边界一致性,从而为配准任务提供额外的监督。相反,分割网络的训练也受益于配准,配准通过将带有手动分割图的一个表面扭曲到另一个表面来提供大量的增强数据,特别是在只有很少的手动标记表面可用时。在一个包含600多个皮质表面的数据集上进行的实验表明,我们的方法在分割和配准精度方面(相对于单独训练的网络)都取得了大幅提升,并且能够使用少得多的标记数据训练高质量的分割和配准模型。