Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA.
Department of Computer Science and Engineering, The University of Texas at Arlington, Arlington, TX 76019, USA; Department of Mathematics, The University of Texas at Arlington, Arlington, TX 76019, USA.
Med Image Anal. 2022 Jul;79:102463. doi: 10.1016/j.media.2022.102463. Epub 2022 Apr 22.
Uncovering the non-trivial brain structure-function relationship is fundamentally important for revealing organizational principles of human brain. However, it is challenging to infer a reliable relationship between individual brain structure and function, e.g., the relations between individual brain structural connectivity (SC) and functional connectivity (FC). Brain structure-function displays a distributed and heterogeneous pattern, that is, many functional relationships arise from non-overlapping sets of anatomical connections. This complex relation can be interwoven with widely existed individual structural and functional variations. Motivated by the advances of generative adversarial network (GAN) and graph convolutional network (GCN) in the deep learning field, in this work, we proposed a multi-GCN based GAN (MGCN-GAN) to infer individual SC based on corresponding FC by automatically learning the complex associations between individual brain structural and functional networks. The generator of MGCN-GAN is composed of multiple multi-layer GCNs which are designed to model complex indirect connections in brain network. The discriminator of MGCN-GAN is a single multi-layer GCN which aims to distinguish the predicted SC from real SC. To overcome the inherent unstable behavior of GAN, we designed a new structure-preserving (SP) loss function to guide the generator to learn the intrinsic SC patterns more effectively. Using Human Connectome Project (HCP) dataset and Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset as test beds, our MGCN-GAN model can generate reliable individual SC from FC. This result implies that there may exist a common regulation between specific brain structural and functional architectures across different individuals.
揭示非平凡的大脑结构-功能关系对于揭示人类大脑的组织原则至关重要。然而,从个体大脑结构和功能之间推断出可靠的关系具有挑战性,例如个体大脑结构连接(SC)和功能连接(FC)之间的关系。大脑结构-功能呈现分布式和异质模式,即许多功能关系源于不重叠的解剖连接集。这种复杂的关系可能与广泛存在的个体结构和功能变化交织在一起。受生成对抗网络(GAN)和图卷积网络(GCN)在深度学习领域的进展的启发,在这项工作中,我们提出了一种基于多 GCN 的 GAN(MGCN-GAN),通过自动学习个体大脑结构和功能网络之间的复杂关联,根据相应的 FC 推断个体 SC。MGCN-GAN 的生成器由多个多层 GCN 组成,旨在对大脑网络中的复杂间接连接进行建模。MGCN-GAN 的鉴别器是一个单多层 GCN,旨在将预测的 SC 与真实的 SC 区分开来。为了克服 GAN 固有的不稳定行为,我们设计了一个新的结构保持(SP)损失函数,以指导生成器更有效地学习内在的 SC 模式。使用人类连接组计划(HCP)数据集和阿尔茨海默病神经影像学倡议(ADNI)数据集作为测试床,我们的 MGCN-GAN 模型可以从 FC 生成可靠的个体 SC。这一结果表明,在不同个体之间,特定的大脑结构和功能结构之间可能存在共同的调节机制。