Kim Byung-Hoon, Ye Jong Chul
Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea.
Front Neurosci. 2020 Jun 30;14:630. doi: 10.3389/fnins.2020.00630. eCollection 2020.
Graph neural networks (GNN) rely on graph operations that include neural network training for various graph related tasks. Recently, several attempts have been made to apply the GNNs to functional magnetic resonance image (fMRI) data. Despite recent progresses, a common limitation is its difficulty to explain the classification results in a neuroscientifically explainable way. Here, we develop a framework for analyzing the fMRI data using the Graph Isomorphism Network (GIN), which was recently proposed as a powerful GNN for graph classification. One of the important contributions of this paper is the observation that the GIN is a dual representation of convolutional neural network (CNN) in the graph space where the shift operation is defined using the adjacency matrix. This understanding enables us to exploit CNN-based saliency map techniques for the GNN, which we tailor to the proposed GIN with one-hot encoding, to visualize the important regions of the brain. We validate our proposed framework using large-scale resting-state fMRI (rs-fMRI) data for classifying the sex of the subject based on the graph structure of the brain. The experiment was consistent with our expectation such that the obtained saliency map show high correspondence with previous neuroimaging evidences related to sex differences.
图神经网络(GNN)依赖于包括针对各种与图相关任务的神经网络训练在内的图操作。最近,人们已经进行了几次尝试,将GNN应用于功能磁共振成像(fMRI)数据。尽管最近取得了进展,但一个共同的局限性是难以以神经科学可解释的方式解释分类结果。在这里,我们开发了一个使用图同构网络(GIN)分析fMRI数据的框架,GIN最近被提出作为一种强大的用于图分类的GNN。本文的一个重要贡献是观察到GIN是卷积神经网络(CNN)在图空间中的对偶表示,其中移位操作是使用邻接矩阵定义的。这种理解使我们能够将基于CNN的显著性图技术用于GNN,我们通过独热编码对其进行定制以适应所提出的GIN,从而可视化大脑的重要区域。我们使用大规模静息态fMRI(rs-fMRI)数据验证了我们提出的框架,以基于大脑的图结构对受试者的性别进行分类。实验结果与我们的预期一致,即获得的显著性图与先前与性别差异相关的神经影像学证据高度吻合。