Computational Science and Engineering, Georgia Institute of Technology, North Ave, 30332, GA, United States.
Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), 55 Park Pl NE, 30303, GA, United States.
Cereb Cortex. 2023 May 9;33(10):5817-5828. doi: 10.1093/cercor/bhac462.
Deep learning has become an effective tool for classifying biological sex based on functional magnetic resonance imaging (fMRI). However, research on what features within the brain are most relevant to this classification is still lacking. Model interpretability has become a powerful way to understand "black box" deep-learning models, and select features within the input data that are most relevant to the correct classification. However, very little work has been done employing these methods to understand the relationship between the temporal dimension of functional imaging signals and the classification of biological sex. Consequently, less attention has been paid to rectifying problems and limitations associated with feature explanation models, e.g. underspecification and instability. In this work, we first provide a methodology to limit the impact of underspecification on the stability of the measured feature importance. Then, using intrinsic connectivity networks from fMRI data, we provide a deep exploration of sex differences among functional brain networks. We report numerous conclusions, including activity differences in the visual and cognitive domains and major connectivity differences.
深度学习已成为基于功能磁共振成像(fMRI)对生物性别进行分类的有效工具。然而,对于大脑中哪些特征与这种分类最相关的研究仍然缺乏。模型可解释性已成为理解“黑盒”深度学习模型并选择与正确分类最相关的输入数据特征的强大方法。然而,很少有工作利用这些方法来理解功能成像信号的时间维度与生物性别分类之间的关系。因此,对于特征解释模型(例如,欠指定和不稳定性)相关的问题和局限性的纠正关注较少。在这项工作中,我们首先提供了一种方法来限制欠指定对所测量特征重要性稳定性的影响。然后,我们使用 fMRI 数据的内在连通性网络,对功能大脑网络中的性别差异进行了深入探讨。我们报告了许多结论,包括视觉和认知领域的活动差异以及主要的连通性差异。