Kucukosmanoglu Murat, Garcia Javier O, Brooks Justin, Bansal Kanika
D-Prime LLC, McLean, VA, 22101, USA.
Humans in Complex Systems, US Army DEVCOM Army Research Laboratory, Aberdeen Proving Ground, MD, 21005, USA.
Sci Rep. 2025 Jul 3;15(1):23689. doi: 10.1038/s41598-025-05690-x.
Deep neural networks (DNNs) excel at extracting insights from complex data across various fields, however, their application in cognitive neuroscience remains limited, largely due to the lack of approaches with interpretability. Here, we employ two different and complementary DNN models, a one-dimensional convolutional neural network (1D-CNN) and a bidirectional long short-term memory network (BiLSTM), to classify cognitive task states from fMRI data, focusing on the cognitive underpinnings of the classification. The 1D-CNN achieved an overall accuracy of 81% (Macro AUC = 0.96), while the BiLSTM reached 78% (Macro AUC = 0.95). Despite the architectural differences, both models demonstrated a robust relationship between prediction accuracy and individual cognitive performance (p < 0.05 for 1D-CNN, and p < 0.001 for BiLSTM), with lower classification accuracy observed in individuals with poorer task performance. Feature importance analysis highlighted the dominance of visual networks, suggesting that task-driven state differences are primarily encoded in visual processing. Attention and control networks also showed relatively high importance. We observed individual trait-based effects and subtle model-specific differences: 1D-CNN yielded slightly better overall performance, while BiLSTM showed better sensitivity for individual behavior. This study highlights the application of interpretable DNNs in revealing cognitive mechanisms associated with task performance and individual variability.
深度神经网络(DNNs)擅长从各个领域的复杂数据中提取见解,然而,它们在认知神经科学中的应用仍然有限,这主要是由于缺乏具有可解释性的方法。在这里,我们采用两种不同且互补的DNN模型,即一维卷积神经网络(1D-CNN)和双向长短期记忆网络(BiLSTM),从功能磁共振成像(fMRI)数据中对认知任务状态进行分类,重点关注分类的认知基础。1D-CNN的总体准确率达到81%(宏AUC = 0.96),而BiLSTM达到78%(宏AUC = 0.95)。尽管架构不同,但两个模型都显示出预测准确率与个体认知表现之间存在稳健的关系(1D-CNN的p < 0.05,BiLSTM的p < 0.001),任务表现较差的个体分类准确率较低。特征重要性分析突出了视觉网络的主导地位,表明任务驱动的状态差异主要编码在视觉处理中。注意力和控制网络也显示出相对较高的重要性。我们观察到基于个体特征的效应和细微的模型特定差异:1D-CNN的总体性能略好,而BiLSTM对个体行为表现出更好的敏感性。这项研究突出了可解释的DNN在揭示与任务表现和个体变异性相关的认知机制方面的应用。