Shi Ran, Zhao Yanyu, Cao Zhiyuan, Liu Chunyu, Kang Yi, Zhang Jiacai
School of Artificial Intelligence, Beijing Normal University, Beijing, 100875, China.
Engineering Research Center of Intelligent Technology and Educational Application, Ministry of Education, Beijing, 100875, China.
Cogn Neurodyn. 2022 Apr;16(2):365-377. doi: 10.1007/s11571-021-09717-7. Epub 2021 Sep 17.
Magnetoencephalography (MEG) signals have demonstrated their practical application to reading human minds. Current neural decoding studies have made great progress to build subject-wise decoding models to extract and discriminate the temporal/spatial features in neural signals. In this paper, we used a compact convolutional neural network-EEGNet-to build a common decoder across subjects, which deciphered the categories of objects (faces, tools, animals, and scenes) from MEG data. This study investigated the influence of the spatiotemporal structure of MEG on EEGNet's classification performance. Furthermore, the EEGNet replaced its convolution layers with two sets of parallel convolution structures to extract the spatial and temporal features simultaneously. Our results showed that the organization of MEG data fed into the EEGNet has an effect on EEGNet classification accuracy, and the parallel convolution structures in EEGNet are beneficial to extracting and fusing spatial and temporal MEG features. The classification accuracy demonstrated that the EEGNet succeeds in building the common decoder model across subjects, and outperforms several state-of-the-art feature fusing methods.
脑磁图(MEG)信号已在读取人类思维方面展现出其实际应用价值。当前的神经解码研究在构建个体特异性解码模型以提取和区分神经信号中的时空特征方面取得了巨大进展。在本文中,我们使用了紧凑卷积神经网络EEGNet来构建跨个体的通用解码器,该解码器从MEG数据中解读物体类别(面部、工具、动物和场景)。本研究调查了MEG的时空结构对EEGNet分类性能的影响。此外,EEGNet用两组并行卷积结构替换其卷积层以同时提取空间和时间特征。我们的结果表明,输入到EEGNet的MEG数据的组织方式对EEGNet分类准确率有影响,并且EEGNet中的并行卷积结构有利于提取和融合MEG的空间和时间特征。分类准确率表明EEGNet成功构建了跨个体的通用解码器模型,并且优于几种当前最先进的特征融合方法。