Sun Xuyun, Qian Cunle, Chen Zhongqin, Wu Zhaohui, Luo Benyan, Pan Gang
College of Computer Science and Technology, Zhejiang University, Hangzhou, Zhejiang, China.
The First Affiliated Hospital of Medical School, Zhejiang University, Hangzhou, Zhejiang, China.
PLoS One. 2016 Dec 14;11(12):e0167497. doi: 10.1371/journal.pone.0167497. eCollection 2016.
Prediction of memory performance (remembered or forgotten) has various potential applications not only for knowledge learning but also for disease diagnosis. Recently, subsequent memory effects (SMEs)-the statistical differences in electroencephalography (EEG) signals before or during learning between subsequently remembered and forgotten events-have been found. This finding indicates that EEG signals convey the information relevant to memory performance. In this paper, based on SMEs we propose a computational approach to predict memory performance of an event from EEG signals. We devise a convolutional neural network for EEG, called ConvEEGNN, to predict subsequently remembered and forgotten events from EEG recorded during memory process. With the ConvEEGNN, prediction of memory performance can be achieved by integrating two main stages: feature extraction and classification. To verify the proposed approach, we employ an auditory memory task to collect EEG signals from scalp electrodes. For ConvEEGNN, the average prediction accuracy was 72.07% by using EEG data from pre-stimulus and during-stimulus periods, outperforming other approaches. It was observed that signals from pre-stimulus period and those from during-stimulus period had comparable contributions to memory performance. Furthermore, the connection weights of ConvEEGNN network can reveal prominent channels, which are consistent with the distribution of SME studied previously.
记忆表现(记住或遗忘)的预测不仅在知识学习方面有各种潜在应用,在疾病诊断中也有潜在应用。最近,人们发现了后续记忆效应(SMEs)——后续记住和遗忘事件在学习前或学习过程中脑电图(EEG)信号的统计差异。这一发现表明,EEG信号传达了与记忆表现相关的信息。在本文中,基于后续记忆效应,我们提出了一种从EEG信号预测事件记忆表现的计算方法。我们设计了一种用于EEG的卷积神经网络,称为ConvEEGNN,以从记忆过程中记录的EEG预测后续记住和遗忘的事件。使用ConvEEGNN,可以通过整合两个主要阶段来实现记忆表现的预测:特征提取和分类。为了验证所提出的方法,我们采用听觉记忆任务从头皮电极收集EEG信号。对于ConvEEGNN,使用刺激前和刺激期间的EEG数据,平均预测准确率为72.07%,优于其他方法。观察到,刺激前期的信号和刺激期的信号对记忆表现的贡献相当。此外,ConvEEGNN网络的连接权重可以揭示突出通道,这与先前研究的后续记忆效应分布一致。