Department of Biomedical Engineering, Yonsei University, Wonju 26493, Republic of Korea.
Department of Neurosurgery, University of California, Los Angeles, CA 90095, USA.
Comput Intell Neurosci. 2019 Jul 10;2019:4259369. doi: 10.1155/2019/4259369. eCollection 2019.
Interpersonal communication is based on questions and answers, and the most useful and simplest case is the binary "yes or no" question and answer. The purpose of this study is to show that it is possible to decode intentions on "yes" or "no" answers from multichannel single-trial electroencephalograms, which were recorded while covertly answering to self-referential questions with either "yes" or "no." The intention decoding algorithm consists of a common spatial pattern and support vector machine, which are employed for the feature extraction and pattern classification, respectively, after dividing the overall time-frequency range into subwindows of 200 ms × 2 Hz. The decoding accuracy using the information within each subwindow was investigated to find useful temporal and spectral ranges and found to be the highest for 800-1200 ms in the alpha band or 200-400 ms in the theta band. When the features from multiple subwindows were utilized together, the accuracy was significantly increased up to ∼86%. The most useful features for the "yes/no" discrimination was found to be focused in the right frontal region in the theta band and right centroparietal region in the alpha band, which may reflect the violation of autobiographic facts and higher cognitive load for "no" compared to "yes." Our task requires the subjects to answer self-referential questions just as in interpersonal conversation without any self-regulation of the brain signals or high cognitive efforts, and the "yes" and "no" answers are decoded directly from the brain activities. This implies that the "mind reading" in a true sense is feasible. Beyond its contribution in fundamental understanding of the neural mechanism of human intention, the decoding of "yes" or "no" from brain activities may eventually lead to a natural brain-computer interface.
人际交流是基于问答的,而最有用和最简单的情况是二进制的“是或否”问答。本研究旨在展示,从多通道单试脑电记录中解码“是”或“否”回答的意图是可能的,这些记录是在隐蔽地回答自我参照问题时,用“是”或“否”回答的。意图解码算法由共同空间模式和支持向量机组成,分别用于特征提取和模式分类,在将整个时频范围划分为 200ms×2Hz 的子窗口后。研究了使用每个子窗口内的信息进行解码的准确性,以找到有用的时间和频谱范围,并发现在 alpha 频段的 800-1200ms 或 theta 频段的 200-400ms 时最高。当一起使用多个子窗口的特征时,准确性显著提高到约 86%。对于“是/否”区分最有用的特征是在 theta 频段的右额区和 alpha 频段的右中央顶区,这可能反映了“否”与“是”相比违反自传事实和更高的认知负荷。我们的任务要求受试者像在人际对话中一样回答自我参照问题,而无需对大脑信号进行任何自我调节或进行高认知努力,并且可以直接从大脑活动中解码“是”和“否”的回答。这意味着真正意义上的“读心术”是可行的。除了对人类意图的神经机制的基本理解的贡献之外,从大脑活动中解码“是”或“否”最终可能导致自然的脑机接口。