Annu Int Conf IEEE Eng Med Biol Soc. 2017 Jul;2017:998-1001. doi: 10.1109/EMBC.2017.8036994.
It is commonly believed that brain has faster reaction speed and higher reaction accuracy on visual-auditory bimodal stimuli than single modal stimuli in current neuropsychological researches, while visual-auditory bimodal stimuli (VABS) do not show corresponding superiority in BCI system. This paper aims at investigating whether semantically congruent stimuli could also get better performance than semantically incongruent stimuli in Brain Computer Interface (BCI) system. Two VABS based paradigms (semantically congruent or incongruent) were conducted in this study. 10 healthy subjects participated in the experiment in order to compare the two paradigms. The results indicated that the higher Event-related potential (ERP) amplitude of semantic incongruent paradigm were observed both in target and non-target stimuli. Nevertheless, we didn't observe significant difference of classification accuracy between congruent and incongruent conditions. Most participants showed their preference on semantically congruent condition for less workload needed. This finding demonstrated that semantic congruency has positive effect on behavioral results (less workload) and insignificant effect on system efficiency.
在当前神经心理学研究中，人们普遍认为，相较于单模态刺激，大脑对视觉 - 听觉双模态刺激具有更快的反应速度和更高的反应准确性，然而视觉 - 听觉双模态刺激（VABS）在脑机接口（BCI）系统中并未表现出相应优势。本文旨在研究在脑机接口（BCI）系统中，语义一致的刺激是否也能比语义不一致的刺激获得更好的表现。本研究进行了两种基于VABS的范式（语义一致或不一致）。10名健康受试者参与实验以比较这两种范式。结果表明，在目标刺激和非目标刺激中均观察到语义不一致范式具有更高的事件相关电位（ERP）幅度。然而，我们未观察到一致和不一致条件下分类准确率的显著差异。大多数参与者因所需工作量较少而表现出对语义一致条件的偏好。这一发现表明，语义一致性对行为结果（工作量较少）有积极影响，而对系统效率影响不显著。
