Information and Computing Sciences, Utrecht University Utrecht, Netherlands ; Perceptual and Cognitive Systems, TNO Soesterberg, Netherlands.
Perceptual and Cognitive Systems, TNO Soesterberg, Netherlands.
Front Syst Neurosci. 2014 Sep 8;8:143. doi: 10.3389/fnsys.2014.00143. eCollection 2014.
Gaze-independent event-related potential (ERP) based brain-computer interfaces (BCIs) yield relatively low BCI performance and traditionally employ unimodal stimuli. Bimodal ERP-BCIs may increase BCI performance due to multisensory integration or summation in the brain. An additional advantage of bimodal BCIs may be that the user can choose which modality or modalities to attend to. We studied bimodal, visual-tactile, gaze-independent BCIs and investigated whether or not ERP components' tAUCs and subsequent classification accuracies are increased for (1) bimodal vs. unimodal stimuli; (2) location-congruent vs. location-incongruent bimodal stimuli; and (3) attending to both modalities vs. to either one modality. We observed an enhanced bimodal (compared to unimodal) P300 tAUC, which appeared to be positively affected by location-congruency (p = 0.056) and resulted in higher classification accuracies. Attending either to one or to both modalities of the bimodal location-congruent stimuli resulted in differences between ERP components, but not in classification performance. We conclude that location-congruent bimodal stimuli improve ERP-BCIs, and offer the user the possibility to switch the attended modality without losing performance.
基于视线无关事件相关电位 (ERP) 的脑-机接口 (BCI) 的性能相对较低,传统上采用单模态刺激。双模态 ERP-BCI 可以通过大脑的多感觉整合或叠加来提高 BCI 的性能。双模态 BCI 的一个额外优势可能是用户可以选择关注哪个模态或多个模态。我们研究了双模态、视觉-触觉、视线无关的 BCI,并调查了以下方面是否会增加 ERP 成分的 tAUC 和后续分类准确率:(1) 双模态与单模态刺激;(2) 位置一致与位置不一致的双模态刺激;以及 (3) 同时关注两个模态与仅关注一个模态。我们观察到双模态 (与单模态相比) P300 tAUC 增强,位置一致性似乎对其有积极影响 (p = 0.056),并导致更高的分类准确率。同时关注双模态位置一致刺激的一个或两个模态会导致 ERP 成分之间存在差异,但不会影响分类性能。我们得出结论,位置一致的双模态刺激可以改善 ERP-BCI,并为用户提供在不影响性能的情况下切换关注模态的可能性。