Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John's, Canada.
Faculty of Medicine, Memorial University of Newfoundland, St. John's, Canada.
J Neural Eng. 2020 Oct 15;17(5):056015. doi: 10.1088/1741-2552/abbc27.
A passive brain-computer interface (pBCI) is a system that continuously adapts human-computer interaction to the user's state. Key to the efficacy of such a system is the reliable estimation of the user's state via neural signals, acquired through non-invasive methods like electroencephalography (EEG) or near-infrared spectroscopy (fNIRS). Many studies to date have explored the detection of mental workload in particular, usually for the purpose of improving safety in high risk work environments. In these studies, mental workload is generally modulated through the manipulation of task difficulty, and no other aspect of the user's state is taken into account. In real-life scenarios, however, different aspects of the user's state are likely to be changing simultaneously-for example, their cognitive state (e.g. level of mental workload) and affective state (e.g. level of stress/anxiety). This inevitable confounding of different states needs to be accounted for in the development of state detection algorithms in order for them to remain effective when taken outside the lab.
In this study we focussed on two different states that are of particular importance in high risk work environments, specifically mental workload and stress, and explored the effect of each on the ability to detect the other using EEG signals. We developed an experimental protocol in which participants performed a cognitive task under two different levels of workload (low workload and high workload) and at two levels of stress (relaxed and stressed) and then used a linear discriminant classifier to perform classification of workload level and stress level independently.
We found that the detection of both mental workload level (e.g. low workload vs. high workload) and stress level (e.g. stressed vs. relaxed) were significantly diminished if the training and test data came from different as opposed to the same level of the other state (e.g. for mental workload classification, training on data from a relaxed condition and testing on data from a stressed condition, rather than both training and testing on the relaxed condition). The reduction in classification accuracy observed was as much as 15%.
The results of this study indicate the importance of considering multiple aspects of a user's state when developing detection algorithms for pBCI technologies.
被动式脑机接口(pBCI)是一种持续自适应人机交互的系统,其关键在于通过非侵入性方法(如脑电图(EEG)或近红外光谱(fNIRS))获取的神经信号来可靠地估计用户状态。迄今为止,许多研究都探索了特定的精神工作负荷检测,通常是为了提高高风险工作环境的安全性。在这些研究中,精神工作负荷通常通过任务难度的操纵来调节,而不考虑用户状态的其他方面。然而,在现实场景中,用户状态的不同方面可能同时发生变化——例如,他们的认知状态(例如精神工作负荷水平)和情感状态(例如压力/焦虑水平)。在开发状态检测算法时,需要考虑到这种不同状态的混淆,以便在实验室之外仍然有效。
在这项研究中,我们专注于高风险工作环境中特别重要的两种状态,即精神工作负荷和压力,并探索了使用 EEG 信号检测另一种状态的能力受到每种状态的影响。我们开发了一种实验方案,其中参与者在两种不同的工作负荷水平(低工作负荷和高工作负荷)和两种压力水平(放松和紧张)下执行认知任务,然后使用线性判别分类器独立地对工作负荷水平和压力水平进行分类。
我们发现,如果训练和测试数据来自不同的状态水平(例如,对精神工作负荷分类,在放松条件下进行训练并在紧张条件下进行测试,而不是在放松条件下同时进行训练和测试),则对精神工作负荷水平(例如低工作负荷与高工作负荷)和压力水平(例如紧张与放松)的检测显著降低。观察到的分类准确性下降高达 15%。
这项研究的结果表明,在开发 pBCI 技术的检测算法时,考虑用户状态的多个方面非常重要。