Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America.
Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, United States of America.
J Neural Eng. 2023 Sep 19;20(5). doi: 10.1088/1741-2552/acec14.
When making decisions, humans can evaluate how likely they are to be correct. If this subjective confidence could be reliably decoded from brain activity, it would be possible to build a brain-computer interface (BCI) that improves decision performance by automatically providing more information to the user if needed based on their confidence. But this possibility depends on whether confidence can be decoded right after stimulus presentation and before the response so that a corrective action can be taken in time. Although prior work has shown that decision confidence is represented in brain signals, it is unclear if the representation is stimulus-locked or response-locked, and whether stimulus-locked pre-response decoding is sufficiently accurate for enabling such a BCI.We investigate the neural correlates of confidence by collecting high-density electroencephalography (EEG) during a perceptual decision task with realistic stimuli. Importantly, we design our task to include a post-stimulus gap that prevents the confounding of stimulus-locked activity by response-locked activity and vice versa, and then compare with a task without this gap.We perform event-related potential and source-localization analyses. Our analyses suggest that the neural correlates of confidence are stimulus-locked, and that an absence of a post-stimulus gap could cause these correlates to incorrectly appear as response-locked. By preventing response-locked activity from confounding stimulus-locked activity, we then show that confidence can be reliably decoded from single-trial stimulus-locked pre-response EEG alone. We also identify a high-performance classification algorithm by comparing a battery of algorithms. Lastly, we design a simulated BCI framework to show that the EEG classification is accurate enough to build a BCI and that the decoded confidence could be used to improve decision making performance particularly when the task difficulty and cost of errors are high.Our results show feasibility of non-invasive EEG-based BCIs to improve human decision making.
在做决策时,人类可以评估自己的判断正确的可能性有多大。如果能够从大脑活动中可靠地解码出这种主观信心,那么就有可能构建一种脑机接口(BCI),根据用户的信心水平,在需要时自动为其提供更多信息,从而提高决策表现。但是,这种可能性取决于信心是否能够在刺激呈现后且在做出反应之前可靠地解码,以便及时采取纠正措施。尽管先前的研究表明,决策信心可以通过大脑信号来表示,但尚不清楚这种表示是与刺激锁相还是与反应锁相,以及刺激锁相的反应前解码是否足够准确以实现这样的 BCI。我们通过在具有现实刺激的感知决策任务中收集高密度脑电图(EEG)来研究信心的神经相关性。重要的是,我们设计我们的任务包含一个刺激后间隙,以防止反应锁相活动与刺激锁相活动混淆,然后与没有该间隙的任务进行比较。我们进行了事件相关电位和源定位分析。我们的分析表明,信心的神经相关性是与刺激锁相的,并且没有刺激后间隙可能会导致这些相关性错误地显示为反应锁相。通过防止反应锁相活动混淆刺激锁相活动,我们然后表明,仅从单试刺激锁相反应前 EEG 就可以可靠地解码信心。我们还通过比较一系列算法来确定一种高性能分类算法。最后,我们设计了一个模拟 BCI 框架,以表明 EEG 分类的准确性足以构建 BCI,并且解码的信心可以用于提高决策表现,尤其是在任务难度和错误成本较高时。我们的结果表明,非侵入性 EEG 基 BCI 具有改善人类决策的可行性。