Brain Computer Interfaces and Neural Engineering Laboratory, School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom.
Department of Otolaryngology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, United States of America.
PLoS One. 2019 Mar 6;14(3):e0212935. doi: 10.1371/journal.pone.0212935. eCollection 2019.
Recognizing a person in a crowded environment is a challenging, yet critical, visual-search task for both humans and machine-vision algorithms. This paper explores the possibility of combining a residual neural network (ResNet), brain-computer interfaces (BCIs) and human participants to create "cyborgs" that improve decision making. Human participants and a ResNet undertook the same face-recognition experiment. BCIs were used to decode the decision confidence of humans from their EEG signals. Different types of cyborg groups were created, including either only humans (with or without the BCI) or groups of humans and the ResNet. Cyborg groups decisions were obtained weighing individual decisions by confidence estimates. Results show that groups of cyborgs are significantly more accurate (up to 35%) than the ResNet, the average participant, and equally-sized groups of humans not assisted by technology. These results suggest that melding humans, BCI, and machine-vision technology could significantly improve decision-making in realistic scenarios.
在拥挤的环境中识别一个人,是人类和机器视觉算法都面临的具有挑战性但至关重要的视觉搜索任务。本文探讨了将残差神经网络(ResNet)、脑机接口(BCI)和人类参与者结合起来创建“半机械人”以提高决策能力的可能性。人类参与者和 ResNet 进行了相同的人脸识别实验。BCI 被用来从 EEG 信号中解码人类的决策置信度。创建了不同类型的半机械人小组,包括只有人类(有或没有 BCI)或人类和 ResNet 的小组。通过置信度估计来衡量个体决策,从而获得半机械人小组的决策。结果表明,半机械人小组的决策比 ResNet、平均参与者和没有技术辅助的同等大小的人类小组更准确(高达 35%)。这些结果表明,融合人类、BCI 和机器视觉技术可以显著提高现实场景中的决策能力。