Media Lab, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
Reactive Lions Inc., San Francisco, CA 94105, USA.
Sensors (Basel). 2023 Dec 22;24(1):80. doi: 10.3390/s24010080.
Coupling brain-computer interfaces (BCIs) and robotic systems in the future can enable seamless personal assistant systems in everyday life, with the requests that can be performed in a discrete manner, using one's brain activity only. These types of systems might be of a particular interest for people with locked-in syndrome (LIS) or amyotrophic lateral sclerosis (ALS) because they can benefit from communicating with robotic assistants using brain sensing interfaces. In this proof-of-concept work, we explored how a wireless and wearable BCI device can control a quadruped robot-Boston Dynamics' Spot. The device measures the user's electroencephalography (EEG) and electrooculography (EOG) activity of the user from the electrodes embedded in the glasses' frame. The user responds to a series of questions with YES/NO answers by performing a brain-teaser activity of mental calculus. Each question-answer pair has a pre-configured set of actions for Spot. For instance, Spot was prompted to walk across a room, pick up an object, and retrieve it for the user (i.e., bring a bottle of water) when a sequence resolved to a YES response. Our system achieved at a success rate of 83.4%. To the best of our knowledge, this is the first integration of wireless, non-visual-based BCI systems with Spot in the context of personal assistant use cases. While this BCI quadruped robot system is an early prototype, future iterations may embody friendly and intuitive cues similar to regular service dogs. As such, this project aims to pave a path towards future developments in modern day personal assistant robots powered by wireless and wearable BCI systems in everyday living conditions.
未来将脑机接口 (BCI) 和机器人系统结合起来,可以在日常生活中实现无缝的个人助理系统,这些系统可以通过离散的方式,仅使用人们的大脑活动来执行请求。对于闭锁综合征 (LIS) 或肌萎缩侧索硬化症 (ALS) 患者来说,这些系统可能特别感兴趣,因为他们可以通过使用脑感应接口与机器人助理进行交流。在这项概念验证工作中,我们探索了无线可穿戴 BCI 设备如何控制波士顿动力公司的四足机器人 Spot。该设备通过测量用户眼镜框架中嵌入的电极的脑电图 (EEG) 和眼电图 (EOG) 活动来测量用户的脑电活动。用户通过进行心理计算的脑筋急转弯活动,对 YES/NO 回答来回答一系列问题。每个问题-答案对都为 Spot 预配置了一组动作。例如,当序列得到 YES 响应时,Spot 会被提示在房间里走动、捡起一个物体并为用户取回它(即,为用户拿一瓶水)。我们的系统成功率达到了 83.4%。据我们所知,这是首次将无线、非视觉 BCI 系统与 Spot 集成到个人助理用例中。虽然这个 BCI 四足机器人系统是一个早期原型,但未来的迭代可能会体现出类似于常规服务犬的友好和直观提示。因此,该项目旨在为未来在日常生活条件下由无线可穿戴 BCI 系统驱动的现代个人助理机器人的发展铺平道路。