Pinegger Andreas, Hiebel Hannah, Wriessnegger Selina C, Müller-Putz Gernot R
Institute of Neural Engineering, Graz University of Technology, Graz, Austria.
Institute of Psychology, University of Graz, Graz, Austria.
PLoS One. 2017 Sep 6;12(9):e0181584. doi: 10.1371/journal.pone.0181584. eCollection 2017.
The P300 event-related potential is a well-known pattern in the electroencephalogram (EEG). This kind of brain signal is used for many different brain-computer interface (BCI) applications, e.g., spellers, environmental controllers, web browsers, or for painting. In recent times, BCI systems are mature enough to leave the laboratories to be used by the end-users, namely severely disabled people. Therefore, new challenges arise and the systems should be implemented and evaluated according to user-centered design (USD) guidelines. We developed and implemented a new system that utilizes the P300 pattern to compose music. Our Brain Composing system consists of three parts: the EEG acquisition device, the P300-based BCI, and the music composing software. Seventeen musical participants and one professional composer performed a copy-spelling, a copy-composing, and a free-composing task with the system. According to the USD guidelines, we investigated the efficiency, the effectiveness and subjective criteria in terms of satisfaction, enjoyment, frustration, and attractiveness. The musical participants group achieved high average accuracies: 88.24% (copy-spelling), 88.58% (copy-composing), and 76.51% (free-composing). The professional composer achieved also high accuracies: 100% (copy-spelling), 93.62% (copy-composing), and 98.20% (free-composing). General results regarding the subjective criteria evaluation were that the participants enjoyed the usage of the Brain Composing system and were highly satisfied with the system. Showing very positive results with healthy people in this study, this was the first step towards a music composing system for severely disabled people.
P300事件相关电位是脑电图(EEG)中一种众所周知的模式。这种脑信号被用于许多不同的脑机接口(BCI)应用,例如拼写器、环境控制器、网页浏览器或绘画。近年来,BCI系统已经足够成熟,可以走出实验室供最终用户使用,即严重残疾人士。因此,出现了新的挑战,系统应该根据以用户为中心的设计(USD)指南来实施和评估。我们开发并实现了一个利用P300模式来创作音乐的新系统。我们的脑作曲系统由三个部分组成:EEG采集设备、基于P300的BCI和音乐创作软件。17名音乐参与者和1名专业作曲家使用该系统完成了复制拼写、复制作曲和自由作曲任务。根据USD指南,我们从满意度、愉悦感、挫败感和吸引力等方面调查了效率、有效性和主观标准。音乐参与者组取得了较高的平均准确率:复制拼写为88.24%,复制作曲为88.58%,自由作曲为76.51%。专业作曲家也取得了较高的准确率:复制拼写为100%,复制作曲为93.62%,自由作曲为98.20%。关于主观标准评估的总体结果是,参与者喜欢使用脑作曲系统,并对该系统高度满意。这项研究在健康人群中取得了非常积极的结果,这是朝着为严重残疾人士开发音乐创作系统迈出的第一步。