Vukelić Mathias, Lingelbach Katharina, Pollmann Kathrin, Peissner Matthias
Fraunhofer Institute for Industrial Engineering IAO, 70569 Stuttgart, Germany.
Institute of Human Factors and Technology Management IAT, University of Stuttgart, 70569 Stuttgart, Germany.
Brain Sci. 2020 Dec 31;11(1):35. doi: 10.3390/brainsci11010035.
Affect monitoring is being discussed as a novel strategy to make adaptive systems more user-oriented. Basic knowledge about oscillatory processes and functional connectivity underlying affect during naturalistic human-computer interactions (HCI) is, however, scarce. This study assessed local oscillatory power entrainment and distributed functional connectivity in a close-to-naturalistic HCI-paradigm. Sixteen participants interacted with a simulated assistance system which deliberately evoked positive (supporting goal-achievement) and negative (impeding goal-achievement) affective reactions. Electroencephalography (EEG) was used to examine the reactivity of the cortical system during the interaction by studying both event-related (de-)synchronization (ERD/ERS) and event-related functional coupling of cortical networks towards system-initiated assistance. Significantly higher α-band and β-band ERD in centro-parietal and parieto-occipital regions and β-band ERD in bi-lateral fronto-central regions were observed during impeding system behavior. Supportive system behavior activated significantly higher γ-band ERS in bi-hemispheric parietal-occipital regions. This was accompanied by functional coupling of remote β-band and γ-band activity in the medial frontal, left fronto-central and parietal regions, respectively. Our findings identify oscillatory signatures of positive and negative affective processes as reactions to system-initiated assistance. The findings contribute to the development of EEG-based neuroadaptive assistance loops by suggesting a non-obtrusive method for monitoring affect in HCI.
情感监测作为一种使自适应系统更以用户为导向的新策略正在被讨论。然而，关于自然人机交互（HCI）过程中情感背后的振荡过程和功能连接的基础知识却很匮乏。本研究在接近自然的HCI范式中评估了局部振荡功率夹带和分布式功能连接。16名参与者与一个模拟辅助系统进行交互，该系统故意引发积极（支持目标达成）和消极（阻碍目标达成）的情感反应。通过研究事件相关（去）同步（ERD/ERS）以及皮层网络对系统发起的辅助的事件相关功能耦合，利用脑电图（EEG）来检查交互过程中皮层系统的反应性。在系统行为产生阻碍时，在中央顶叶和顶枕区域观察到显著更高的α波段和β波段ERD，在双侧额中央区域观察到β波段ERD。支持性系统行为在双侧顶枕区域激活了显著更高的γ波段ERS。这分别伴随着内侧额叶、左侧额中央和顶叶区域中远程β波段和γ波段活动的功能耦合。我们的研究结果确定了作为对系统发起的辅助的反应的积极和消极情感过程的振荡特征。这些发现通过提出一种用于监测HCI中情感的非侵入性方法，为基于脑电图的神经自适应辅助回路的发展做出了贡献。
