School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athens, Greece.
Biomedial Simulations and Imaging Laboratory, National Technical University of Athens, 15780 Athens, Greece.
Sensors (Basel). 2022 Mar 23;22(7):2472. doi: 10.3390/s22072472.
In this article, an unobtrusive and affordable sensor-based multimodal approach for real time recognition of engagement in serious games (SGs) for health is presented. This approach aims to achieve individualization in SGs that promote self-health management. The feasibility of the proposed approach was investigated by designing and implementing an experimental process focusing on real time recognition of engagement. Twenty-six participants were recruited and engaged in sessions with a SG that promotes food and nutrition literacy. Data were collected during play from a heart rate sensor, a smart chair, and in-game metrics. Perceived engagement, as an approximation to the ground truth, was annotated continuously by participants. An additional group of six participants were recruited for smart chair calibration purposes. The analysis was conducted in two directions, firstly investigating associations between identified sitting postures and perceived engagement, and secondly evaluating the predictive capacity of features extracted from the multitude of sources towards the ground truth. The results demonstrate significant associations and predictive capacity from all investigated sources, with a multimodal feature combination displaying superiority over unimodal features. These results advocate for the feasibility of real time recognition of engagement in adaptive serious games for health by using the presented approach.
本文提出了一种基于传感器的、不引人注目的、经济实惠的多模态方法,用于实时识别健康类严肃游戏(SG)中的参与度。这种方法旨在实现个性化的 SG,以促进自我健康管理。通过设计和实施一个专注于实时识别参与度的实验过程,研究了所提出方法的可行性。招募了 26 名参与者,并让他们参与了一个促进食物和营养知识的 SG 游戏。在游戏过程中,从心率传感器、智能椅子和游戏内指标中收集数据。参与者不断地对感知到的参与度进行注释,作为对真实情况的近似值。另外招募了六名参与者进行智能椅子校准。分析从两个方向进行,首先调查识别出的坐姿与感知到的参与度之间的关联,其次评估从多种来源提取的特征对真实情况的预测能力。结果表明,所有被调查的来源都具有显著的相关性和预测能力,多模态特征组合的表现优于单模态特征。这些结果表明,通过使用所提出的方法,实时识别自适应健康类严肃游戏中的参与度是可行的。
Sensors (Basel). 2022-3-23
J Nutr Educ Behav. 2021-10
Clin Teach. 2016-8
JMIR Serious Games. 2021-9-23
Psychiatr Serv. 2019-10-23
Sensors (Basel). 2020-12-9
IEEE J Biomed Health Inform. 2021-5
Procedia Comput Sci. 2022
JMIR Serious Games. 2022-11-29
Sensors (Basel). 2022-1-21
Annu Int Conf IEEE Eng Med Biol Soc. 2019-7
Annu Int Conf IEEE Eng Med Biol Soc. 2019-7
Sensors (Basel). 2019-1-22
Front Public Health. 2017-9-28
J Biomed Inform. 2017-7
Front Psychiatry. 2017-1-10
IEEE Trans Biomed Eng. 2015-12