UMR STMS, Ircam, CNRS, Sorbonne Université, 75004, Paris, France.
ISIR, CNRS UMR 7222, Inserm U1150, Sorbonne Université, 75005, Paris, France.
J Neuroeng Rehabil. 2023 Oct 5;20(1):136. doi: 10.1186/s12984-023-01248-y.
Movement sonification, the use of real-time auditory feedback linked to movement parameters, have been proposed to support rehabilitation. Nevertheless, if promising results have been reported, the effect of the type of sound used has not been studied systematically. The aim of this study was to investigate in a single session the effect of different types of sonification both quantitatively and qualitatively on patients with acquired brain lesions and healthy participants.
An experimental setup enabling arm sonification was developed using three different categories of sonification (direct sound modulation, musical interaction, and soundscape). Simple moving forward movements performed while sliding on a table with both arms were investigated with all participants. Quantitative analysis on the movement timing were performed considering various parameters (sound condition, affected arm and dominance, sonification categories). Qualitative analysis of semi-structured interviews were also conducted, as well as neuropsychological evaluation of music perception.
For both the patient and healthy groups (15 participants each), average duration for performing the arm movement is significantly longer with sonification compared to the no-sound condition (p < 0.001). Qualitative analysis of semi-structured interviews revealed different aspects of motivational and affective aspects of sonification. Most participants of both groups preferred to complete the task with sound (29 of 30 participants), and described the experience as playful (22 of 30 participants). More precisely, the soundscape (nature sounds) was the most constantly preferred (selected first by 14 of 30 participants).
Overall, our results confirm that the sonification has an effect on the temporal execution of the movement during a single-session. Globally, sonification is welcomed by the participants, and we found convergent and differentiated appreciations of the different sonification types.
运动声音化，即将实时听觉反馈与运动参数相关联的应用，已被提议用于支持康复。然而，如果报告了有希望的结果，那么所使用的声音类型的效果尚未得到系统研究。本研究的目的是在单次会议中调查不同类型的声音化对获得性脑损伤患者和健康参与者的定量和定性影响。
使用三种不同类别的声音化（直接声音调制、音乐互动和音景）开发了一种能够实现手臂声音化的实验设置。所有参与者都进行了使用双臂在桌子上滑动进行简单向前移动的实验。考虑到各种参数（声音条件、受影响的手臂和主导手臂、声音化类别），对运动定时进行了定量分析。还进行了半结构化访谈的定性分析，以及音乐感知的神经心理学评估。
对于患者组和健康组（每组 15 名参与者），与无声条件相比，使用声音化进行手臂运动的平均持续时间明显更长（p < 0.001）。半结构化访谈的定性分析揭示了声音化在动机和情感方面的不同方面。两组的大多数参与者都更喜欢有声音完成任务（30 名参与者中的 29 名），并将体验描述为有趣（30 名参与者中的 22 名）。更具体地说，音景（自然声音）是最常被选择的（30 名参与者中有 14 名首先选择）。
总体而言，我们的结果证实，声音化对单次会议中运动的时间执行有影响。总体而言，参与者对声音化表示欢迎，并且我们发现了对不同声音化类型的趋同和差异化评价。
