Cao Yinan, Giordano Bruno L, Avanzini Federico, McAdams Stephen
Crossmodal Research Laboratory, Department of Experimental Psychology, University of Oxford, Oxford, UK.
Department of Music Research, Centre for Interdisciplinary Research in Music, Media and Technology, McGill University, Montreal, QC, Canada.
Exp Brain Res. 2016 Apr;234(4):1145-58. doi: 10.1007/s00221-015-4529-9. Epub 2016 Jan 20.
Skilled interactions with sounding objects, such as drumming, rely on resolving the uncertainty in the acoustical and tactual feedback signals generated by vibrating objects. Uncertainty may arise from mis-estimation of the objects' geometry-independent mechanical properties, such as surface stiffness. How multisensory information feeds back into the fine-tuning of sound-generating actions remains unexplored. Participants (percussionists, non-percussion musicians, or non-musicians) held a stylus and learned to control their wrist velocity while repeatedly striking a virtual sounding object whose surface stiffness was under computer control. Sensory feedback was manipulated by perturbing the surface stiffness specified by audition and haptics in a congruent or incongruent manner. The compensatory changes in striking velocity were measured as the motor effects of the sensory perturbations, and sensory dominance was quantified by the asymmetry of congruency effects across audition and haptics. A pronounced dominance of haptics over audition suggested a superior utility of somatosensation developed through long-term experience with object exploration. Large interindividual differences in the motor effects of haptic perturbation potentially arose from a differential reliance on the type of tactual prediction error for which participants tend to compensate: vibrotactile force versus object deformation. Musical experience did not have much of an effect beyond a slightly greater reliance on object deformation in mallet percussionists. The bias toward haptics in the presence of crossmodal perturbations was greater when participants appeared to rely on object deformation feedback, suggesting a weaker association between haptically sensed object deformation and the acoustical structure of concomitant sound during everyday experience of actions upon objects.
与发声物体的熟练互动,如击鼓,依赖于解决由振动物体产生的声学和触觉反馈信号中的不确定性。不确定性可能源于对物体与几何形状无关的机械特性(如表面刚度)的错误估计。多感官信息如何反馈到发声动作的微调中仍未得到探索。参与者(打击乐手、非打击乐音乐家或非音乐家)手持触控笔,在反复敲击一个表面刚度由计算机控制的虚拟发声物体时,学习控制手腕速度。通过以一致或不一致的方式扰动听觉和触觉指定的表面刚度来操纵感官反馈。将敲击速度的补偿变化作为感官扰动的运动效应进行测量,并通过听觉和触觉上一致性效应的不对称性来量化感官优势。触觉对听觉的明显优势表明,通过长期的物体探索经验发展而来的躯体感觉具有更高的效用。触觉扰动的运动效应存在较大的个体差异,这可能源于参与者倾向于补偿的触觉预测误差类型的差异:振动触觉力与物体变形。音乐经验除了让槌击乐手对物体变形的依赖略有增加外,并没有太大影响。当参与者似乎依赖物体变形反馈时,在存在跨模态扰动的情况下对触觉的偏向更大,这表明在日常对物体进行动作的经验中,触觉感知到的物体变形与伴随声音的声学结构之间存在较弱的关联。