Unit for Visually Impaired People, Istituto Italiano di Tecnologia.
Robotics Brain and Cognitive Sciences, Istituto Italiano di Tecnologia.
J Exp Psychol Hum Percept Perform. 2022 Feb;48(2):174-189. doi: 10.1037/xhp0000973.
When moving through space, we encode multiple sensory cues that guide our orientation through the environment. The integration between visual and self-motion cues is known to improve navigation. However, spatial navigation may also benefit from multisensory external signals. The present study aimed to investigate whether humans combine auditory and visual landmarks with improving their navigation abilities. Two experiments with different cue reliability were conducted. In both, participants' task was to return an object to its original location by using landmarks, which could be visual-only, auditory-only, or audiovisual. We took error and variability of object relocation distance as measures of accuracy and precision. To quantify interference between cues and assess their weights, we ran a conflict condition with a spatial discrepancy between visual and auditory landmarks. Results showed comparable accuracy and precision when navigating with visual-only and audiovisual landmarks but greater error and variability with auditory-only landmarks. Splitting participants into two groups based on given unimodal weights revealed that only subjects who associated similar weights to auditory and visual cues showed precision benefit in audiovisual conditions. These findings suggest that multisensory integration occurs depending on idiosyncratic cue weighting. Future multisensory procedures to aid mobility must consider individual differences in encoding landmarks. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
当我们在空间中移动时,会对多种感官线索进行编码,这些线索指导我们在环境中的方向感。视觉和自身运动线索的整合被认为可以改善导航。然而,空间导航也可能受益于多感官外部信号。本研究旨在调查人类是否会将听觉和视觉地标与改善导航能力结合起来。进行了两项具有不同线索可靠性的实验。在这两项实验中,参与者的任务是通过使用地标将物体放回其原始位置,地标可以是仅视觉的、仅听觉的或视听的。我们将物体重新定位距离的误差和可变性作为准确性和精度的衡量标准。为了量化线索之间的干扰并评估它们的权重,我们在视觉和听觉地标之间存在空间差异的情况下运行了一个冲突条件。结果表明,仅使用视觉和视听地标导航时具有相似的准确性和精度,但仅使用听觉地标时会产生更大的误差和可变性。根据单一模态权重将参与者分为两组,结果表明,只有将听觉和视觉线索关联到相似权重的受试者在视听条件下才会表现出精度优势。这些发现表明,多感官整合取决于特定的线索权重。未来用于辅助移动的多感官程序必须考虑地标编码的个体差异。