Department of Psychology, University of Bath, Bath, BA2 7AY, UK; Crossmodal Cognition Laboratory, REVEAL Research Centre, University of Bath, Bath, BA2 7AY, UK.
Crossmodal Cognition Laboratory, REVEAL Research Centre, University of Bath, Bath, BA2 7AY, UK; Centre for Health and Cognition, Bath Spa University, Bath, BA2 9BN, UK.
Appl Ergon. 2020 May;85:103072. doi: 10.1016/j.apergo.2020.103072. Epub 2020 Feb 18.
Visual-to-auditory sensory substitution devices (SSDs) provide improved access to the visual environment for the visually impaired by converting images into auditory information. Research is lacking on the mechanisms involved in processing data that is perceived through one sensory modality, but directly associated with a source in a different sensory modality. This is important because SSDs that use auditory displays could involve binaural presentation requiring both ear canals, or monaural presentation requiring only one - but which ear would be ideal? SSDs may be similar to reading, as an image (printed word) is converted into sound (when read aloud). Reading, and language more generally, are typically lateralised to the left cerebral hemisphere. Yet, unlike symbolic written language, SSDs convert images to sound based on visuospatial properties, with the right cerebral hemisphere potentially having a role in processing such visuospatial data. Here we investigated whether there is a hemispheric bias in the processing of visual-to-auditory sensory substitution information and whether that varies as a function of experience and visual ability. We assessed the lateralization of auditory processing with two tests: a standard dichotic listening test and a novel dichotic listening test created using the auditory information produced by an SSD, The vOICe. Participants were tested either in the lab or online with the same stimuli. We did not find a hemispheric bias in the processing of visual-to-auditory information in visually impaired, experienced vOICe users. Further, we did not find any difference between visually impaired, experienced vOICe users and sighted novices in the hemispheric lateralization of visual-to-auditory information processing. Although standard dichotic listening is lateralised to the left hemisphere, the auditory processing of images in SSDs is bilateral, possibly due to the increased influence of right hemisphere processing. Auditory SSDs might therefore be equally effective with presentation to either ear if a monaural, rather than binaural, presentation were necessary.
视觉-听觉感觉替代设备 (SSDs) 通过将图像转换为听觉信息,为视力障碍者提供了对视觉环境的更好访问。目前对于通过一种感觉模态感知的数据的处理机制的研究还很缺乏,但这些数据与另一种感觉模态中的源直接相关。这很重要,因为使用听觉显示器的 SSD 可能涉及双耳呈现,需要两个耳道,或者单耳呈现,只需要一个 - 但哪只耳朵是理想的? SSD 可能类似于阅读,因为图像(打印字)被转换为声音(当大声朗读时)。阅读,更一般地说语言,通常偏向于左大脑半球。然而,与符号书面语言不同,SSD 根据视觉空间特性将图像转换为声音,右大脑半球可能在处理这种视觉空间数据方面发挥作用。在这里,我们研究了视觉-听觉感觉替代信息处理是否存在半球偏向,以及这种偏向是否随经验和视觉能力而变化。我们使用两种测试来评估听觉处理的偏侧性:标准的双耳分听测试和使用 SSD 产生的听觉信息创建的新的双耳分听测试,即 vOICe。参与者在实验室或在线使用相同的刺激进行测试。我们没有发现视障、经验丰富的 vOICe 用户在处理视觉-听觉信息时存在半球偏向。此外,我们没有发现视障、经验丰富的 vOICe 用户和视力正常的新手在视觉-听觉信息处理的半球偏侧性方面有任何差异。尽管标准的双耳分听是偏向于左半球的,但 SSD 中图像的听觉处理是双侧的,这可能是由于右半球处理的影响增加。因此,如果需要单耳呈现而不是双耳呈现,听觉 SSD 可能对两只耳朵同样有效。