通过视觉到听觉感官替代的单声道和立体声道模式评估视力障碍者空间物体定位的准确性（一项试点研究）。
Assessment of Accuracy of Spatial Object Localization by Means of Mono and Stereo Modes of Visual-to-Auditory Sensory Substitution in People with Visual Impairments (a Pilot Study).
作者信息
Butorova A S, Koryukin E A, Khomenko N M, Sergeev A P
机构信息
Junior Researcher; Institute of Industrial Ecology of the Ural Branch of the Russian Academy of Sciences, 20 S. Kovalevskoy St., Ekaterinburg, 620990, Russia.
PhD Student; Ural Federal University named after the First President of Russia B.N. Yeltsin, 19 Mira St., Ekaterinburg, 620002, Russia; Research Assistant, Artificial Intelligence Laboratory; Ural Federal University named after the First President of Russia B.N. Yeltsin, 19 Mira St., Ekaterinburg, 620002, Russia.
出版信息
Sovrem Tekhnologii Med. 2024;16(4):29-36. doi: 10.17691/stm2024.16.4.03. Epub 2024 Aug 30.
UNLABELLED
is to assess the accuracy of spatial object localization in mono and stereo modes of visual-to-auditory sensory substitution by means of the developed system tested on persons with normal or corrected-to-normal vision.
MATERIALS AND METHODS
A prototype of a visual-to-auditory sensory substitution device based on a video camera with two lenses was prepared. Software to convert the signal from a video camera into an audio signal in mono and stereo modes was developed.To assess the developed system, an experimental study with 30 blindfolded sighted participants was conducted. 15 persons were tested in mono mode, 15 - in stereo mode. All persons were trained to use the visual-to-auditory sensory substitution system. During the experiment, participants were to locate a white plastic cube with dimensions of 4×4×4 cm on a working surface. The researcher placed the cube in one of 20 positions on the working surface in a pseudo-random order.
RESULTS
To assess the accuracy of the cube localization, deviations along the and -axes and absolute deviations were calculated. The general dynamics of localization accuracy was positive both in mono and stereo modes. Absolute deviation and -axis deviation were significantly higher in stereo mode; there was no significant difference in -axis deviation between modes. On average, participants tended to underestimate the distance to the cube when it was on the left, right, or far side of the working surface, and overestimate the distance to the cube when it was on the near side of the working surface.
CONCLUSION
Tests demonstrated that the accuracy of object localization in stereo mode can be improved by increasing the time for training the participants and by showing them more presentations. The results of the study can be used to develop assistive techniques for people with visual impairments, to manufacture medical equipment, and create brain-computer interfaces.
未标注
目的是通过在视力正常或矫正至正常的人身上测试所开发的系统，评估视觉到听觉感官替代的单声道和立体声模式下空间物体定位的准确性。
材料与方法
制备了基于带有两个镜头的摄像机的视觉到听觉感官替代设备的原型。开发了用于将来自摄像机的信号转换为单声道和立体声模式下的音频信号的软件。为了评估所开发的系统，对30名蒙眼的有视力参与者进行了实验研究。15人在单声道模式下进行测试，15人在立体声模式下进行测试。所有人员都接受了使用视觉到听觉感官替代系统的培训。在实验过程中，参与者要在工作表面上定位一个尺寸为4×4×4厘米的白色塑料立方体。研究人员以伪随机顺序将立方体放置在工作表面的20个位置之一。
结果
为了评估立方体定位的准确性，计算了沿x轴和y轴的偏差以及绝对偏差。单声道和立体声模式下定位准确性的总体动态都是正向的。立体声模式下的绝对偏差和x轴偏差显著更高；模式之间y轴偏差没有显著差异。平均而言，当立方体在工作表面的左侧、右侧或远侧时，参与者往往低估到立方体的距离，而当立方体在工作表面的近侧时，参与者往往高估到立方体的距离。
结论
测试表明，通过增加参与者的训练时间并向他们展示更多演示，可以提高立体声模式下物体定位的准确性。该研究结果可用于为视力障碍者开发辅助技术、制造医疗设备以及创建脑机接口。
Zotero 插件