Stoll Chloé, Palluel-Germain Richard, Fristot Vincent, Pellerin Denis, Alleysson David, Graff Christian
University Grenoble Alpes, LPNC, 38000 Grenoble, France; CNRS, LPNC, 38000 Grenoble, France.
University Grenoble Alpes, GIPSA-Lab, 38000 Grenoble, France.
Appl Bionics Biomech. 2015;2015:543492. doi: 10.1155/2015/543492. Epub 2015 Feb 5.
Background. Common manufactured depth sensors generate depth images that humans normally obtain from their eyes and hands. Various designs converting spatial data into sound have been recently proposed, speculating on their applicability as sensory substitution devices (SSDs). Objective. We tested such a design as a travel aid in a navigation task. Methods. Our portable device (MeloSee) converted 2D array of a depth image into melody in real-time. Distance from the sensor was translated into sound intensity, stereo-modulated laterally, and the pitch represented verticality. Twenty-one blindfolded young adults navigated along four different paths during two sessions separated by one-week interval. In some instances, a dual task required them to recognize a temporal pattern applied through a tactile vibrator while they navigated. Results. Participants learnt how to use the system on both new paths and on those they had already navigated from. Based on travel time and errors, performance improved from one week to the next. The dual task was achieved successfully, slightly affecting but not preventing effective navigation. Conclusions. The use of Kinect-type sensors to implement SSDs is promising, but it is restricted to indoor use and it is inefficient on too short range.
背景。常见的人造深度传感器生成的深度图像是人类通常通过眼睛和双手获取的。最近有人提出了各种将空间数据转换为声音的设计，并推测其作为感官替代设备（SSD）的适用性。目的。我们在导航任务中测试了这样一种设计作为旅行辅助工具。方法。我们的便携式设备（MeloSee）将深度图像的二维阵列实时转换为旋律。传感器的距离被转换为声音强度，进行横向立体声调制，音高表示垂直度。21名蒙眼的年轻人在两个相隔一周的时间段内沿着四条不同的路径导航。在某些情况下，一项双重任务要求他们在导航时识别通过触觉振动器施加的时间模式。结果。参与者学会了如何在新路径以及他们已经走过的路径上使用该系统。基于行进时间和错误，表现从一周到下一周有所提高。双重任务成功完成，对有效导航有轻微影响但并未阻止。结论。使用Kinect型传感器来实现SSD是有前景的，但仅限于室内使用，并且在太短的距离上效率低下。
