Likova Lora T, Mineff Kristyo N, Tyler Christopher W
Smith-Kettlewell Eye Research Institute, San Francisco, Ca, USA.
IS&T Int Symp Electron Imaging. 2021;33(11). doi: 10.2352/issn.2470-1173.2021.11.hvei-160.
We describe the development of a multipurpose haptic stimulus delivery and spatiomotor recording system with tactile map-overlays for electronic processing This innovative multipurpose spatiomotor capture system will serve a wide range of functions in the training and behavioral assessment of spatial memory and precise motor control for blindness rehabilitation, both for STEM learning and for navigation training and map reading. Capacitive coupling through the map-overlays to the touch-tablet screen below them allows precise recording i) of hand movements during haptic exploration of tactile raised-line images on one tablet and ii) of line-drawing trajectories on the other, for analysis of navigational errors, speed, time elapsed, etc. Thus, this system will provide for the first time in an integrated and automated manner quantitative assessments of the whole 'perception-cognition-action' loop - from non-visual exploration strategies, spatial memory, precise spatiomotor control and coordination, drawing performance, and navigation capabilities, as well as of haptic and movement planning and control. The accuracy of memory encoding, in particular, can be assessed by the memory-drawing operation of the capture system. Importantly, this system allows for both remote and in-person operation. Although the focus is on visually impaired populations, the system is designed to equally serve training and assessments in the normally sighted as well.
我们描述了一种具有触觉地图覆盖层的多功能触觉刺激传递与空间运动记录系统的开发，用于电子处理。这种创新的多功能空间运动捕捉系统将在空间记忆训练和行为评估以及盲人康复的精确运动控制中发挥广泛作用，无论是在科学、技术、工程和数学（STEM）学习方面，还是在导航训练和地图阅读方面。通过地图覆盖层与下方触摸平板电脑屏幕的电容耦合，可以精确记录：i）在一个平板电脑上对触觉凸起线条图像进行触觉探索时的手部运动，以及ii）在另一个平板电脑上的线条绘制轨迹，用于分析导航误差、速度、经过时间等。因此，该系统将首次以集成和自动化的方式对整个“感知 - 认知 - 行动”循环进行定量评估——从非视觉探索策略、空间记忆、精确的空间运动控制与协调、绘图表现和导航能力，以及触觉和运动规划与控制。特别是，记忆编码的准确性可以通过捕捉系统的记忆绘图操作来评估。重要的是，该系统允许远程操作和现场操作。尽管重点是视障人群，但该系统设计为同样适用于正常视力人群的训练和评估。
