Caspi Avi, Roy Arup, Barry Michael P, Sadeghi Roksana, Kartha Arathy, Dagnelie Gislin
Annu Int Conf IEEE Eng Med Biol Soc. 2020 Jul;2020:3323-3326. doi: 10.1109/EMBC44109.2020.9175803.
Tracking the eye of a blind patient can enhance the usability of an artificial vision system. In systems where the sensing element, i.e. the scene camera that captures the visual information, is mounted on the patient's head, the user must use head scanning in order to steer the line of sight of the implant to the region of interest. Integrating an eye tracker in the prosthesis will enable scanning using eye movements. The eye position will set the region of interest within the wide field-of-view of the scene camera. An essential requirement of an eye tracker is the need to calibrate it. Obviously, off-the-shelf calibration methods that require looking at known points in space cannot be used with blind users.Here we tested the feasibility of calibrating the eye-tracker based on pupil position and the location of the percept reported by the implant recipient, using a handheld marker. Pupil positions were extracted using custom image processing in a field-programmable-gate-array built into a glasses-mounted eye tracker. In the calibration process, electrodes were directly stimulated and the subject reported the location of the percept using a handheld marker. Linear regression was used to extract the transfer function from pupil position to gaze direction in the coordinates of the scene camera.In using the eye tracker with the proposed calibration method, patients demonstrated improved precision on a localization task with corresponding reduction of head movements.
追踪盲人患者的眼睛可以提高人工视觉系统的可用性。在传感元件(即捕捉视觉信息的场景相机)安装在患者头部的系统中,用户必须使用头部扫描才能将植入物的视线引导到感兴趣的区域。在假体中集成眼动追踪器将使患者能够通过眼球运动进行扫描。眼睛位置将在场景相机的宽视野内设置感兴趣的区域。眼动追踪器的一个基本要求是需要对其进行校准。显然,需要注视空间中已知点的现成校准方法不能用于盲人用户。在这里,我们测试了使用手持标记物,基于瞳孔位置和植入物接受者报告的感知位置来校准眼动追踪器的可行性。在安装在眼镜上的眼动追踪器内置的现场可编程门阵列中,使用自定义图像处理提取瞳孔位置。在校准过程中,直接刺激电极,受试者使用手持标记物报告感知的位置。使用线性回归在场景相机的坐标中提取从瞳孔位置到注视方向的传递函数。在使用具有所提出校准方法的眼动追踪器时,患者在定位任务中表现出更高的精度,同时头部运动相应减少。