Optics Department, IMT Atlantique, 29238 Brest CEDEX 03, France.
Eyes Triple Shut, 78430 Louveciennes, France.
Sensors (Basel). 2023 Mar 27;23(7):3503. doi: 10.3390/s23073503.
Recording a video scene as seen by an observer, materializing where is focused his visual attention and allowing an external person to point at a given object in this scene, could be beneficial for various applications such as medical education or remote training. Such a versatile device, although tested at the experimental laboratory demonstrator stage, has never been integrated in a compact and portable way in a real environment. In this context, we built a low-cost, light-weight, head-mounted device integrating a miniature camera and a laser pointer that can be remotely controlled or servo-controlled by an eye tracker. Two motorizations were implemented and tested (pan/tilt and Rilsey-prisms-based). The video was both recorded locally and transmitted wirelessly. Risley prisms allowed finer remote control of camera or laser pointer orientation (0.1° vs. 0.35°), but data processing and Wi-Fi transmission incur significant latency (~0.5 s) limiting the servo-controlling by eye movements. The laser beam was spatially shaped by a Diffractive Optical Element to facilitate object illumination or recognition. With this first proof-of-concept prototype, the data stream needs to be optimized to make full use of the eye tracker, but this versatile device can find various applications in education, healthcare or research.
记录观察者所见的视频场景，将其聚焦在他的视觉注意力所在的位置，并允许外部人员在该场景中指向给定的对象，这对于各种应用（如医学教育或远程培训）可能是有益的。这种多功能设备虽然在实验实验室演示阶段进行了测试，但从未以紧凑和便携的方式集成到真实环境中。在这种情况下，我们构建了一个低成本、轻量级的头戴式设备，该设备集成了一个微型摄像头和一个激光指示器，可以通过眼动仪远程或伺服控制。实现并测试了两种电机（俯仰和基于 Risley 棱镜）。视频既可以本地录制，也可以无线传输。Risley 棱镜允许更精细地远程控制相机或激光指示器的方向（0.1° 与 0.35°），但数据处理和 Wi-Fi 传输会导致显著的延迟（~0.5 s），从而限制了通过眼动的伺服控制。激光束通过衍射光学元件进行空间整形，以方便对象的照明或识别。通过这个初步的概念验证原型，数据流需要进行优化，以充分利用眼动仪，但这种多功能设备可以在教育、医疗保健或研究领域找到各种应用。
