Johns Hopkins University, Baltimore, MD, USA.
Vanderbilt University, Nashville, TN, USA.
Int J Comput Assist Radiol Surg. 2024 Jul;19(7):1281-1284. doi: 10.1007/s11548-024-03150-x. Epub 2024 May 5.
Eye gaze tracking and pupillometry are evolving areas within the field of tele-robotic surgery, particularly in the context of estimating cognitive load (CL). However, this is a recent field, and current solutions for gaze and pupil tracking in robotic surgery require assessment. Considering the necessity of stable pupillometry signals for reliable cognitive load estimation, we compare the accuracy of three eye trackers, including head and console-mounted designs.
We conducted a user study with the da Vinci Research Kit (dVRK), to compare the three designs. We collected eye tracking and dVRK video data while participants observed nine markers distributed over the dVRK screen. We compute and analyze pupil detection stability and gaze prediction accuracy for the three designs.
Head-worn devices present better stability and accuracy of gaze prediction and pupil detection compared to console-mounted systems. Tracking stability along the field of view varies between trackers, with gaze predictions detected at invalid zones of the image with high confidence.
While head-worn solutions show benefits in confidence and stability, our results demonstrate the need to improve eye tacker performance regarding pupil detection, stability, and gaze accuracy in tele-robotic scenarios.
眼动追踪和瞳孔测量是远程机器人手术领域内不断发展的领域,特别是在估计认知负荷(CL)方面。然而,这是一个新兴领域,目前机器人手术中的注视和瞳孔跟踪解决方案需要评估。考虑到稳定的瞳孔测量信号对于可靠的认知负荷估计的必要性,我们比较了三种眼动追踪器的准确性,包括头戴式和控制台安装式设计。
我们使用达芬奇研究工具包(dVRK)进行了一项用户研究,以比较三种设计。我们收集了眼动追踪和 dVRK 视频数据,同时参与者观察了分布在 dVRK 屏幕上的九个标记。我们计算并分析了三种设计的瞳孔检测稳定性和注视预测准确性。
头戴式设备在注视预测和瞳孔检测的稳定性和准确性方面优于控制台安装式系统。跟踪稳定性在跟踪器之间变化,注视预测在高置信度的图像无效区域被检测到。
虽然头戴式解决方案在置信度和稳定性方面具有优势,但我们的结果表明,需要提高眼动追踪器在远程机器人场景中的瞳孔检测、稳定性和注视准确性方面的性能。