Department of Orthopedic Surgery, Diakonissen Hospital, Mannheim, Germany.
mbits imaging GmbH, Heidelberg, Germany.
Appl Clin Inform. 2020 Jan;11(1):88-94. doi: 10.1055/s-0039-1701003. Epub 2020 Jan 29.
Availability of patient-specific image data, gathered from preoperatively conducted studies, like computed tomography scans and magnetic resonance imaging studies, during a surgical procedure is a key factor for surgical success and patient safety. Several alternative input methods, including recognition of hand gestures, have been proposed for surgeons to interact with medical image viewers during an operation. Previous studies pointed out the need for usability evaluation of these systems.
We describe the accuracy and usability of a novel software system, which integrates gesture recognition via machine learning into an established image viewer.
This pilot study is a prospective, observational trial, which asked surgeons to interact with software to perform two standardized tasks in a sterile environment, modeled closely to a real-life situation in an operating room. To assess usability, the validated "System Usability Scale" (SUS) was used. On a technical level, we also evaluated the accuracy of the underlying neural network.
The neural network reached 98.94% accuracy while predicting the gestures during validation. Eight surgeons with an average of 6.5 years of experience participated in the usability study. The system was rated on average with 80.25 points on the SUS.
The system showed good overall usability; however, additional areas of potential improvement were identified and further usability studies are needed. Because the system uses standard PC hardware, it made for easy integration into the operating room.
在手术过程中,利用术前进行的计算机断层扫描和磁共振成像研究等获取的患者特定图像数据是手术成功和患者安全的关键因素。为了让外科医生在手术过程中与医学图像查看器进行交互,已经提出了几种替代输入方法,包括对手势的识别。先前的研究指出需要对这些系统进行可用性评估。
我们描述了一种新颖的软件系统的准确性和可用性,该系统通过机器学习将手势识别集成到现有的图像查看器中。
这是一项前瞻性、观察性试验,要求外科医生在无菌环境中使用软件来执行两个标准化任务,这些任务紧密模拟手术室中的实际情况。为了评估可用性,使用了经过验证的“系统可用性量表”(SUS)。在技术层面上,我们还评估了基础神经网络的准确性。
在验证过程中,神经网络对手势的预测准确率达到 98.94%。8 名具有平均 6.5 年经验的外科医生参与了可用性研究。该系统在 SUS 上的平均得分为 80.25 分。
该系统整体可用性良好;但是,确定了一些潜在的改进领域,需要进一步进行可用性研究。由于该系统使用标准的 PC 硬件,因此很容易集成到手术室中。