IEEE Trans Biomed Eng. 2022 May;69(5):1630-1638. doi: 10.1109/TBME.2021.3124422. Epub 2022 Apr 21.
To develop a system for training central venous catheterization that does not require an expert observer. We propose a training system that uses video-based workflow recognition and electromagnetic tracking to provide trainees with real-time instruction and feedback.
The system provides trainees with prompts about upcoming tasks and visual cues about workflow errors. Most tasks are recognized from a webcam video using a combination of a convolutional neural network and a recurrent neural network. We evaluated the system's ability to recognize tasks in the workflow by computing the percent of tasks that were recognized and the average signed transitional delay between the system and reviewers. We also evaluated the usability of the system using a participant questionnaire.
The system was able to recognize 86.2% of tasks in the workflow. The average signed transitional delay was -0.7s. The average usability score on the questionnaire was 4.7 out of 5 for the system overall. The participants found the interactive task list to be the most useful component of the system with an average score of 4.8 out of 5.
Overall, the participants' response to the system was positive. Participants perceived that the system would be useful for central venous catheterization training. Our system provides trainees with meaningful instruction and feedback without needing an expert observer to be present.
We are able to provide trainees with more opportunities to access instruction and meaningful feedback by using workflow recognition.
开发一种不需要专家观察员的中心静脉置管培训系统。我们提出了一种使用基于视频的工作流程识别和电磁跟踪的培训系统,为学员提供实时指导和反馈。
该系统为学员提供有关即将到来的任务的提示以及有关工作流程错误的视觉提示。大多数任务是使用卷积神经网络和循环神经网络的组合从网络摄像头视频中识别的。我们通过计算被识别的任务的百分比以及系统和审阅者之间的平均符号过渡延迟,来评估系统识别工作流程中任务的能力。我们还使用参与者问卷评估了系统的可用性。
系统能够识别工作流程中 86.2%的任务。平均符号过渡延迟为-0.7s。参与者对系统的总体平均可用性评分为 4.7 分(满分 5 分)。参与者认为交互式任务列表是系统最有用的组件,平均得分为 4.8 分(满分 5 分)。
总的来说,参与者对系统的反应是积极的。参与者认为该系统将有助于中心静脉置管培训。我们的系统通过使用工作流程识别为学员提供了更多获得指导和有意义反馈的机会,而无需专家观察员在场。
我们能够通过使用工作流程识别为学员提供更多的机会获得指导和有意义的反馈。