Department of Anaesthesia and Pain Management, Royal Melbourne Hospital, Parkville, Victoria, Australia.
University of Melbourne, Parkville, Victoria, Australia.
Infect Control Hosp Epidemiol. 2023 May;44(5):732-735. doi: 10.1017/ice.2022.169. Epub 2022 Jul 14.
To compare the accuracy of monitoring personal protective equipment (PPE) donning and doffing process between an artificial intelligent (AI) machine collaborated with remote human buddy support system and an onsite buddy, and to determine the degree of AI autonomy at the current development stage.
We conducted a pilot simulation study with 30 procedural scenarios (15 donning and 15 doffing, performed by one individual) incorporating random errors in 55 steps. In total, 195 steps were assessed.
The human-AI machine system and the onsite buddy assessed the procedures independently. The human-AI machine system performed the assessment via a tablet device, which was positioned to allow full-body visualization of the donning and doffing person.
The overall accuracy of PPE monitoring using the human-AI machine system was 100% and the overall accuracy of the onsite buddy was 99%. There was a very good agreement between the 2 methods (κ coefficient, 0.97). The current version of the AI technology was able to perform autonomously, without the remote human buddy's rectification in 173 (89%) of 195 steps. It identified 67.3% of all the errors independently.
This study provides preliminary evidence suggesting that a human-AI machine system may be able to serve as a substitute or enhancement to an onsite buddy performing the PPE monitoring task. It provides practical assistance using a combination of a computer mirror, visual prompts, and verbal commands. However, further studies are required to examine its clinical efficacy with a diverse range of individuals performing the donning and doffing procedures.
比较人工智能 (AI) 机器与人远程助手协作系统和现场助手在监测个人防护设备 (PPE) 穿戴过程中的准确性,并确定在当前发展阶段 AI 的自主程度。
我们在包含 55 个步骤随机错误的 30 个程序场景(15 个穿戴和 15 个脱卸,由一个人执行)中进行了一项试点模拟研究。总共评估了 195 个步骤。
人工 AI 机器系统和现场助手独立评估程序。人工 AI 机器系统通过平板电脑设备进行评估,该设备的位置允许对穿戴者的全身进行可视化。
使用人工 AI 机器系统监测 PPE 的总体准确率为 100%,现场助手的总体准确率为 99%。两种方法之间存在很好的一致性(κ系数,0.97)。当前版本的 AI 技术能够在 195 个步骤中的 173 个(89%)步骤中自主执行,无需远程人类助手纠正。它独立识别了 67.3%的所有错误。
这项研究初步表明,人工 AI 机器系统可能能够替代或增强现场助手执行 PPE 监测任务。它使用计算机镜像、视觉提示和语音命令相结合提供实用帮助。然而,需要进一步研究来检查其在不同个体执行穿戴程序中的临床效果。