Kim Mary S, Park Beomseok, Sippel Genevieve J, Mun Aaron H, Yang Wanzhao, McCarthy Kathleen H, Fernandez Emely, Linguraru Marius George, Sarcevic Aleksandra, Marsic Ivan, Burd Randall S
Division of Trauma and Burn Surgery, Children's National Hospital, Washington, DC 20010, United States.
Department of Electrical and Computer Engineering, Rutgers University, New Brunswick, NJ 08901, United States.
J Am Med Inform Assoc. 2025 Jan 1;32(1):163-171. doi: 10.1093/jamia/ocae262.
Human monitoring of personal protective equipment (PPE) adherence among healthcare providers has several limitations, including the need for additional personnel during staff shortages and decreased vigilance during prolonged tasks. To address these challenges, we developed an automated computer vision system for monitoring PPE adherence in healthcare settings. We assessed the system performance against human observers detecting nonadherence in a video surveillance experiment.
The automated system was trained to detect 15 classes of eyewear, masks, gloves, and gowns using an object detector and tracker. To assess how the system performs compared to human observers in detecting nonadherence, we designed a video surveillance experiment under 2 conditions: variations in video durations (20, 40, and 60 seconds) and the number of individuals in the videos (3 versus 6). Twelve nurses participated as human observers. Performance was assessed based on the number of detections of nonadherence.
Human observers detected fewer instances of nonadherence than the system (parameter estimate -0.3, 95% CI -0.4 to -0.2, P < .001). Human observers detected more nonadherence during longer video durations (parameter estimate 0.7, 95% CI 0.4-1.0, P < .001). The system achieved a sensitivity of 0.86, specificity of 1, and Matthew's correlation coefficient of 0.82 for detecting PPE nonadherence.
An automated system simultaneously tracks multiple objects and individuals. The system performance is also independent of observation duration, an improvement over human monitoring.
The automated system presents a potential solution for scalable monitoring of hospital-wide infection control practices and improving PPE usage in healthcare settings.
医护人员对个人防护装备(PPE)依从性进行人工监测存在若干局限性,包括在人员短缺时需要额外人员以及长时间任务期间警惕性降低。为应对这些挑战,我们开发了一种用于监测医疗机构中PPE依从性的自动化计算机视觉系统。我们在视频监控实验中评估了该系统相对于检测不依从情况的人类观察者的性能。
使用目标检测器和跟踪器对自动化系统进行训练,以检测15类眼镜、口罩、手套和防护服。为了评估该系统在检测不依从情况时与人类观察者相比的表现,我们在两种条件下设计了一个视频监控实验:视频时长变化(20、40和60秒)以及视频中的个体数量(3名与6名)。12名护士作为人类观察者参与。根据检测到的不依从情况数量评估性能。
人类观察者检测到的不依从情况实例比系统少(参数估计值为-0.3,95%置信区间为-0.4至-0.2,P < 0.001)。人类观察者在较长视频时长中检测到更多不依从情况(参数估计值为0.7,95%置信区间为0.4 - 1.0,P < 0.001)。该系统在检测PPE不依从情况时的灵敏度为0.86,特异性为1,马修斯相关系数为0.82。
自动化系统可同时跟踪多个物体和个体。系统性能也与观察时长无关,这是相对于人工监测的一个改进。
该自动化系统为医院范围内感染控制措施的可扩展监测以及改善医疗机构中PPE的使用提供了一种潜在解决方案。