Aldahlawi Salwa A, Almoallim Amr H, Afifi Ibtesam K
Department of Basic and Clinical Oral Sciences, Faculty of Dental Medicine, Umm Al - Qura University, Makkah, Saudi Arabia.
Independent Scholar, Riyadh, Saudi Arabia.
Clin Exp Dent Res. 2025 Jun;11(3):e70150. doi: 10.1002/cre2.70150.
The study aimed to assess the efficacy of an artificial intelligence (AI) model in evaluating hand hygiene (HH) performance compared to infection control auditors in dental clinics.
The AI model utilized a pretrained convolutional neural network (CNN) and was fine-tuned on a custom data set of videos showing dental students performing alcohol-based hand rub (ABHR) procedures. A total of 66 videos were recorded, with 33 used for training and 11 for validating the model. The remaining 22 videos were designated for testing and the AI- infection control auditors comparison experiment. Two infection control auditors assessed the HH performance videos using a standardized checklist. The model's performance was evaluated through precision, recall, and F1 score across various classes. The level of agreement between the auditors and the AI assessments was measured using Cohen's kappa, and the sensitivity and specificity of the AI were compared to those of the infection control auditors.
The AI model has learned to differentiate between classes of hand movement, with an overall F1 score of 0.85. Results showed a 90.91% agreement rate between the AI model and infection control auditors in evaluating HH steps, with a sensitivity of 85.7% and specificity of 100% in identifying acceptable HH practices. Step 3 (back of fingers to opposing palm with fingers interlocked) was consistently identified as the most frequently missed step by both the AI model and the infection control auditors.
The AI model assessment of HH performance closely matched auditors' evaluations, suggesting its reliability as a tool for evaluating and mentoring HH in dental clinics. Future research should explore the application of AI technology in different dental settings to further validate its feasibility and adaptability.
本研究旨在评估人工智能(AI)模型在评估牙科诊所手部卫生(HH)表现方面的效果,并与感染控制审核员的评估结果进行比较。
该AI模型使用了预训练的卷积神经网络(CNN),并在一个自定义数据集上进行了微调,该数据集包含展示牙科学生进行酒精擦手(ABHR)操作的视频。共录制了66个视频,其中33个用于训练,11个用于验证模型。其余22个视频用于测试以及AI与感染控制审核员的比较实验。两名感染控制审核员使用标准化检查表评估HH表现视频。通过各类别的精确率、召回率和F1分数评估模型的性能。使用科恩kappa系数测量审核员与AI评估之间的一致性水平,并将AI的敏感性和特异性与感染控制审核员的进行比较。
AI模型已学会区分手部动作类别,总体F1分数为0.85。结果显示,在评估HH步骤时,AI模型与感染控制审核员的一致率为90.91%,在识别可接受的HH操作方面,敏感性为85.7%,特异性为100%。步骤3(手指背向相对手掌,手指交叉)一直被AI模型和感染控制审核员一致认定为最常被遗漏的步骤。
AI模型对HH表现的评估与审核员的评估结果高度匹配,表明其作为牙科诊所评估和指导HH的工具具有可靠性。未来的研究应探索AI技术在不同牙科环境中的应用,以进一步验证其可行性和适应性。