Department of Exercise and Sport Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA.
Human Movement Science Curriculum, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA.
Sensors (Basel). 2024 Sep 17;24(18):6005. doi: 10.3390/s24186005.
(1) Background: As digital health technology evolves, the role of accurate medical-gloved hand tracking is becoming more important for the assessment and training of practitioners to reduce procedural errors in clinical settings. (2) Method: This study utilized computer vision for hand pose estimation to model skeletal hand movements during in situ aseptic drug compounding procedures. High-definition video cameras recorded hand movements while practitioners wore medical gloves of different colors. Hand poses were manually annotated, and machine learning models were developed and trained using the DeepLabCut interface via an 80/20 training/testing split. (3) Results: The developed model achieved an average root mean square error (RMSE) of 5.89 pixels across the training data set and 10.06 pixels across the test set. When excluding keypoints with a confidence value below 60%, the test set RMSE improved to 7.48 pixels, reflecting high accuracy in hand pose tracking. (4) Conclusions: The developed hand pose estimation model effectively tracks hand movements across both controlled and in situ drug compounding contexts, offering a first-of-its-kind medical glove hand tracking method. This model holds potential for enhancing clinical training and ensuring procedural safety, particularly in tasks requiring high precision such as drug compounding.
（1）背景：随着数字健康技术的发展，准确的医学手套手跟踪在评估和培训从业者以减少临床环境中的程序错误方面变得越来越重要。（2）方法：本研究利用计算机视觉对手部姿势估计进行建模，以模拟原位无菌药物配制过程中的骨骼手部运动。高清摄像机记录了从业人员戴不同颜色手套时的手部运动。手动注释手部姿势，并使用 DeepLabCut 接口通过 80/20 的训练/测试分割开发和训练机器学习模型。（3）结果：开发的模型在训练数据集上的平均均方根误差（RMSE）为 5.89 像素，在测试数据集上为 10.06 像素。当排除置信值低于 60%的关键点时，测试集 RMSE 提高到 7.48 像素，反映了手部姿势跟踪的高度准确性。（4）结论：开发的手部姿势估计模型有效地跟踪了受控和原位药物配制环境中的手部运动，提供了一种首创的医学手套手部跟踪方法。该模型有可能增强临床培训并确保程序安全，特别是在需要高精度的任务（如药物配制）中。
