Department of Medical Education Studies, International Research Center for Medical Education, Graduate School of Medicine, the University of Tokyo, Japan.
Department of Community-based Family Medicine, Faculty of Medicine, Tottori University, Japan.
Intern Med. 2022 Aug 1;61(15):2295-2300. doi: 10.2169/internalmedicine.9268-21. Epub 2022 May 21.
Objective Vaccination technique is a crucial skill for medical trainees to learn, especially in the current coronavirus disease 2019 pandemic. To this end, validated assessment tools are essential in teaching appropriate techniques. However, valid instruments for assessing vaccine administration skills have not yet been developed. We therefore explored the development and validation of an assessment tool for vaccination techniques based on expert consensus. Methods We implemented a modified Delphi process to develop a vaccination technique assessment tool. We then conducted a validation study to establish the reliability and validity of the tool. Results Two rounds of the modified Delphi process were performed to generate a 19-item, vaccination performance assessment checklist. In the validation study, the linear weighted kappa value for inter-rater reliability of the overall checklist score was 0.725. Spearman's correlation coefficient between the mean checklist score and the global rating was 0.98 (p<0.01). Conclusions This is a pioneering study examining the development and validation of an assessment tool for vaccine administration techniques. The tool will be widely used in vaccination-related education.
目的 接种技术是医学实习生必须掌握的一项关键技能,尤其是在当前的 2019 年冠状病毒病大流行期间。为此,验证有效的评估工具对于教授正确的技术至关重要。然而,目前尚未开发出用于评估疫苗接种技术的有效工具。因此,我们探索了基于专家共识制定疫苗接种技术评估工具的方法,并对其进行了开发和验证。
方法 我们采用改良 Delphi 法来制定接种技术评估工具。然后,我们进行了一项验证研究,以确定该工具的可靠性和有效性。
结果 通过两轮改良 Delphi 法,制定了一个 19 项的接种表现评估检查表。在验证研究中,整体检查表评分的观察者间可靠性的线性加权 Kappa 值为 0.725。检查表平均分与总体评分之间的斯皮尔曼相关系数为 0.98(p<0.01)。
结论 这是一项探索疫苗接种技术评估工具的开发和验证的开创性研究。该工具将广泛应用于与疫苗接种相关的教育。