Jarl Martin, Escher Cecilia, Harbut Piotr, Conte Helen, Nilsson Ulrica
Department of Neurobiology, Care Sciences and Society, Karolinska Institute, Alfred Nobels Allé 23, Stockholm, 171 77, Sweden.
Department of Anesthesia and Intensive Care, Danderyd University Hospital, Stockholm, Sweden.
BMC Med Educ. 2025 May 17;25(1):718. doi: 10.1186/s12909-025-07297-2.
Non-technical skills are the essential cognitive, social, and personal resources contributing to safe and efficient task performance. An assessment tool can facilitate the development and teaching of non-technical skills. The nurse anesthetist non-technical skills tool includes four categories and fifteen elements and is an adaptation of the existing tools for physician anesthetists and Danish nurse anesthetists. The ratings are on a five-step scale, with an option to select "Not Relevant". Since there doesn't exist an assessment tool for Swedish nurse anesthetists' non-technical skills, the aim of the study was to translate and adapt the assessment tool for nurse anesthetists' non-technical skills to a Swedish context and test its psychometric qualities among nurse anesthetists with experience in teaching nurse anesthetist students and junior nurse anesthetists in clinical settings.
In this prospective psychometric evaluation study, sixteen nurse anesthetists were recruited. They rated 12 video clips of simulated anesthesia scenarios after participating in a three-hour calibration workshop. Four weeks later, a test-retest was conducted, which included five video clips. Internal consistency, Interrater reliability, and test-retest reliability were examined.
Internal consistency showed acceptable results on the element level and Interrater reliability indicated good results. Retest reliability showed poor to moderate reliability. The use of "Not Relevant" varied significantly depending on the length of the video clip and the provider being rated. The raters considered the assessment tool suitable but initially challenging to use for rating non-technical skills among nurse anesthetists and articulate non-technical skills in anesthesia nursing.
This initial testing of the Swedish nurse anesthetists' non-technical skills tool shows acceptable psychometric qualities and gives a foundation for future research. However, the rating "Not Relevant" poses challenges that need to be addressed. Nevertheless, the participants consider the assessment of non-technical skills in Swedish nurse anesthetists to be appropriate.
非技术技能是有助于安全高效完成任务的重要认知、社交和个人资源。一种评估工具可促进非技术技能的发展与教学。护士麻醉师非技术技能工具包括四个类别和十五个要素，是对现有麻醉医生和丹麦护士麻醉师工具的改编。评分采用五级量表，并有选择“不相关”的选项。由于不存在针对瑞典护士麻醉师非技术技能的评估工具，本研究的目的是将护士麻醉师非技术技能评估工具翻译并改编至瑞典环境，并在有教学护士麻醉专业学生经验的护士麻醉师以及临床环境中的初级护士麻醉师中测试其心理测量学质量。
在这项前瞻性心理测量学评估研究中，招募了16名护士麻醉师。他们在参加了为期三小时的校准工作坊后，对12个模拟麻醉场景的视频片段进行评分。四周后进行重测，包括5个视频片段。检验了内部一致性、评分者间信度和重测信度。
内部一致性在要素层面显示出可接受的结果，评分者间信度显示出良好的结果。重测信度显示出较差到中等的信度。“不相关”的使用因视频片段的长度和被评分的提供者而有显著差异。评分者认为该评估工具适用，但最初用于评估护士麻醉师的非技术技能以及阐述麻醉护理中的非技术技能具有挑战性。
瑞典护士麻醉师非技术技能工具的这项初步测试显示出可接受的心理测量学质量，并为未来研究奠定了基础。然而，“不相关”评分带来了需要解决的挑战。尽管如此，参与者认为对瑞典护士麻醉师的非技术技能进行评估是合适的。
