Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Campus Gualtar, Braga, 4710-057, Portugal.
ICVS/3B's-PT Government Associate Laboratory, Braga/Guimarães, 4710-057, Portugal.
BMC Med Educ. 2023 Mar 22;23(1):177. doi: 10.1186/s12909-023-04146-y.
Ultrasound assessment of the airway recently integrates the point-of-care approach to patient evaluation since ultrasound measurements can predict a difficult laryngoscopy and tracheal intubation. Because ultrasonography is performer-dependent, a proper training and assessment tool is needed to increase diagnostic accuracy. An objective, structured assessment ultrasound skill (OSAUS) scale was recently developed to guide training and assess competence. This work aims to study the psychometric properties of OSAUS Scale when used to evaluate competence in ultrasound hyomental distance (HMD) measurement.
Prospective and experimental study. Volunteers were recruited and enrolled in groups with different expertise. Each participant performed three ultrasonographic HMD evaluation. The performance was videorecorded and anonymized. Five assessors blindly rated participants' performance using OSAUS scale and a Global Rating Scale (GRS). A psychometric study of OSAUS scale as assessment tool for ultrasound HMD competence was done.
Fifteen voluntaries participated on the study. Psychometric analysis of OSAUS showed strong internal consistency (Cronbach's alpha 0.916) and inter-rater reliability (ICC 0.720; p < 0.001). The novice group scored 15.4±0.18 (mean±SD), the intermediate 14.3±0.75 and expert 13.6±0.1.25, with a significant difference between novice and expert groups (p = 0.036). The time in seconds to complete the task was evaluated: novice (90±34) (mean±SD), intermediate (84±23) and experts (83±15), with no significant differences between groups. A strong correlation was observed between OSAUS and global rating scale (r = 0.970, p < 0.001).
The study demonstrated evidence of validity and reliability. Further studies are needed to implement OSAUS scale in the clinical setting for training and assessment of airway ultrasound competence.
气道的超声评估最近将床边检查方法整合到患者评估中，因为超声测量可以预测喉镜检查和气管插管的难度。由于超声检查依赖于操作者，因此需要适当的培训和评估工具来提高诊断准确性。最近开发了一种客观的、结构化的超声技能评估（OSAUS）量表，以指导培训和评估能力。本研究旨在研究 OSAUS 量表在评估超声下颏舌骨距离（HMD）测量能力时的心理测量特性。
前瞻性和实验研究。招募志愿者并分为不同专业知识水平的组。每位参与者进行三次超声 HMD 评估。记录并匿名记录表现。五位评估者使用 OSAUS 量表和整体评分量表（GRS）对参与者的表现进行盲评。对 OSAUS 量表作为超声 HMD 能力评估工具进行了心理计量学研究。
15 名志愿者参与了这项研究。OSAUS 的心理计量分析显示出很强的内部一致性（Cronbach's alpha 0.916）和评分者间可靠性（ICC 0.720；p < 0.001）。新手组得分为 15.4±0.18（平均值±标准差），中级组为 14.3±0.75，专家组为 13.6±0.12，新手组和专家组之间存在显著差异（p = 0.036）。完成任务所需的秒数评估：新手（90±34）（平均值±标准差），中级（84±23）和专家（83±15），组间无显著差异。OSAUS 与整体评分量表之间存在很强的相关性（r = 0.970，p < 0.001）。
该研究证明了有效性和可靠性。需要进一步的研究来将 OSAUS 量表应用于临床环境，以培训和评估气道超声能力。
