Centre for Clinical Education, University of Copenhagen and Capital Region of Denmark, Copenhagen, Denmark. lkonge @ yahoo.dk
Respiration. 2011;81(6):483-90. doi: 10.1159/000324452. Epub 2011 Mar 3.
International guidelines suggest that trainees should perform at least 100 flexible bronchoscopies in a supervised setting, but this number is not evidence based. An objective assessment method could provide educational feedback to trainees and help supervisors decide when basic competency is established. No former assessment instrument has been able to distinguish between trainees and experts.
The aim of this study was to explore the validity and reliability of a new assessment procedure relating to testing operators across multiple tasks with increasing difficulty using a standardized scoring form.
The test was administered on a virtual reality bronchoscopy simulator to a total of 42 test subjects (14 senior consultants, 14 trainees and 14 medical students). The inter-rater reliability of the test procedure was explored according to examination of test results from 10 subjects using 3 raters (2 blinded).
We found a high inter-rater reliability (Cronbach's α = 0.90). The assessment procedure sufficiently differentiated the performance of the 3 groups (p < 0.001). Assessment of 6 procedures was necessary to secure a generalizability coefficient >0.80.
The new assessment procedure proved both valid and reliable.
国际指南建议学员在监督环境下至少完成 100 例软性支气管镜检查，但这一数字没有依据。客观评估方法可以为学员提供教育反馈，并帮助主管确定何时建立基本能力。以前没有评估工具能够区分学员和专家。
本研究旨在探讨一种新的评估程序的有效性和可靠性，该程序使用标准化评分表，通过多项具有递增难度的任务来测试操作人员。
共有 42 名测试对象（14 名高级顾问、14 名学员和 14 名医学生）在虚拟现实支气管镜模拟器上进行了测试。根据 10 名受试者的测试结果，使用 3 名评分者（2 名盲评），对测试程序的组内一致性进行了评估。
我们发现该评估程序具有很高的组内一致性（Cronbach's α = 0.90）。该评估程序能够充分区分 3 组的表现（p < 0.001）。需要评估 6 个程序才能确保综合系数>0.80。
新的评估程序被证明是有效且可靠的。
