Department of Radiology, Level 6, Ninewells Hospital and Medical School, Dundee, Tayside DD1 9SY, United Kingdom.
J Vasc Interv Radiol. 2010 Jan;21(1):130-4. doi: 10.1016/j.jvir.2009.09.013. Epub 2009 Nov 20.
To determine whether an electronic endovascular simulator exhibited "construct validity," that is, the ability to differentiate between novice and experienced operators of differing levels of experience, and whether training on the simulator led to improved performance, thereby indicating "instructional effectiveness" for basic endovascular tasks.
Two separate experiments were performed by using an electronic endovascular simulator. In the first experiment, which was performed to investigate construct validity, the performance of four experienced operators and four novice radiology trainees was compared by using three objective outcome measures. In the second experiment, performed to investigate instructional effectiveness, the authors observed the performance of 14 novice operators before and after training on the device by using similar objective outcome measures as well as subjective measurement of performance from operator and supervisor.
In the first experiment, one of the three simulator-derived objective outcome measures for the two subject groups was statistically significant and the other two approached statistical significance. In the second experiment, two of the three objective criteria and all subjective assessments of performance criteria showed a statistically significant improvement.
The results indicate that the endovascular simulator exhibits both construct validity and instructional effectiveness for trainees at an early stage in their acquisition of these skills and support its use in the acquisition of basic endovascular skills.
确定电子血管内模拟器是否具有“构建效度”,即区分不同经验水平的新手和经验丰富的操作人员的能力,以及在模拟器上进行培训是否会导致性能提高,从而表明基本血管内任务的“教学有效性”。
使用电子血管内模拟器进行了两项独立的实验。在第一个实验中,为了研究构建效度,通过三个客观的结果衡量标准,比较了四个经验丰富的操作人员和四个新手放射科学员的表现。在第二个实验中,为了研究教学效果,作者通过使用类似的客观结果衡量标准以及操作人员和主管的主观性能测量,观察了 14 名新手操作人员在设备上培训前后的表现。
在第一个实验中,两个受试组的三个模拟器衍生的客观结果衡量标准中的一个具有统计学意义,另外两个接近统计学意义。在第二个实验中,三个客观标准中的两个和所有主观性能评估标准都显示出统计学上的显著改善。
结果表明,血管内模拟器对于这些技能早期阶段的学员具有构建效度和教学有效性,并支持其在基本血管内技能的获取中的应用。