Reznick R, Regehr G, MacRae H, Martin J, McCulloch W
Department of Surgery, University of Toronto, Ontario, Canada.
Am J Surg. 1997 Mar;173(3):226-30. doi: 10.1016/s0002-9610(97)89597-9.
A new approach to testing operative technical skills, the Objective Structured Assessment of Technical Skill (OSATS), formally assesses discrete segments of surgical tasks using bench model simulations. This study examines the interstation reliability and construct validity of a large-scale administration of the OSATS.
A 2-hour, eight-station OSATS was administered to 48 general surgery residents. Residents were assessed at each station by one of 48 surgeons who evaluated the resident using two methods of scoring: task-specific checklists and global rating scales.
Interstation reliability was 0.78 for the checklist score, and 0.85 for the global score. Analysis of variance revealed a significant effect of training for both the checklist score, F(3,44) = 20.08, P <0.001, and the global score, F(3,44) = 24.63, P <0.001.
The OSATS demonstrates high reliability and construct validity, suggesting that we can effectively measure residents' technical ability outside the operating room using bench model simulations.
一种测试手术操作技能的新方法,即客观结构化技术技能评估(OSATS),使用模拟实验台模型正式评估手术任务的各个离散部分。本研究检验了大规模实施OSATS时各站点间的可靠性和结构效度。
对48名普通外科住院医师进行了一次时长2小时、共八个站点的OSATS测试。每个站点由48名外科医生中的一名对住院医师进行评估,评估时使用两种评分方法:特定任务清单和整体评分量表。
清单评分的各站点间可靠性为0.78,整体评分为0.85。方差分析显示,培训对清单评分(F(3,44) = 20.08,P <0.001)和整体评分(F(3,44) = 24.63,P <0.001)均有显著影响。
OSATS显示出高可靠性和结构效度,这表明我们可以使用模拟实验台模型在手术室之外有效测量住院医师的技术能力。