Mahour G H, Hoffman K I
J Pediatr Surg. 1986 Feb;21(2):154-7. doi: 10.1016/s0022-3468(86)80070-7.
This paper reports on the development and validation of a standardized in-training examination for approved graduate program in pediatric surgery. The major purpose of the examination was to provide an external source of data for program and/or educational evaluation. The method used for equating the examination across years, ensuring content relevance are detailed. Given the emphasis on program evaluation, validation procedures concentrated on determining if differences in training would be reflected in performance differences on the examination. The performance of four groups differing in levels of training was compared. Three of the groups represented increasing levels of training within pediatric surgery. The fourth group consisted of trainees in general surgery with an average of 2.5 postgraduate years. Analysis of variance revealed a significant difference in mean performance across and between all four groups. Trend analysis showed the greatest difference to be between trainees in general surgery and trainees just beginning their pediatric surgical training. The smallest difference is noted between the first and second year trainees in pediatric surgery. Performance gains within the second year of training seem to be more specialized and concentrated in certain subject areas. The impact of the above findings and the examination in general for residency program development and evaluation are discussed.
本文报告了一项针对小儿外科认可的研究生项目的标准化在职考试的开发与验证情况。该考试的主要目的是为项目和/或教育评估提供外部数据来源。详细介绍了用于逐年使考试等值、确保内容相关性的方法。鉴于对项目评估的重视，验证程序集中于确定培训差异是否会反映在考试成绩差异上。比较了四组培训水平不同的人员的表现。其中三组代表小儿外科培训水平的逐步提高。第四组由普通外科住院医师组成，平均有2.5年研究生学习经历。方差分析显示，所有四组之间以及组内的平均表现存在显著差异。趋势分析表明，普通外科住院医师与刚开始小儿外科培训的住院医师之间的差异最大。小儿外科第一年和第二年住院医师之间的差异最小。培训第二年的表现提升似乎更具专业性，且集中在某些学科领域。讨论了上述发现以及该考试总体上对住院医师培训项目发展和评估的影响。
