Sandella Jeanne M, Smith Larissa A, Dowling Dennis J
Vice President for Clinical Skills Testing, 101 W Elm St, Suite 150, Conshohocken, PA 19428-2004.
J Am Osteopath Assoc. 2014 Apr;114(4):253-8. doi: 10.7556/jaoa.2014.050.
Assessment of osteopathic manipulative treatment (OMT) is included in the National Board of Osteopathic Medical Examiners' Comprehensive Osteopathic Medical Licensing Examination-USA Level 2-Performance Evaluation (COMLEX-USA Level 2-PE). The scores earned for OMT should be equivalent among all raters regardless of which technique is scored or which rater is scoring the performance. As a quality assurance measure, selected examination dates and the encounters within the administration of COMLEX-USA Level 2-PE are scored by 2 raters: first by a "live" rater and next by a quality assurance rater. Neither rater knows if he or she is the first or second rater.
To compare candidate's scores recorded for OMT on COMLEX-USA Level 2-PE to determine whether differences exist among raters and techniques scored.
The authors evaluated candidate performances that took place from July through November 2012. For each performance, 2 raters scored the same technique or different techniques using the OMT scoring rubric. Discrepancies between scores were compared using t tests. Statistical significance was set at P<.05 for most analyses.
Of the 708 performances, there was no statistically significant difference in scoring whether the OMT raters scored the same technique or different techniques when the students performed more than 1. There were no statistically significant differences between these results and instances when only a single technique was performed and scored.
The present study provides reliability evidence for the use of the global OMT scoring tool in the evaluation of OMT in COMLEX-USA Level 2-PE.
整骨手法治疗（OMT）评估包含在美国整骨医学考试委员会的美国综合整骨医学执照考试二级——实践评估（COMLEX - USA二级 - PE）中。无论评分的是哪种技术或哪位评分者对表现进行评分，所有评分者为OMT给出的分数都应相当。作为一项质量保证措施，COMLEX - USA二级 - PE考试管理过程中的选定考试日期及考试场次由两名评分者打分：首先由一名“现场”评分者打分，接着由一名质量保证评分者打分。两名评分者都不知道自己是第一个还是第二个评分者。
比较COMLEX - USA二级 - PE考试中考生OMT的得分，以确定评分者之间以及所评技术之间是否存在差异。
作者评估了2012年7月至11月期间考生的表现。对于每次表现，两名评分者使用OMT评分标准对相同技术或不同技术进行评分。使用t检验比较分数差异。大多数分析将统计学显著性设定为P <.05。
在708次表现中，当学生进行了不止一项操作时，OMT评分者对相同技术或不同技术进行评分时，得分无统计学显著差异。这些结果与只进行并评分一项技术的情况之间也无统计学显著差异。
本研究为在COMLEX - USA二级 - PE考试中使用整体OMT评分工具评估OMT提供了可靠性证据。
