Cundy Peter
Specialty Court of Orthopaedic Surgery, Court of Examiners, Royal Australasian College of Surgeons, Australia.
ANZ J Surg. 2012 Sep;82(9):607-11. doi: 10.1111/j.1445-2197.2012.06035.x. Epub 2012 Mar 27.
The Final Examination for Orthopaedic Surgeons in Australia comprises seven components of which two are written responses and five are oral examinations involving separate pairs of examiners.
The reliability of the examination process and close marking system was assessed by using a standardized DVD of a sham examination. Fifteen current examiners viewed the DVD and scored the viewed examination independently.
The results demonstrated consistency in scoring and reliability. This validation is likely to be further increased by the current system of the pairing of examiners. Additionally, the patient-based examination segments were found to be as reliably scored as the criterion-referenced computer-based examination stations.
Candidates for the Fellowship Examination should be reassured that this study has shown that the examination process has inter-examiner reliability and consistency.
澳大利亚骨科外科医生期末考试由七个部分组成,其中两个是书面回答,五个是口试,口试由不同的考官小组进行。
通过使用模拟考试的标准化DVD来评估考试过程和严格评分系统的可靠性。15名现任考官观看了DVD并独立对观看的考试进行评分。
结果显示评分具有一致性和可靠性。当前考官配对系统可能会进一步提高这种有效性。此外,发现基于患者的考试部分与基于标准参照计算机的考试站一样具有可靠的评分。
fellowship考试的考生应放心,本研究表明考试过程具有考官间的可靠性和一致性。