Morrison H, McNally H, Wylie C, McFaul P, Thompson W
School of Education, Queen's University of Belfast, Northern Ireland.
Med Educ. 1996 Sep;30(5):345-8. doi: 10.1111/j.1365-2923.1996.tb00845.x.
The objective structured clinical examination (OSCE) now has an established place in the assessment of the medical undergraduate. While much has been written about the reliability of the OSCE, empirical work on the determination of the passing score which represents competence on the OSCE is rarely encountered. If the OSCE is to play its role in the 'high stakes' testing of clinical competence, it is important that this passing score be set reliably and defensibly. This article illustrates how a two-session modified Angoff standard-setting procedure is used to set the passing score on a 14 station Obstetrics and Gynaecology OSCE used to assess final year students at The Queen's University of Belfast. The Angoff methodology harnesses the professional judgement of expert judges to establish defensible standards. Four university teachers, five non-academic consultants and six junior clinical staff took part in a two-session Angoff standard-setting procedure. In the first session, the judges (individually and in silence) used their professional judgement to estimate the score which a minimally competent final year obstetrics and gynaecology student should achieve on each tested element of the OSCE. In the second session they revised their session 1 judgements in the light of the OSCE scores of real students and the opportunity for structured discussion. The passing score for the OSCE is reported together with the statistical measures which assure its reliability.
客观结构化临床考试(OSCE)如今在医学本科评估中已占据一席之地。虽然关于OSCE的可靠性已有诸多著述,但关于确定代表OSCE能力的及格分数的实证研究却很少见。如果OSCE要在临床能力的“高风险”测试中发挥作用,可靠且合理地设定这个及格分数至关重要。本文阐述了如何采用两阶段的改良安格夫标准设定程序来确定贝尔法斯特女王大学用于评估最后一年学生的14站妇产科OSCE的及格分数。安格夫方法利用专家评委的专业判断来确立合理的标准。四位大学教师、五位非学术顾问和六位初级临床工作人员参与了两阶段的安格夫标准设定程序。在第一阶段,评委们(各自独立且安静地)运用他们的专业判断来估计一名最低限度合格的妇产科最后一年学生在OSCE的每个测试项目上应得的分数。在第二阶段,他们根据真实学生的OSCE分数以及进行结构化讨论的机会,对第一阶段的判断进行了修订。报告了OSCE的及格分数以及确保其可靠性的统计指标。