Nair Balakrishnan, Moonen-van Loon Joyce M W, Parvathy Mulavana, van der Vleuten Cees P M
University of Newcastle.
Faculty of Health.
MedEdPublish (2016). 2021 Apr 30;10:104. doi: 10.15694/mep.2021.000104.1. eCollection 2021.
This article was migrated. The article was marked as recommended. Introduction All developed countries depend on International Medical Graduates (IMGs) to complement their workforce. However, the assessment of their fitness to practice and acculturation into the new system can be challenging. To improve this, we introduced Workplace Based Assessment (WBA), using a programmatic philosophy. This paper reports the reliability of this new approach. Method Over the past 10 years, we have assessed over 250 IMGs, each cohort assessed over a 6-month period. We used Mini-Cex, Case Based Discussions (CBD) and Multi-Source Feedback (MSF) to assess them. We analysed the reliability of each tool and the composite reliability of 12 Mini-Cex, 5 CBDs and 12 MSF assessments in the tool kit. Results A reliability coefficient of 0.78 with a SEM of 0.19 was obtained for the sample of 236 IMGs. We found the MSF to be the most reliable tool. By adding one more MSF to the assessment on two occasions, we can reach a reliability of 0.8 and SEM of 0.18. Conclusions The current assessment methodology has acceptable reliability. By increasing the MSF, we can improve the reliability. The lessons from this study are generalisable to IMG assessment and other medical education programs.
本文已迁移。该文章被标记为推荐文章。引言 所有发达国家都依赖国际医学毕业生（IMGs）来补充其劳动力。然而，评估他们的执业能力以及融入新体系的情况可能具有挑战性。为了改善这一状况，我们引入了基于工作场所的评估（WBA），采用了一种系统性理念。本文报告了这种新方法的可靠性。方法 在过去10年中，我们评估了超过250名国际医学毕业生，每个队列在6个月的时间内接受评估。我们使用迷你临床演练评估（Mini-Cex）、基于案例的讨论（CBD）和多源反馈（MSF）对他们进行评估。我们分析了每种工具的可靠性以及工具包中12次Mini-Cex、5次CBD和12次MSF评估的综合可靠性。结果 对236名国际医学毕业生的样本进行评估，得到的可靠性系数为0.78，标准误为0.19。我们发现多源反馈是最可靠的工具。通过在两次评估中再增加一次多源反馈，我们可以达到0.8的可靠性和0.18的标准误。结论 当前的评估方法具有可接受的可靠性。通过增加多源反馈，我们可以提高可靠性。本研究所得经验可推广至国际医学毕业生评估及其他医学教育项目。
