Judd Terry, Ryan Anna, Flynn Eleanor, McColl Geoff
Department of Medical Education, The University of Melbourne, Melbourne, Australia.
Perspect Med Educ. 2017 Oct;6(5):356-361. doi: 10.1007/s40037-017-0372-y.
Large-scale interview and simulation-based assessments such as objective structured clinical examinations (OSCEs) and multiple mini interviews (MMIs) are logistically complex to administer, generate large volumes of assessment data, and are strong candidates for the adoption of computer-based marking systems. Adoption of new technologies can be challenging, and technical failures, which are relatively commonplace, can delay and/or create resistance to ongoing implementation.This paper reports on the adoption process of an electronic marking system for OSCEs and MMIs following an unsuccessful initial trial. It describes how, after the initial setback, a staged implementation, progressing from small to larger-scale assessments, single to multiple assessment types, and lower to higher stakes assessments, was used to successfully adopt and embed iPad-based marking within our medical school.Critical factors in the success of this approach included thorough appraisal and selection of technologies, rigorous assurance of system reliability and security, constant review and refinement, and careful attention to implementation and end-user training. Engagement of stakeholders is also crucial, especially in the case of previous failures or setbacks. The early identification and recruitment of staff to provide specific expertise and support for adoption of an innovation helps to facilitate this process with four key roles proposed; those of innovation advocate, champion, expert and sponsor.
大规模的基于面试和模拟的评估，如客观结构化临床考试（OSCEs）和多迷你面试（MMIs），在组织实施上后勤工作复杂，会产生大量评估数据，并且是采用基于计算机的评分系统的有力候选方式。采用新技术可能具有挑战性，相对常见的技术故障会延迟和/或引发对持续实施的抵触情绪。本文报告了在初次试用失败后，OSCEs和MMIs电子评分系统的采用过程。它描述了在最初的挫折之后，如何通过分阶段实施，从小规模评估逐步过渡到大规模评估，从单一评估类型过渡到多种评估类型，从低风险评估过渡到高风险评估，成功地在我们医学院采用并嵌入基于iPad的评分系统。这种方法成功的关键因素包括对技术进行全面评估和选择、严格确保系统可靠性和安全性、不断审查和完善，以及认真关注实施和最终用户培训。利益相关者的参与也至关重要，特别是在之前有失败或挫折的情况下。尽早识别和招募为采用创新提供特定专业知识和支持的人员有助于推动这一过程，文中提出了四个关键角色；即创新倡导者、拥护者、专家和赞助者。
