Department of Medical Education and Informatics, Ankara University Faculty of Medicine, Ankara, Turkey.
Department of Measurement and Evaluation, Ankara University Faculty of Education, Ankara, Turkey.
Ann Med. 2023 Dec;55(1):490-501. doi: 10.1080/07853890.2023.2168744.
The quality of the performances of standardized patients plays a significant role in the effectiveness of clinical skills education. Therefore, providing standardized patients with constant feedback is essential. It is especially important to get students' perspectives immediately following their encounters with standardized patients. In the literature, there is no scale for use by students to evaluate the performance of standardized patients. Thus, the three main goals of this study were to: (1) develop a scale for use by students to evaluate the performance of standardized patients, (2) examine the psychometric properties of the scale, and (3) determine a cut-off score for the scale in a standard-setting.
Seven hundred and two medical students participated in the scale- development process, the pilot test, and the validation process, and seven educators took part in the standard-setting process. After the evaluation of content validity, construct validity was assessed via exploratory and confirmatory factor analyses. For the standard-setting study, the extended Angoff method was used.
The exploratory factor analysis revealed that the scale had a single-factor structure, which was confirmed by confirmatory factor analysis. The Cronbach's alpha internal consistency coefficient was 0.91. The scale consists of nine items. The cut-off score was determined to be 24.11/45, which represents the minimum acceptable standard for standardized patient performance.
Our study outlined the critical steps in developing a measurement tool and produced a valid and reliable scale that allows medical students to assess the performance of standardized patients immediately following their interaction with the standardized patient. This scale constitutes an important contribution to the literature as it provides a tool for standardized patient trainers to assess standardized patients' weaknesses and help them improve their performance.KEY MESSAGESEvaluation of SP performance is essential to ensure the educational quality of clinical skills training programs.Students are the most relevant stakeholders to give feedback about SP performance immediately after encounters.The 'Standardized Patient Performance Rating Scale - Student Version' is a valid, reliable scale that can be used by students for the evaluation of standardized patients' strengths and weaknesses at individual-performance levels quickly.
标准化患者的表现质量对临床技能教育的效果起着重要作用。因此，为标准化患者提供持续的反馈至关重要。尤其重要的是，在学生与标准化患者接触后立即获得他们的反馈。在文献中，没有学生用于评估标准化患者表现的量表。因此，本研究的三个主要目标是：（1）开发学生用于评估标准化患者表现的量表，（2）检验量表的心理测量学特性，（3）在标准设定中确定量表的截止分数。
702 名医学生参与了量表开发过程、试点测试和验证过程，7 名教育工作者参与了标准设定过程。在内容效度评估后，通过探索性和验证性因素分析评估结构效度。对于标准设定研究，使用扩展的 Angoff 方法。
探索性因素分析显示，该量表具有单因素结构，验证性因素分析也证实了这一点。Cronbach's alpha 内部一致性系数为 0.91。该量表由 9 个项目组成。截点分数确定为 24.11/45，代表标准化患者表现的最低可接受标准。
我们的研究概述了开发测量工具的关键步骤，并生成了一个有效且可靠的量表，使医学生能够在与标准化患者互动后立即评估标准化患者的表现。该量表为文献做出了重要贡献，因为它为标准化患者培训师提供了一种工具，以评估标准化患者的弱点并帮助他们提高表现。
评估 SP 表现对于确保临床技能培训计划的教育质量至关重要。
学生是在与 SP 接触后立即提供反馈的最相关利益相关者。
“标准化患者表现评定量表-学生版”是一个有效、可靠的量表，学生可以快速地对标准化患者的优势和劣势进行个体表现水平的评估。
