Acad Med. 2009 Oct;84(10 Suppl):S120-3. doi: 10.1097/ACM.0b013e3181b37009.
Composite score validity depends on its reliability, content, and comparison with other outcomes measures. This study examined all three aspects of a composite score used in a third-year surgery clerkship.
Composite score reliability was calculated using stratified alpha; several other reasonable composite combinations were tested. Correlation coefficients between clerkship composite scores and grades were calculated with other achievement measures. Two consecutive years were studied (N = 162, N = 159).
The clerkship composite score reliability was .76 (Year 1) and .81 (Year 2). Positive correlations (P <or= .05) were found between composite scores and other clerkships' test scores and the United States Medical Licensing Examination Step 2 Clinical Knowledge examination. Positive correlations (P <or= .05) were found between surgery clerkship grades and other clerkship grades.
This study documents the reliability of a composite score and provides evidence for its validity in a surgery clerkship.
综合评分的有效性取决于其可靠性、内容以及与其他结果测量的比较。本研究检验了三年级外科学实习中使用的综合评分的这三个方面。
使用分层 alpha 计算综合评分的可靠性;还测试了其他几种合理的综合组合。使用其他成就衡量标准计算实习综合评分与成绩之间的相关系数。对连续两年(N = 162,N = 159)进行了研究。
实习综合评分的可靠性分别为.76(第 1 年)和.81(第 2 年)。综合评分与其他实习的测试成绩和美国医师执照考试第 2 步临床知识考试之间存在正相关(P≤.05)。实习成绩与其他实习成绩之间存在正相关(P≤.05)。
本研究记录了综合评分的可靠性,并为外科学实习中的有效性提供了证据。