Nseir Saad, Elkalioubie Ahmed, Deruelle Philippe, Lacroix Dominique, Gosset Didier
University of Lille, School of Medicine, Lille, France.
University Hospital of Lille, Critical Care Center, Lille, France.
Int J Med Educ. 2017 Feb 25;8:63-69. doi: 10.5116/ijme.5898.2f91.
This investigation aimed to determine the validity of script concordance test (SCT), compared with clinical-case-related short-answer management problems (SAMP), in fourth-year medical students.
This retrospective study was conducted at the Medical School of Lille University. Cardiology and gynecology examinations both included 3 SCT and 2 clinical-case-related SAMP. Final score did not include SCT results, and was out of 20 points. The passing score was ≥10/20. Wilcoxon and McNemar tests were used to compare quantitative and qualitative variables, respectively. Correlation between scores was also analyzed.
A total of 519 and 521 students completed SAMP and SCT in cardiology and gynecology, respectively. Cardiology score was significantly higher in SCT than SAMP (mean ± SD 13.5±2.4 versus 11.4±2.6, Wilcoxon test, p<0.001). In gynecology, SCT score was significantly lower than SAMP score (10.8±2.6 versus 11.4±2.7, Wilcoxon test, p=0.001). SCT and SAMP scores were significantly correlated (p <0.05, Pearson's correlation). However, percentage of students with SCT score ≥ 10/20 was similar among those who passed or failed cardiology (327 of 359 (91%) vs 146 of 160 (91%), χ=0.004, df =1, p=0.952), or gynecology (274 of 379 (65%) vs 84 of 142 (59%), χ=1.614, df=1, p=0.204) SAMP test. Cronbach alpha coefficient was 0.31 and 0.92 for all SCT and SAMP, respectively.
Although significantly correlated, the scores obtained in SCT and SAMP were significantly different in fourth-year medical students. These findings suggest that SCT should not be used for summative purposes in fourth-year medical students.
本研究旨在确定脚本一致性测试（SCT）与临床病例相关简答题管理问题（SAMP）相比，在四年级医学生中的有效性。
本回顾性研究在里尔大学医学院进行。心脏病学和妇科考试均包括3项SCT和2项临床病例相关的SAMP。最终成绩不包括SCT结果，满分为20分。及格分数为≥10/20。分别使用Wilcoxon检验和McNemar检验来比较定量和定性变量。还分析了分数之间的相关性。
共有519名和521名学生分别完成了心脏病学和妇科的SAMP和SCT。心脏病学中SCT的分数显著高于SAMP（均值±标准差13.5±2.4对11.4±2.6，Wilcoxon检验，p<0.001）。在妇科中，SCT分数显著低于SAMP分数（10.8±2.6对11.4±2.7，Wilcoxon检验，p=0.001）。SCT和SAMP分数显著相关（p<0.05，Pearson相关性）。然而，心脏病学考试及格或不及格的学生中SCT分数≥10/20的百分比相似（359人中的327人（91%）对160人中的146人（91%），χ=0.004，自由度=1，p=0.952），妇科SAMP考试中也是如此（379人中的274人（65%）对142人中的84人（59%），χ=1.614，自由度=1，p=0.204）。所有SCT和SAMP的Cronbach α系数分别为0.31和0.92。
虽然SCT和SAMP所得分数显著相关，但四年级医学生中这两种测试的分数存在显著差异。这些发现表明，SCT不应在四年级医学生中用于总结性评价目的。
