脚本一致性测试评估基础肾病知识在本科医学教育中的影响，基于参考面板组成对评分的影响。

Impact of reference panel composition on scores of script concordance test assessing basic nephrology knowledge in undergraduate medical education.

机构信息

Nephrology, Dialysis and Transplantation Department, Gabriel Montpied Hospital, Clermont-Ferrand, France.

Human Nutrition Unit, Clermont Auvergne University INRAE UMR 1019, Clermont-Ferrand, France.

出版信息

Med Teach. 2024 Jan;46(1):110-116. doi: 10.1080/0142159X.2023.2239441. Epub 2023 Aug 6.

DOI:10.1080/0142159X.2023.2239441

PMID:37544894

Abstract

PURPOSE

In the assessment of basic medical knowledge, the composition of the reference panel between specialists and primary care (PC) physicians is a contentious issue. We assessed the effect of panel composition on the scores of undergraduate medical students in a script concordance test (SCT).

METHODS

The scale of an SCT on basic nephrology knowledge was set by a panel of nephrologists or a mixed panel of nephrologists and PC physicians. The results of the SCTs were compared with ANOVA for repeated measurements. Concordance was assessed with Bland and Altman plots.

RESULTS

Forty-five students completed the SCT. Their scores differed according to panel composition: 65.6 ± 9.73/100 points for nephrologists, and 70.27 ± 8.82 for the mixed panel, < 0.001. Concordance between the scores was low with a bias of -4.27 ± 2.19 and a 95% limit of agreement of -8.96 to -0.38. Panel composition led to a change in the ranking of 71% of students (mean 3.6 ± 2.6 places).

CONCLUSION

The composition of the reference panel, either specialist or mixed, for SCT assessment of basic knowledge has an impact on test results and student rankings.

摘要

目的

在基础医学知识评估中，专科医生和基层医疗（PC）医生参考专家组的组成是一个有争议的问题。我们评估了专家组组成对本科医学生脚本一致性测试（SCT）分数的影响。

方法

由肾病专家或肾病专家和 PC 医生混合专家组制定基本肾病知识 SCT 量表。使用重复测量方差分析比较 SCT 的结果。用 Bland 和 Altman 图评估一致性。

结果

45 名学生完成了 SCT。他们的分数因专家组组成而异：肾病专家组为 65.6±9.73/100 分，混合专家组为 70.27±8.82 分，<0.001。评分之间的一致性较低，偏差为-4.27±2.19，95%的一致性范围为-8.96 至-0.38。专家组组成导致 71%的学生（平均 3.6±2.6 名）的排名发生变化。