Nephrology, Dialysis and Transplantation Department, Gabriel Montpied Hospital, Clermont-Ferrand, France.
Human Nutrition Unit, Clermont Auvergne University INRAE UMR 1019, Clermont-Ferrand, France.
Med Teach. 2024 Jan;46(1):110-116. doi: 10.1080/0142159X.2023.2239441. Epub 2023 Aug 6.
In the assessment of basic medical knowledge, the composition of the reference panel between specialists and primary care (PC) physicians is a contentious issue. We assessed the effect of panel composition on the scores of undergraduate medical students in a script concordance test (SCT).
The scale of an SCT on basic nephrology knowledge was set by a panel of nephrologists or a mixed panel of nephrologists and PC physicians. The results of the SCTs were compared with ANOVA for repeated measurements. Concordance was assessed with Bland and Altman plots.
Forty-five students completed the SCT. Their scores differed according to panel composition: 65.6 ± 9.73/100 points for nephrologists, and 70.27 ± 8.82 for the mixed panel, < 0.001. Concordance between the scores was low with a bias of -4.27 ± 2.19 and a 95% limit of agreement of -8.96 to -0.38. Panel composition led to a change in the ranking of 71% of students (mean 3.6 ± 2.6 places).
The composition of the reference panel, either specialist or mixed, for SCT assessment of basic knowledge has an impact on test results and student rankings.
在基础医学知识评估中，专科医生和基层医疗（PC）医生参考专家组的组成是一个有争议的问题。我们评估了专家组组成对本科医学生脚本一致性测试（SCT）分数的影响。
由肾病专家或肾病专家和 PC 医生混合专家组制定基本肾病知识 SCT 量表。使用重复测量方差分析比较 SCT 的结果。用 Bland 和 Altman 图评估一致性。
45 名学生完成了 SCT。他们的分数因专家组组成而异：肾病专家组为 65.6±9.73/100 分，混合专家组为 70.27±8.82 分，<0.001。评分之间的一致性较低，偏差为-4.27±2.19，95%的一致性范围为-8.96 至-0.38。专家组组成导致 71%的学生（平均 3.6±2.6 名）的排名发生变化。
SCT 评估基础知识时，参考专家组的组成（专科医生或混合专家组）对测试结果和学生排名有影响。
