University of Texas Medical Branch, Department of Family Medicine, Galveston, TX.
Department of Orthopaedic Surgery and Rehabilitation, University of Texas Medical Branch, Galveston, TX.
Fam Med. 2023 May;55(5):333-338. doi: 10.22454/FamMed.2023.170761. Epub 2023 Feb 21.
We sought to describe the process of integrating resident self-assessments into milestone assessments at the University of Texas Medical Branch Family Medicine Residency Program in Galveston, Texas. We compared resident self-assessments across milestones to Clinical Competency Committee (CCC) assessments across terms (fall versus spring) and by postgraduate year (PGY).
In fall 2020, the milestone assessment process was updated to include a resident milestone self-assessment, which was used as the starting point for CCC assessment. We calculated mean and standard deviation of average milestone scores for both self-assessment and CCC for each PGY. We used repeated measure analysis of variance to examine within- and between-subject effects.
Self-assessment and CCC assessments were completed for 30 postgraduate trainees for spring 2020 and fall 2021 terms, for a total of 60 self- and 60 CCC assessments. CCC score was similar to self-assessment. There were larger variations in the resident self-assessment scores than CCC scores. Self-assessment scores increased by PGY, but were not different between fall and spring terms. We found a significant three-way interaction of assessors, terms, and PGYs.
Resident milestone self-assessment enables residents to participate in the assessment process, and when differences exist between self- and CCC assessments, specific feedback can be given based on individual milestone skills. Our study showed progression between PGY regardless of the assessor, but only CCC assessment showed significant differences between terms.
我们旨在描述德克萨斯大学医学分部家庭医学住院医师项目在德克萨斯加尔维斯顿分校整合住院医师自我评估纳入里程碑评估的过程。我们比较了跨里程碑的住院医师自我评估与跨学期(秋季与春季)和毕业后年份(PGY)的临床能力委员会(CCC)评估。
2020 年秋季,更新了里程碑评估流程,包括住院医师里程碑自我评估,该评估将作为 CCC 评估的起点。我们计算了每个 PGY 的自我评估和 CCC 的平均里程碑分数的平均值和标准差。我们使用重复测量方差分析来检查内部和个体之间的效果。
共完成了 30 名住院医师在 2020 年春季和 2021 年秋季学期的自我评估和 CCC 评估,共完成了 60 次自我评估和 60 次 CCC 评估。CCC 评分与自我评估相似。住院医师自我评估分数的变化大于 CCC 评分。自我评估分数随 PGY 增加,但秋季和春季学期之间没有差异。我们发现评估者、学期和 PGY 之间存在显著的三向交互作用。
住院医师里程碑自我评估使住院医师能够参与评估过程,并且当自我评估和 CCC 评估之间存在差异时,可以根据个人里程碑技能提供具体反馈。我们的研究表明,无论评估者如何,PGY 之间都有进展,但只有 CCC 评估显示出学期之间的显著差异。