Department of Medicine, Royal College of Surgeons in Ireland, Beaumont Hospital, Dublin, Ireland.
Med Teach. 2009 Nov;31(11):e545-50. doi: 10.3109/01421590903095494.
The importance of valid and reliable assessment of student competence and performance is gaining increased recognition. Provision of valid patient-based formative assessment is an increasing challenge for clinical teachers in a busy hospital setting. A formative assessment tool that reliably predicts performance in the summative setting would be of value to both students and teachers.
This study explores the utility of the team objective structured bedside assessment (TOSBA), a novel ward-based formative assessment tool, in predicting student performance in the final clinical examination.
The performance of a cohort of final year students (n = 191) in the TOSBA was compared with their subsequent performance in the final examination. A comparison was also made between student performance in the existing formative assessment tool, the objective structured long examination record (OSLER) and the final examination. We also examined the relationship between the TOSBA and the components of the final examination using clustering around latent variables analysis.
There was a clear relationship between student performance in the TOSBA and performance in the final examination (r(2) = 0.35). Student performance in the OSLER showed a poor relationship with performance in the final examination (r(2) = 0.15) compared with the TOSBA. The TOSBA results showed particular correlation with specific components of the final examination which were clinically based.
TOSBA performance is a strong predictor of subsequent performance in the final examination. The clustering of the TOSBA with other assessments of clinical skills underlines its utility. Further research is required to determine whether performance in the TOSBA is predictive of subsequent performance during internship.
学生能力和表现的有效和可靠评估的重要性日益受到重视。在繁忙的医院环境中,为临床教师提供有效的基于患者的形成性评估是一个越来越大的挑战。一种能够可靠预测总结性评估表现的形成性评估工具,对学生和教师都将具有重要价值。
本研究探讨了团队客观结构化床边评估(TOSBA)作为一种新颖的基于病房的形成性评估工具,在预测学生最终临床考试表现方面的效用。
将一组最后一年学生(n = 191)在 TOSBA 中的表现与他们随后在期末考试中的表现进行比较。还比较了学生在现有的形成性评估工具(客观结构化长考试记录(OSLER))和期末考试中的表现。我们还使用潜在变量聚类分析,检查了 TOSBA 与期末考试各个组成部分之间的关系。
学生在 TOSBA 中的表现与期末考试中的表现之间存在明显的关系(r²=0.35)。与 TOSBA 相比,学生在 OSLER 中的表现与期末考试中的表现相关性较差(r²=0.15)。TOSBA 的结果与基于临床的期末考试的特定组成部分显示出特别的相关性。
TOSBA 的表现是期末考试后续表现的有力预测指标。TOSBA 与其他临床技能评估的聚类强调了其效用。需要进一步研究以确定 TOSBA 的表现是否可以预测实习期间的后续表现。