Melcher Peter, Roth Andreas, Ghanem Mohamed, Rotzoll Daisy
LernKlinik Leipzig.
Klinik und Poliklinik für Orthopädie, Unfallchirurgie, plastische Chirurgie, Universitätsklinik Leipzig A. ö. R.
Z Orthop Unfall. 2017 Aug;155(4):468-475. doi: 10.1055/s-0043-109022. Epub 2017 May 18.
Medical curricula require an increasing amount of integrated clinical practical skills education. German medical faculties are increasingly implementing the OSCE (objective structured clinical examination) to test students' practical as well as communication skills. Teaching and assessment tools for practical skills include simulators and simulated patient scenarios, where peer-assisted teaching (PAT) is applied. Trained student tutors support this process. This study examines for the first time the use of PAT student tutors as examiners in an orthopaedic OSCE unit and the existence of possible differences in rating between faculty and PAT student tutors. N = 94 students (out of n = 324) in their first clinical year were randomly assigned to the OSCE unit "spine and pelvis examination" in March/April 2016 and data were collected over the three-day OSCE period. A structured checklist was developed and the two examiners (one university professor from the Department of Orthopaedics, one PAT student tutor) received identical preparatory training. The checklist was completed by both examiners independently and data were collected for statistical analysis. The analysis focused on the overall evaluation in points, as well as separate checklist sections focusing on different competences and comparison of the three consecutive examination days. Analysis was conducted by SPSS. The average number of points in the overall evaluation was 19.5 (out of 25) points. The student tutor evaluated the students with an average of 19.1 points, the professor with 19.9 points. A significant difference was observed between the two examiner evaluations of day one (p < 0.001) and in the overall analysis (p < 0.001). On OSCE examination days 2 and 3, no significant differences in evaluation were observed. The analysis shows only one significant evaluation difference between the two assessors, with the PAT student tutor's evaluation being stricter. The authors conclude that a point difference of 0.8 out of 25 in the average overall evaluation and an interrater reliability of 0.95 in an orthopaedic OSCE station examining practical skills as well as communication skills justifies employing PAT student tutors as assessors in this context. The obligatory requirements for this are a detailed PAT student tutor training, the development of a well-structured and valid checklist, as well as continuous quality assurance of the overall OSCE.
医学课程要求越来越多的综合临床实践技能教育。德国医学院校越来越多地采用客观结构化临床考试(OSCE)来测试学生的实践技能和沟通技巧。实践技能的教学和评估工具包括模拟器和模拟患者场景,并应用同伴辅助教学(PAT)。经过培训的学生导师支持这一过程。本研究首次考察了在骨科OSCE单元中使用PAT学生导师作为考官的情况,以及教师和PAT学生导师在评分上是否存在差异。2016年3月/4月,94名(共324名)处于临床第一年的学生被随机分配到OSCE单元“脊柱和骨盆检查”,并在为期三天的OSCE期间收集数据。制定了一份结构化检查表,两位考官(一位来自骨科的大学教授,一位PAT学生导师)接受了相同的预培训。两位考官独立完成检查表,并收集数据进行统计分析。分析重点在于以分数表示的总体评价,以及专注于不同能力的检查表各部分,并对连续三天的考试进行比较。分析由SPSS进行。总体评价的平均分数为19.5分(满分25分)。学生导师对学生的平均评分为19.1分,教授为19.9分。在第一天的两位考官评价之间(p < 0.001)以及总体分析中(p < 0.001)观察到显著差异。在OSCE考试的第2天和第3天,未观察到评价上的显著差异。分析表明两位评估者之间仅存在一个显著的评价差异,即PAT学生导师的评价更为严格。作者得出结论,在一个考察实践技能和沟通技巧的骨科OSCE站点中,总体评价平均分数相差0.8分(满分25分)以及评分者间信度为0.95证明在这种情况下可以聘用PAT学生导师作为评估者。对此的强制性要求是对PAT学生导师进行详细培训,制定一份结构良好且有效的检查表,以及对整个OSCE进行持续的质量保证。