Beck Stefanie, Ruhnke Bjarne, Issleib Malte, Daubmann Anne, Harendza Sigrid, Zöllner Christian
Department of Anaesthesiology, University Hospital Hamburg-Eppendorf, Martinistr. 52, 20246, Hamburg, Germany.
The Medical Faculty of the University Hamburg, Martinistr. 52, 20246, Hamburg, Germany.
BMC Med Educ. 2016 Oct 7;16(1):263. doi: 10.1186/s12909-016-0788-9.
Training of lay-rescuers is essential to improve survival-rates after cardiac arrest. Multiple campaigns emphasise the importance of basic life support (BLS) training for school children. Trainings require a valid assessment to give feedback to school children and to compare the outcomes of different training formats. Considering these requirements, we developed an assessment of BLS skills using MiniAnne and tested the inter-rater reliability between professionals, medical students and trained school children as assessors.
Fifteen professional assessors, 10 medical students and 111-trained school children (peers) assessed 1087 school children at the end of a CPR-training event using the new assessment format. Analyses of inter-rater reliability (intraclass correlation coefficient; ICC) were performed.
Overall inter-rater reliability of the summative assessment was high (ICC = 0.84, 95 %-CI: 0.84 to 0.86, n = 889). The number of comparisons between peer-peer assessors (n = 303), peer-professional assessors (n = 339), and peer-student assessors (n = 191) was adequate to demonstrate high inter-rater reliability between peer- and professional-assessors (ICC: 0.76), peer- and student-assessors (ICC: 0.88) and peer- and other peer-assessors (ICC: 0.91). Systematic variation in rating of specific items was observed for three items between professional- and peer-assessors.
Using this assessment and integrating peers and medical students as assessors gives the opportunity to assess hands-on skills of school children with high reliability.
培训非专业救援人员对于提高心脏骤停后的生存率至关重要。多项活动强调了对学童进行基本生命支持(BLS)培训的重要性。培训需要进行有效的评估,以便向学童提供反馈,并比较不同培训形式的效果。考虑到这些要求,我们开发了一种使用MiniAnne评估BLS技能的方法,并测试了专业人员、医学生和经过培训的学童作为评估者之间的评分者间信度。
15名专业评估者、10名医学生和111名经过培训的学童(同龄人)在心肺复苏培训活动结束时,使用新的评估形式对1087名学童进行了评估。进行了评分者间信度分析(组内相关系数;ICC)。
总体总结性评估的评分者间信度较高(ICC = 0.84,95%置信区间:0.84至0.86,n = 889)。同龄人评估者之间(n = 303)、同龄人-专业评估者之间(n = 339)以及同龄人-学生评估者之间(n = 191)的比较数量足以证明同龄人评估者与专业评估者之间(ICC:0.76)、同龄人评估者与学生评估者之间(ICC:0.88)以及同龄人评估者与其他同龄人评估者之间(ICC:0.91)具有较高的评分者间信度。在专业评估者和同龄人评估者之间,观察到三个项目在特定项目评分上存在系统差异。
使用这种评估方法,并将同龄人和医学生纳入评估者范围,有机会以高信度评估学童的实践技能。