Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, Los Angeles, Calif; Keck School of Medicine, University of Southern California, Los Angeles, Calif.
Department of Pediatrics, Division of Emergency and Transport Medicine, Children's Hospital Los Angeles, Los Angeles, Calif; Keck School of Medicine, University of Southern California, Los Angeles, Calif.
Acad Pediatr. 2018 Jan-Feb;18(1):86-93. doi: 10.1016/j.acap.2017.08.009. Epub 2017 Aug 24.
Transfer of care sign-outs (TOCS) for admissions from a pediatric emergency department have unique challenges. Standardized and reliable assessment tools for TOCS remain elusive. We describe the development, reliability, and validity of a TOCS assessment tool.
Video recordings of resident TOCS were assessed to capture 4 domains: completeness, synopsis, foresight, and professionalism. In phase 1, 56 TOCS were used to modify the tool and improve reliability. In phase 2, 91 TOCS were used to examine validity. Analyses included Cronbach's alpha for internal structure, intraclass correlation and Cohen's kappa for interrater reliability, Pearson's correlation for relationships between variables, and 95% confidence interval of the mean for resident group comparisons.
Cronbach's alpha was 0.52 for internal structure of the tool's subjective rating scale. Intraclass correlation for the subjective rating scale items ranged from 0.70 to 0.80. Cohen's kappa for most objective checklist items ranged from 0.43 to 1. Content completeness was significantly correlated with synopsis, foresight, and professionalism (Pearson's r ranged from 0.36 to 0.62, P values were <0.001). House staff senior residents scored higher (on average) than interns and rotating senior residents in synopsis and foresight. Also, house staff interns scored higher (on average) than rotating senior residents in professionalism. House staff senior residents scored higher (on average) than rotating senior residents in content completeness.
We provide validity evidence to support using scores from the TOCS tool to assess higher-level transfer of care comprehension and communication by pediatric emergency department residents and to test interventions to improve TOCS.
儿科急诊科的入院患者交接(TOCS)存在独特的挑战。标准化和可靠的 TOCS 评估工具仍然难以捉摸。我们描述了 TOCS 评估工具的开发、可靠性和有效性。
评估住院医师 TOCS 的视频记录,以捕捉 4 个领域:完整性、概要、远见和专业性。在第 1 阶段,使用 56 次 TOCS 来修改工具并提高可靠性。在第 2 阶段,使用 91 次 TOCS 来检验有效性。分析包括内部结构的克朗巴赫 α、评分者间可靠性的组内相关系数和 Cohen's kappa、变量之间关系的 Pearson 相关以及居民组比较的平均值的 95%置信区间。
工具主观评分量表的内部结构克朗巴赫 α 为 0.52。主观评分量表项目的组内相关系数范围为 0.70 至 0.80。大多数客观清单项目的 Cohen's kappa 范围为 0.43 至 1。内容完整性与概要、远见和专业性显著相关(Pearson's r 范围为 0.36 至 0.62,P 值均<0.001)。住院医师高级住院医师在概要和远见方面的得分(平均)高于实习医师和轮转高级住院医师。此外,住院医师实习医师在专业性方面的得分(平均)高于轮转高级住院医师。住院医师高级住院医师在内容完整性方面的得分(平均)高于轮转高级住院医师。
我们提供了有效性证据,支持使用 TOCS 工具的评分来评估儿科急诊科住院医师更高层次的护理交接理解和沟通能力,并测试改善 TOCS 的干预措施。