Wong Camilla L, Norris Mireille, Sinha Samir S, Zorzitto Maria L, Madala Sushma, Hamid Jemila S
Li Ka Shing Knowledge Institute, St. Michael's Hospital, Toronto, ON, Canada; Division of Geriatrics, St. Michael's Hospital, Toronto, ON, Canada.
Division of Geriatrics, Sunnybrook Health Sciences Centre, Toronto, ON, Canada.
Can Geriatr J. 2016 Dec 23;19(4):182-188. doi: 10.5770/cgj.19.234. eCollection 2016 Dec.
The Team Standardized Assessment of a Clinical Encounter Report (StACER) was designed for use in Geriatric Medicine residency programs to evaluate Communicator and Collaborator competencies.
The Team StACER was completed by two geriatricians and interdisciplinary team members based on observations during a geriatric medicine team meeting. Postgraduate trainees were recruited from July 2010-November 2013. Inter-rater reliability between two geriatricians and between all team members was determined. Internal consistency of items for the constructs Communicator and Collaborator competencies was calculated. Raters completed a survey previously administered to Canadian geriatricians to assess face validity. Trainees completed a survey to determine the usefulness of this instrument as a feedback tool.
Thirty postgraduate trainees participated. The prevalence-adjusted bias-adjusted kappa range inter-rater reliability for Communicator and Collaborator items were 0.87-1.00 and 0.86-1.00, respectively. The Cronbach's alpha coefficient for Communicator and Collaborator items was 0.997 (95% CI: 0.993-1.00) and 0.997 (95% CI: 0.997-1.00), respectively. The instrument lacked discriminatory power, as all trainees scored "meets requirements" in the overall assessment. Niney-three per cent and 86% of trainees found feedback useful for developing Communicator and Collaborator competencies, respectively.
The Team StACER has adequate inter-rater reliability and internal consistency. Poor discriminatory power and face validity challenge the merit of using this evaluation tool. Trainees felt the tool provided useful feedback on Collaborator and Communicator competencies.
团队临床会诊报告标准化评估（StACER）旨在用于老年医学住院医师培训项目，以评估沟通者和协作者能力。
团队StACER由两名老年医学专家和跨学科团队成员根据老年医学团队会议期间的观察结果完成。2010年7月至2013年11月招募了研究生学员。确定了两名老年医学专家之间以及所有团队成员之间的评分者间信度。计算了沟通者和协作者能力结构项目的内部一致性。评分者完成了一项先前针对加拿大老年医学专家进行的调查，以评估表面效度。学员完成了一项调查，以确定该工具作为反馈工具的有用性。
30名研究生学员参与。沟通者和协作者项目的患病率调整偏差调整kappa评分者间信度范围分别为0.87 - 1.00和0.86 - 1.00。沟通者和协作者项目的Cronbach's alpha系数分别为0.997（95% CI：0.993 - 1.00）和0.997（95% CI：0.997 - 1.00）。该工具缺乏区分能力，因为所有学员在总体评估中得分均为“符合要求”。分别有93%和86%的学员认为反馈对培养沟通者和协作者能力有用。
团队StACER具有足够的评分者间信度和内部一致性。较差的区分能力和表面效度对使用该评估工具的价值提出了挑战。学员们认为该工具为协作者和沟通者能力提供了有用的反馈。
