Meng Li, Metro David G, Patel Rita M
J Grad Med Educ. 2009 Dec;1(2):216-20. doi: 10.4300/JGME-D-09-00014.1.
To implement a 360-degree resident evaluation instrument on the postanesthesia care unit (PACU) rotation and to determine the reliability, feasibility, and validity of this tool for assessing residents' professionalism and interpersonal and communication skills.
Thirteen areas of evaluation were selected to assess the professionalism and interpersonal and communication skills of residents during their PACU rotation. Each area was measured on a 9-point Likert scale (1, unsatisfactory performance, to 9, outstanding performance). Rating forms were distributed to raters after the completion of the PACU rotation. Raters included PACU nurses, secretarial staff, nurse aides, and medical technicians. Residents were aware of the 360-degree assessment and participated voluntarily. The multiple raters' evaluations were then compared with those of the traditional faculty. Intraclass correlation coefficients were calculated to measure the reliability of ratings within each category of raters by the Pearson correlation coefficient.
Four hundred twenty-nine rating forms were returned during the study period. Fifteen residents were evaluated. The response rate was 88%. Residents were ranked highest on availability and lowest on management skill. The average rating across all areas was high (8.23). The average mean rating across all items from PACU nurses was higher (8.34) than from secretarial staff (7.99, P > .08). The highest ranked resident ranked high with all raters and the lowest ranked was low with most raters. The intraclass coefficients of correlations were 0.8719, 0.7860, 0.8268, and 0.8575.
This type of resident assessment tool may be useful for PACU rotations. It appears to correlate with traditional faculty ratings, is feasible to use, and provides formative feedback to residents regarding their professionalism and interpersonal and communication skills.
在麻醉后护理单元(PACU)轮转中实施一项360度住院医师评估工具,并确定该工具在评估住院医师专业素养、人际沟通技能方面的可靠性、可行性和有效性。
选择13个评估领域,以评估住院医师在PACU轮转期间的专业素养、人际沟通技能。每个领域采用9点李克特量表进行测量(1表示表现不满意,9表示表现出色)。在PACU轮转结束后,将评分表分发给评估者。评估者包括PACU护士、秘书人员、护理助理和医学技术人员。住院医师知晓360度评估并自愿参与。然后将多位评估者的评估结果与传统教员的评估结果进行比较。通过Pearson相关系数计算组内相关系数,以衡量各评估者类别内评分的可靠性。
在研究期间共收回429份评分表。对15名住院医师进行了评估。回复率为88%。住院医师在可及性方面得分最高,在管理技能方面得分最低。所有领域的平均评分较高(8.23)。PACU护士对所有项目的平均评分(8.34)高于秘书人员(7.99,P>.08)。排名最高的住院医师在所有评估者中得分都很高,排名最低的在大多数评估者中得分都很低。组内相关系数分别为0.8719、0.7860、0.8268和0.8575。
这种住院医师评估工具可能对PACU轮转有用。它似乎与传统教员的评分相关,使用可行,并能为住院医师提供关于其专业素养、人际沟通技能的形成性反馈。