School of Continuing Education, China Medical University, Shenyang, China.
J Surg Educ. 2013 Sep-Oct;70(5):628-35. doi: 10.1016/j.jsurg.2013.04.004. Epub 2013 May 15.
The aim of the study was to test the psychometric characteristics of the 360° evaluation instrument for assessing residents' competency in professionalism, interpersonal and communication skills, and develop a feasible, valid, and reliable multisource feedback (MSF) program for surgery residents to address this gap.
We carried out an MSF assessment of 149 surgery residents at 19 hospitals all over China. MSF assessment includes 6 surveys with 21, 21, 21, 26, 14, and 15 items and these surveys were developed to assess surgery residents by attending doctor, resident self, peer, nurse, patient, and office staff, respectively, using a 5-point agreement scale with an "unable-to-evaluate" category. Reliability was assessed by Cronbach alpha. Exploratory factor analysis was used to assess validity and determine which items grouped together into scales.
A total of 2384 questionnaires were analyzed in this study. The internal consistency reliability of the instruments was a Cronbach alpha of 0.932, 0.936, 0.914, 0.916, 0.939, and 0.903 for attending doctor, resident self, nurse, patient, resident peer, and office staff surveys, respectively. On the attending, resident self, resident peer, nurse, office staff, and patient surveys, the factor analysis identified 2 factors of professionalism and interpersonal and communication skills accounting for 75.62%, 74.81%, 72.65%, 73.38%, 76.11%, and 63.89% of the variance, respectively. Some items, such as Demonstrates respect for my "Sexual Orientation," "Religion," and "Disability," in different surveys had high unable-to-evaluate rates (more than 10%).
The data suggest that these instruments developed to assess surgery residents are feasible to administer and provide valid and reliable evidence. Some items in survey need to be adjusted keeping in mind the Chinese culture.
本研究旨在测试评估住院医师专业精神、人际沟通技能等能力的 360°评估工具的心理测量学特征，并为外科住院医师开发一个可行、有效和可靠的多源反馈（MSF）方案，以解决这一差距。
我们对中国 19 家医院的 149 名外科住院医师进行了 MSF 评估。MSF 评估包括 6 项调查，每项调查有 21、21、21、26、14 和 15 个条目，这些调查旨在通过主治医生、住院医师自评、同行、护士、患者和办公室工作人员来评估外科住院医师，使用 5 分制同意量表和“无法评估”类别。可靠性通过 Cronbach α 进行评估。探索性因素分析用于评估有效性，并确定哪些条目组合成量表。
本研究共分析了 2384 份问卷。工具的内部一致性信度为：主治医生、住院医师自评、护士、患者、住院医师同行和办公室工作人员调查的 Cronbach α 分别为 0.932、0.936、0.914、0.916、0.939 和 0.903。在主治医生、住院医师自评、住院医师同行、护士、办公室工作人员和患者调查中，因素分析确定了专业精神和人际沟通技能两个因素，分别占 75.62%、74.81%、72.65%、73.38%、76.11%和 63.89%的方差。在不同的调查中，有些条目，如“表现出对我的‘性取向’、‘宗教’和‘残疾’的尊重”，无法评估的比例较高（超过 10%）。
这些数据表明，开发这些评估外科住院医师的工具具有可行性，并提供了有效和可靠的证据。在考虑中国文化的情况下，需要对调查中的一些条目进行调整。
