Pragmatic Clinical Trials Unit, Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, UK.
Department of Primary Care and Public Health, Brighton and Sussex Medical School, University of Brighton, Brighton, UK.
Int J Methods Psychiatr Res. 2018 Dec;27(4):e1722. doi: 10.1002/mpr.1722. Epub 2018 Jun 6.
Little attention has been given to the common assessment problem that clinicians assess outcomes of several patients and may rate them in comparison to one another, whereas patients assess only their own outcomes without any comparison. We explored empirically whether this would lead to a greater variability of clinician ratings as compared to patient ratings.
Data from two independent samples in which clinicians and patients, using consistent instruments, rated their therapeutic relationships. We present descriptive statistics of variability and intracluster correlation coefficients.
The Helping Alliance Scale was completed at baseline and follow-up by 20 clinicians and 103 patients in an observational study and by 88 clinicians and 431 patients in a trial. Patients tended to rate their relationship 5-10% more highly than their clinicians, but with 50-100% more variability. Intraclinician Helping Alliance Scale ratings were more correlated than those by patients (intracluster correlation coefficients 0.3-0.7 vs. 0.0-0.2).
Contrary to our assumption, clinicians' ratings of therapeutic relationships were in both samples less variable than those of their patients. When clinicians rate outcomes of several patients, a cluster effect of ratings may have to be considered in the design and analysis.
很少有人关注临床医生评估多个患者的结果并可能相互比较评分的常见评估问题,而患者则不进行任何比较仅评估自己的结果。我们通过实证研究来探索这种情况是否会导致临床医生的评分比患者的评分更具变异性。
我们使用了两个独立的样本,其中临床医生和患者使用一致的工具评估他们的治疗关系。我们展示了变异性的描述性统计和组内相关系数。
在一项观察性研究中,有 20 名临床医生和 103 名患者在基线和随访时完成了《帮助联盟量表》,而在一项试验中,有 88 名临床医生和 431 名患者完成了该量表。患者对他们关系的评分往往比他们的临床医生高 5-10%,但变异性高 50-100%。临床医生的《帮助联盟量表》评分比患者的评分更相关(组内相关系数 0.3-0.7 与 0.0-0.2)。
与我们的假设相反,在两个样本中,临床医生对治疗关系的评分的变异性都小于患者的评分。当临床医生评估多个患者的结果时,在设计和分析中可能需要考虑评分的聚类效应。