临床评估中检查者严格程度与人格因素之间可能关系的探索：一项试点研究。

Exploration of a possible relationship between examiner stringency and personality factors in clinical assessments: a pilot study.

作者信息

Finn Yvonne, Cantillon Peter, Flaherty Gerard

出版信息

BMC Med Educ. 2014 Dec 31;14:1052. doi: 10.1186/s12909-014-0280-3.

DOI:10.1186/s12909-014-0280-3

PMID:25551778

原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC4295411/

Abstract

BACKGROUND

The reliability of clinical examinations is known to vary considerably. Inter-examiner variability is a key source of this variability. Some examiners consistently give lower scores to some candidates compared to other examiners and vice versa - the 'hawk- dove' effect. Stable examiner characteristics, such as personality factors, may influence examiner stringency. We investigated whether examiner stringency is related to personality factors.

METHODS

We recruited 12 examiners to view and score a video-recorded five station OSCE of six Year 1 undergraduate medical students at our institution. In addition examiners completed a validated personality questionnaire. Examiners' markings were tested for statistically significant differences using non-parametric one way analysis of variance. The relationship between examiners' markings and examiner personality factors was investigated using Spearman correlation coefficient.

RESULTS

At each station there was a statistically significant difference between examiners markings, confirming the presence of inter-examiner variability. Correlation analysis showed no association between stringency and any of the five major personality factors. When we omitted an outlier examiner we found a statistically significant negative correlation between examiner stringency and openness to experience with a correlation coefficients (rho) of - 0.66 (p = 0.03). Conversely there was a moderate positive correlation between examiner stringency and neuroticism with a correlation coefficient (rho) of 0.73 (p = 0.01).

CONCLUSIONS

In this study we did not find any relationship between examiner stringency and examiner personality factors. However, following the elimination of an outlier examiner from the analysis, we found a significant relationship between examiner stringency and two of the big five personality factors (neuroticism and openness to experience). The significance of this outlier is not known. As this was a small pilot study we recommend further studies in this field to investigate if there is a relationship between examiner stringency in clinical assessments and personality factors.

摘要

背景

临床检查的可靠性差异很大。检查者之间的变异性是这种差异的一个关键来源。与其他检查者相比，一些检查者总是给某些考生较低的分数，反之亦然——即“鹰鸽”效应。稳定的检查者特征，如人格因素，可能会影响检查者的严格程度。我们调查了检查者的严格程度是否与人格因素有关。

方法

我们招募了12名检查者，让他们观看并对我校6名本科一年级医学生的一段包含五个站点的视频模拟临床考试（OSCE）进行评分。此外，检查者还完成了一份经过验证的人格问卷。使用非参数单因素方差分析对检查者的评分进行统计学显著性差异检验。使用斯皮尔曼相关系数研究检查者评分与检查者人格因素之间的关系。

结果

在每个站点，检查者的评分之间存在统计学显著性差异，证实了检查者之间变异性的存在。相关性分析显示，严格程度与五个主要人格因素中的任何一个均无关联。当我们剔除一名异常值检查者后，我们发现检查者的严格程度与经验开放性之间存在统计学显著性负相关，相关系数（rho）为-0.66（p = 0.03）。相反，检查者的严格程度与神经质之间存在中度正相关，相关系数（rho）为0.73（p = 0.01）。

结论

在本研究中，我们未发现检查者的严格程度与检查者人格因素之间存在任何关系。然而，在从分析中剔除一名异常值检查者后，我们发现检查者的严格程度与大五人格因素中的两个（神经质和经验开放性）之间存在显著关系。该异常值的意义尚不清楚。由于这是一项小型试点研究，我们建议在该领域进行进一步研究，以调查临床评估中检查者的严格程度与人格因素之间是否存在关系。