Department of Surgery, Faculty of Medicine, Bahrain Defense Force Hospital, Riffa, Bahrain.
Acad Med. 2013 Mar;88(3):413-20. doi: 10.1097/ACM.0b013e318280a953.
To conduct a meta-analysis of published studies to determine the construct and criterion validity of the mini-clinical evaluation exercise (mini-CEX) to measure clinical performance.
The authors included all peer-reviewed studies published from 1995 to 2012 that reported the relationship between participants' performance on the mini-CEX and on other standardized academic and clinical performance measures. Moderator variables and performance and standardized exam measures were extracted and reviewed independently using a standardized coding protocol.
Performance measures from 11 studies were identified. A random-effects model of weighted mean effect size differences (d) resulted in: (1) construct validity coefficients for the mini-CEX on the trainees' performance across different residency year levels ranging from d=0.25 (95% confidence intervals [CI]: 0.04-0.46) to d=0.50 (95% CI: 0.31-0.70), and (2) concurrent validity coefficients for the mini-CEX based on personnel ratings ranging from d=0.23 (95% CI: 0.04-0.50) to d=0.50 (95% CI: 0.34-0.65). Also, a random-effects model of weighted correlation effect size differences (r) resulted in predictive validity coefficients for the mini-CEX on trainees' performance across different standardized measures ranging from r=0.26 (95% CI: 0.16-0.35) to r=0.85 (95% CI: 0.47-0.96).
The construct and criterion validity of the mini-CEX was supported by small to large effect size differences based on measures between trainees' achievement and clinical skills performance, indicating that it is an important instrument for the direct observation of trainees' clinical performance.
对已发表的研究进行荟萃分析,以确定迷你临床演练评估(mini-CEX)测量临床表现的结构效度和效标效度。
作者纳入了所有 1995 年至 2012 年发表的同行评审研究,这些研究报告了参与者在 mini-CEX 上的表现与其他标准化学术和临床表现测量之间的关系。使用标准化编码方案独立提取和审查了调节变量以及表现和标准化考试测量。
确定了 11 项研究的表现测量。加权平均效应大小差异(d)的随机效应模型得出:(1)在不同住院医师年级水平上,mini-CEX 对学员表现的构念效度系数范围为 d=0.25(95%置信区间 [CI]:0.04-0.46)至 d=0.50(95% CI:0.31-0.70);(2)基于人员评分的 mini-CEX 的同时效度系数范围为 d=0.23(95% CI:0.04-0.50)至 d=0.50(95% CI:0.34-0.65)。此外,加权相关效应大小差异(r)的随机效应模型得出,在不同的标准化测量中,mini-CEX 对学员表现的预测效度系数范围为 r=0.26(95% CI:0.16-0.35)至 r=0.85(95% CI:0.47-0.96)。
基于学员成就与临床技能表现之间的测量,mini-CEX 的结构效度和效标效度得到了小到中等效应大小差异的支持,表明它是直接观察学员临床表现的重要工具。