Department of Psychology.
Department of Psychology, University of Northern Iowa.
Psychol Assess. 2014 Sep;26(3):916-24. doi: 10.1037/a0036469. Epub 2014 Apr 21.
Reflecting the common use of the MMPI-2 to provide diagnostic considerations, computer-based test interpretations (CBTIs) also typically offer diagnostic suggestions. However, these diagnostic suggestions can sometimes be shown to vary widely across different CBTI programs even for identical MMPI-2 profiles. The present study evaluated the diagnostic reliability of 6 commercially available CBTIs using a 20-item Q-sort task developed for this study. Four raters each sorted diagnostic classifications based on these 6 CBTI reports for 20 MMPI-2 profiles. Two questions were addressed. First, do users of CBTIs understand the diagnostic information contained within the reports similarly? Overall, diagnostic sorts of the CBTIs showed moderate inter-interpreter diagnostic reliability (mean r = .56), with sorts for the 1/2/3 profile showing the highest inter-interpreter diagnostic reliability (mean r = .67). Second, do different CBTIs programs vary with respect to diagnostic suggestions? It was found that diagnostic sorts of the CBTIs had a mean inter-CBTI diagnostic reliability of r = .56, indicating moderate but not strong agreement across CBTIs in terms of diagnostic suggestions. The strongest inter-CBTI diagnostic agreement was found for sorts of the 1/2/3 profile CBTIs (mean r = .71). Limitations and future directions are discussed.
反映出 MMPI-2 常用于提供诊断考虑因素,基于计算机的测试解释 (CBTI) 通常也提供诊断建议。然而,这些诊断建议有时可能因不同的 CBTI 程序而有很大差异,即使对于相同的 MMPI-2 剖面图也是如此。本研究使用为这项研究开发的 20 项 Q 分类任务,评估了 6 种商业上可用的 CBTI 的诊断可靠性。4 名评估者根据这 6 种 CBTI 报告对 20 种 MMPI-2 剖面图进行了诊断分类。解决了两个问题。首先,CBTI 的使用者是否同样理解报告中包含的诊断信息?总体而言,CBTI 的诊断分类显示出中等的解释间诊断可靠性(平均 r =.56),1/2/3 剖面图的分类显示出最高的解释间诊断可靠性(平均 r =.67)。其次,不同的 CBTI 程序在诊断建议方面是否存在差异?研究发现,CBTI 的诊断分类具有平均的 CBTI 间诊断可靠性 r =.56,表明在诊断建议方面,CBTI 之间存在中等但不强的一致性。1/2/3 剖面图的 CBTI 的分类具有最强的 CBTI 间诊断一致性(平均 r =.71)。讨论了局限性和未来的方向。