Universidad de Valparaíso, Facultad de Medicina, Escuela de Psicología, Av. Brasil 2140, Valparaíso, 2362854 Chile.
Clin Neuropsychol. 2013;27(6):1019-42. doi: 10.1080/13854046.2013.806677. Epub 2013 Jun 14.
In the last decade, different statistical techniques have been introduced to improve assessment of malingering-related poor effort. In this context, we have recently shown preliminary evidence that a Bayesian latent group model may help to optimize classification accuracy using a simulation research design. In the present study, we conducted two analyses. Firstly, we evaluated how accurately this Bayesian approach can distinguish between participants answering in an honest way (honest response group) and participants feigning cognitive impairment (experimental malingering group). Secondly, we tested the accuracy of our model in the differentiation between patients who had real cognitive deficits (cognitively impaired group) and participants who belonged to the experimental malingering group. All Bayesian analyses were conducted using the raw scores of a visual recognition forced-choice task (2AFC), the Test of Memory Malingering (TOMM, Trial 2), and the Word Memory Test (WMT, primary effort subtests). The first analysis showed 100% accuracy for the Bayesian model in distinguishing participants of both groups with all effort measures. The second analysis showed outstanding overall accuracy of the Bayesian model when estimates were obtained from the 2AFC and the TOMM raw scores. Diagnostic accuracy of the Bayesian model diminished when using the WMT total raw scores. Despite, overall diagnostic accuracy can still be considered excellent. The most plausible explanation for this decrement is the low performance in verbal recognition and fluency tasks of some patients of the cognitively impaired group. Additionally, the Bayesian model provides individual estimates, p(zi |D), of examinees' effort levels. In conclusion, both high classification accuracy levels and Bayesian individual estimates of effort may be very useful for clinicians when assessing for effort in medico-legal settings.
在过去的十年中,已经引入了不同的统计技术来提高对与装病相关的不良努力的评估。在这种情况下,我们最近已经初步证明了一种贝叶斯潜在群组模型可能有助于使用模拟研究设计来优化分类准确性。在本研究中,我们进行了两项分析。首先,我们评估了这种贝叶斯方法如何准确地区分以诚实方式回答的参与者(诚实反应组)和假装认知障碍的参与者(实验性装病组)。其次,我们测试了我们的模型在区分真正认知缺陷的患者(认知受损组)和属于实验性装病组的参与者方面的准确性。所有贝叶斯分析均使用视觉识别迫选任务(2AFC)、记忆装病测验(TOMM,第 2 试)和单词记忆测验(WMT,主要努力子测验)的原始分数进行。第一项分析表明,贝叶斯模型在区分两组参与者时,使用所有努力测量值的准确率为 100%。第二项分析表明,当从 2AFC 和 TOMM 原始分数获得估计值时,贝叶斯模型的总体准确率非常出色。当使用 WMT 总原始分数时,贝叶斯模型的诊断准确性会降低。尽管如此,总体诊断准确性仍可被认为是优秀的。造成这种衰减的最合理的解释是认知受损组的一些患者在言语识别和流畅性任务中的表现不佳。此外,贝叶斯模型提供了应试者努力水平的个体估计值 p(zi |D)。总之,在医学法律环境中评估努力时,高分类准确性水平和贝叶斯个体努力估计值都可能对临床医生非常有用。