Department of Psychology, University of Windsor.
Neuropsychology Program, Palo Alto University.
Psychol Assess. 2018 Aug;30(8):1082-1095. doi: 10.1037/pas0000561. Epub 2018 Jun 28.
This study was designed to examine the potential of the Delis-Kaplan Executive System (D-KEFS) version of the Trail Making Test (TMT) as a performance validity test (PVT). Data were collected from a mixed clinical sample of 157 consecutively referred outpatients (49% male, MAge = 47.1, MEducation = 13.6) undergoing neuropsychological assessment at an academic medical center in the northeastern United States. Sensitivity and specificity of the D-KEFS Trails to psychometrically defined invalid responding was calculated across various cutoffs and criterion PVTs. The D-KEFS Trails produced classification accuracy comparable to the original version of the TMT, hovering around the "Larrabee limit" (.50 sensitivity at .90 specificity). Different cutoffs (age-corrected scaled score ≤5 on Trails 1-3, ≤4 on Trails 4 and ≤8 on Trails 5) were needed to achieve the same classification accuracy across the five trials. Combining multiple cutoffs improved the signal detection performance. The study provides preliminary evidence of the utility of D-KEFS Trails as a PVT. Embedded PVTs are valuable, because they make a multivariate approach to validity assessment feasible. Combining validity indicators is superior to relying on single cutoffs. (PsycINFO Database Record
本研究旨在考察 Delis-Kaplan 执行系统(D-KEFS)版本的连线测验(TMT)作为一种测试表现效度(PVT)的可能性。数据来自于美国东北部一所学术医学中心的 157 名连续转诊门诊患者的混合临床样本(49%为男性,MAge=47.1,MEducation=13.6),他们正在接受神经心理评估。在各种截断值和标准 PVT 下,计算了 D-KEFS 轨迹对心理测量定义的无效反应的敏感性和特异性。D-KEFS 轨迹产生的分类准确性与 TMT 的原始版本相当,徘徊在“Larrabee 限制”(敏感性为 0.50,特异性为 0.90)附近。为了在五个试验中实现相同的分类准确性,需要使用不同的截断值(Trails 1-3 的年龄校正量表得分≤5,Trails 4 的得分≤4,Trails 5 的得分≤8)。结合多个截断值可以提高信号检测性能。该研究提供了 D-KEFS 轨迹作为 PVT 的初步证据。嵌入式 PVT 很有价值,因为它们使得对有效性评估的多元方法成为可能。结合有效性指标优于依赖单一的截断值。