Lichtenstein Jonathan D, Erdodi Laszlo A, Rai Jaspreet K, Mazur-Mosiewicz Anya, Flaro Lloyd
a Department of Psychiatry, Neuropsychology Services , Geisel School of Medicine at Dartmouth , Lebanon , NH , USA.
b Department of Psychology, Neuropsychology Track , University of Windsor , ON , USA.
Child Neuropsychol. 2018 Feb;24(2):247-260. doi: 10.1080/09297049.2016.1259402. Epub 2016 Nov 28.
Past studies have examined the ability of the Wisconsin Card Sorting Test (WCST) to discriminate valid from invalid performance in adults using both individual embedded validity indicators (EVIs) and multivariate approaches. This study is designed to investigate whether the two most stable of these indicators-failures to maintain set (FMS) and the logistical regression equation S-B-can be extended to pediatric populations. The classification accuracy for FMS and S-B was examined in a mixed clinical sample of 226 children aged 7 to 17 years (64.6% male, MAge = 13.6 years) against a combination of established performance validity tests (PVTs). The results show that at adult cutoffs, FMS and S-B produce an unacceptably high failure rate (33.2% and 45.6%) and low specificity (.55-.72), but an upward adjustment in cutoffs significantly improves classification accuracy. Defining Pass as <2 and Fail as ≥4 on FMS results in consistently good specificity (.89-.92) but low and variable sensitivity (.00-.33). Similarly, cutting the S-B distribution at 3.68 produces good specificity (.90-.92) but variable sensitivity (.06-.38). Passing or failing FMS or S-B is unrelated to age, gender and IQ. The data from this study suggest that in a pediatric sample, adjusted cutoffs on the FMS and S-B ensure good specificity, but with low or variable sensitivity. Thus, they should not be used in isolation to determine the credibility of a response set. At the same time, they can make valuable contributions to pediatric neuropsychology by providing empirically-supported, expedient and cost-effective indicators to enhance performance validity assessment.
过去的研究使用个体嵌入式效度指标(EVI)和多变量方法,考察了威斯康星卡片分类测验(WCST)区分成人有效与无效表现的能力。本研究旨在调查这些指标中最稳定的两个指标——无法维持定势(FMS)和逻辑回归方程S-B——是否可以扩展到儿科人群。在226名7至17岁儿童(64.6%为男性,平均年龄=13.6岁)的混合临床样本中,针对一系列既定的效标效度测验(PVT),检验了FMS和S-B的分类准确性。结果表明,按照成人的临界值,FMS和S-B产生了高得不可接受的失败率(分别为33.2%和45.6%)以及低特异性(0.55 - 0.72),但临界值的向上调整显著提高了分类准确性。将FMS上的通过定义为<2,失败定义为≥4,会产生始终良好的特异性(0.89 - 0.92),但敏感性较低且变化不定(0.00 - 0.33)。同样,将S-B分布在3.68处截断会产生良好的特异性(0.90 - 0.92),但敏感性变化不定(0.06 - 0.38)。FMS或S-B的通过或失败与年龄、性别和智商无关。本研究的数据表明,在儿科样本中,FMS和S-B的调整临界值可确保良好的特异性,但敏感性较低或变化不定。因此,它们不应单独用于确定反应定势的可信度。与此同时,它们可以通过提供经验支持的、便捷且具有成本效益的指标来加强效标效度评估,从而为儿科神经心理学做出有价值的贡献。