Department of Hearing & Speech Science, Portland State University, OR.
Geriatric Research, Education and Clinical Center, VA Pittsburgh Healthcare System, PA.
J Speech Lang Hear Res. 2019 Jun 19;62(6):1724-1738. doi: 10.1044/2018_JSLHR-L-18-0344. Epub 2019 Jun 3.
Purpose In this study, we investigated the agreement between the 175-item Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996 ) and a 30-item computer adaptive PNT (PNT-CAT; Fergadiotis, Kellough, & Hula, 2015 ; Hula, Kellough, & Fergadiotis, 2015 ) created using item response theory (IRT) methods. Method The full PNT and the PNT-CAT were administered to 47 participants with aphasia in counterbalanced order. Latent trait-naming ability estimates for the 2 PNT versions were analyzed in a Bayesian framework, and the agreement between them was evaluated using correlation and measures of constant, variable, and total error. We also evaluated the extent to which individual pairwise differences were credibly greater than 0 and whether the IRT measurement model provided an adequate indication of the precision of individual score estimates. Results The agreement between the PNT and the PNT-CAT was strong, as indicated by high correlation ( r = .95, 95% CI [.92, .97]), negligible bias, and low variable and total error. The number of statistically robust pairwise score differences did not credibly exceed the Type I error rate, and the precision of individual score estimates was reasonably well predicted by the IRT model. Discussion The strong agreement between the full PNT and the PNT-CAT suggests that the latter is a suitable measurement of anomia in group studies. The relatively robust estimates of score precision also suggest that the PNT-CAT can be useful for the clinical assessment of anomia in individual cases. Finally, the IRT methods used to construct the PNT-CAT provide a framework for additional development to further reduce measurement error. Supplemental Material https://doi.org/10.23641/asha.8202176.
目的 在这项研究中,我们调查了 175 项费城命名测试(PNT;Roach、Schwartz、Martin、Grewal 和 Brecher,1996)与使用项目反应理论(IRT)方法创建的 30 项计算机自适应 PNT(PNT-CAT;Fergadiotis、Kellough 和 Hula,2015;Hula、Kellough 和 Fergadiotis,2015)之间的一致性。
方法 将完整的 PNT 和 PNT-CAT 以平衡的顺序施测给 47 名失语症患者。使用贝叶斯框架分析这 2 种 PNT 版本的潜在特质命名能力估计值,并通过相关和常误、变误和总误的测量来评估它们之间的一致性。我们还评估了个别配对差异是否可信地大于 0,以及 IRT 测量模型是否能很好地指示个体分数估计值的精度。
结果 PNT 与 PNT-CAT 的一致性很强,表现为高相关(r=.95,95%CI [.92,.97])、可忽略的偏差以及低变误和总误。统计上可靠的配对分数差异数量没有可信地超过Ⅰ类错误率,IRT 模型可以合理地预测个体分数估计值的精度。
讨论 完整的 PNT 与 PNT-CAT 之间的强一致性表明,后者是群体研究中构音障碍的合适测量方法。分数精度的相对稳健估计值也表明,PNT-CAT 可用于个体构音障碍的临床评估。最后,用于构建 PNT-CAT 的 IRT 方法为进一步减少测量误差提供了一个框架。