Suppr超能文献

利用计算机自适应测试提高失语症面命名评估的效率。

Enhancing the Efficiency of Confrontation Naming Assessment for Aphasia Using Computer Adaptive Testing.

机构信息

Department of Hearing & Speech Science, Portland State University, OR.

Geriatric Research, Education and Clinical Center, VA Pittsburgh Healthcare System, PA.

出版信息

J Speech Lang Hear Res. 2019 Jun 19;62(6):1724-1738. doi: 10.1044/2018_JSLHR-L-18-0344. Epub 2019 Jun 3.

Abstract

Purpose In this study, we investigated the agreement between the 175-item Philadelphia Naming Test (PNT; Roach, Schwartz, Martin, Grewal, & Brecher, 1996 ) and a 30-item computer adaptive PNT (PNT-CAT; Fergadiotis, Kellough, & Hula, 2015 ; Hula, Kellough, & Fergadiotis, 2015 ) created using item response theory (IRT) methods. Method The full PNT and the PNT-CAT were administered to 47 participants with aphasia in counterbalanced order. Latent trait-naming ability estimates for the 2 PNT versions were analyzed in a Bayesian framework, and the agreement between them was evaluated using correlation and measures of constant, variable, and total error. We also evaluated the extent to which individual pairwise differences were credibly greater than 0 and whether the IRT measurement model provided an adequate indication of the precision of individual score estimates. Results The agreement between the PNT and the PNT-CAT was strong, as indicated by high correlation ( r = .95, 95% CI [.92, .97]), negligible bias, and low variable and total error. The number of statistically robust pairwise score differences did not credibly exceed the Type I error rate, and the precision of individual score estimates was reasonably well predicted by the IRT model. Discussion The strong agreement between the full PNT and the PNT-CAT suggests that the latter is a suitable measurement of anomia in group studies. The relatively robust estimates of score precision also suggest that the PNT-CAT can be useful for the clinical assessment of anomia in individual cases. Finally, the IRT methods used to construct the PNT-CAT provide a framework for additional development to further reduce measurement error. Supplemental Material https://doi.org/10.23641/asha.8202176.

摘要

目的 在这项研究中,我们调查了 175 项费城命名测试(PNT;Roach、Schwartz、Martin、Grewal 和 Brecher,1996)与使用项目反应理论(IRT)方法创建的 30 项计算机自适应 PNT(PNT-CAT;Fergadiotis、Kellough 和 Hula,2015;Hula、Kellough 和 Fergadiotis,2015)之间的一致性。

方法 将完整的 PNT 和 PNT-CAT 以平衡的顺序施测给 47 名失语症患者。使用贝叶斯框架分析这 2 种 PNT 版本的潜在特质命名能力估计值,并通过相关和常误、变误和总误的测量来评估它们之间的一致性。我们还评估了个别配对差异是否可信地大于 0,以及 IRT 测量模型是否能很好地指示个体分数估计值的精度。

结果 PNT 与 PNT-CAT 的一致性很强,表现为高相关(r=.95,95%CI [.92,.97])、可忽略的偏差以及低变误和总误。统计上可靠的配对分数差异数量没有可信地超过Ⅰ类错误率,IRT 模型可以合理地预测个体分数估计值的精度。

讨论 完整的 PNT 与 PNT-CAT 之间的强一致性表明,后者是群体研究中构音障碍的合适测量方法。分数精度的相对稳健估计值也表明,PNT-CAT 可用于个体构音障碍的临床评估。最后,用于构建 PNT-CAT 的 IRT 方法为进一步减少测量误差提供了一个框架。

补充材料 https://doi.org/10.23641/asha.8202176.

相似文献

1
Enhancing the Efficiency of Confrontation Naming Assessment for Aphasia Using Computer Adaptive Testing.
J Speech Lang Hear Res. 2019 Jun 19;62(6):1724-1738. doi: 10.1044/2018_JSLHR-L-18-0344. Epub 2019 Jun 3.
2
Empirical Evaluation of Computer-Adaptive Alternate Short Forms for the Assessment of Anomia Severity.
J Speech Lang Hear Res. 2019 Dec 18;63(1):163-172. doi: 10.1044/2019_JSLHR-L-19-0213. Print 2020 Jan 22.
3
Development and Simulation Testing of a Computerized Adaptive Version of the Philadelphia Naming Test.
J Speech Lang Hear Res. 2015 Jun 1;58(3):878-890. doi: 10.1044/2015_JSLHR-L-14-0297.
4
Item Response Theory Modeling of the Philadelphia Naming Test.
J Speech Lang Hear Res. 2015 Jun 1;58(3):865-877. doi: 10.1044/2015_JSLHR-L-14-0249.
5
Predicting confrontation naming item difficulty.
Aphasiology. 2019;33(6):689-709. doi: 10.1080/02687038.2018.1495310. Epub 2018 Jul 23.
6
Short-form Philadelphia naming test: rationale and empirical evaluation.
Am J Speech Lang Pathol. 2012 May;21(2):S140-53. doi: 10.1044/1058-0360(2012/11-0089). Epub 2012 Jan 31.
7
Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test.
J Speech Lang Hear Res. 2023 Apr 12;66(4):1351-1364. doi: 10.1044/2023_JSLHR-22-00439. Epub 2023 Apr 4.
8
Item Response Theory Modeling of the Verb Naming Test.
J Speech Lang Hear Res. 2023 May 9;66(5):1718-1739. doi: 10.1044/2023_JSLHR-22-00458. Epub 2023 Mar 31.
9
Computer Adaptive Testing for the Assessment of Anomia Severity.
Semin Speech Lang. 2021 Jun;42(3):180-191. doi: 10.1055/s-0041-1727252. Epub 2021 Jul 14.
10
A cognitive psychometric model for assessment of picture naming abilities in aphasia.
Psychol Assess. 2018 Jun;30(6):809-826. doi: 10.1037/pas0000529. Epub 2018 Mar 19.

引用本文的文献

2
Response Latencies During Confrontation Picture Naming in Aphasia: Are Proxy Measurements Sufficient?
J Speech Lang Hear Res. 2024 May 7;67(5):1548-1557. doi: 10.1044/2024_JSLHR-23-00452. Epub 2024 Apr 1.
3
Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test.
J Speech Lang Hear Res. 2023 Apr 12;66(4):1351-1364. doi: 10.1044/2023_JSLHR-22-00439. Epub 2023 Apr 4.
4
Item Response Theory Modeling of the Verb Naming Test.
J Speech Lang Hear Res. 2023 May 9;66(5):1718-1739. doi: 10.1044/2023_JSLHR-22-00458. Epub 2023 Mar 31.
5
ParAlg: A Paraphasia Algorithm for Multinomial Classification of Picture Naming Errors.
J Speech Lang Hear Res. 2023 Mar 7;66(3):966-986. doi: 10.1044/2022_JSLHR-22-00255. Epub 2023 Feb 15.
6
Rational Adaptation in Using Conceptual Versus Lexical Information in Adults With Aphasia.
Front Psychol. 2021 Jan 28;12:589930. doi: 10.3389/fpsyg.2021.589930. eCollection 2021.
7
Empirical Evaluation of Computer-Adaptive Alternate Short Forms for the Assessment of Anomia Severity.
J Speech Lang Hear Res. 2019 Dec 18;63(1):163-172. doi: 10.1044/2019_JSLHR-L-19-0213. Print 2020 Jan 22.

本文引用的文献

1
Stan: A Probabilistic Programming Language.
J Stat Softw. 2017;76. doi: 10.18637/jss.v076.i01. Epub 2017 Jan 11.
2
Predicting confrontation naming item difficulty.
Aphasiology. 2019;33(6):689-709. doi: 10.1080/02687038.2018.1495310. Epub 2018 Jul 23.
3
A cognitive psychometric model for assessment of picture naming abilities in aphasia.
Psychol Assess. 2018 Jun;30(6):809-826. doi: 10.1037/pas0000529. Epub 2018 Mar 19.
4
Development and Simulation Testing of a Computerized Adaptive Version of the Philadelphia Naming Test.
J Speech Lang Hear Res. 2015 Jun 1;58(3):878-890. doi: 10.1044/2015_JSLHR-L-14-0297.
5
Item Response Theory Modeling of the Philadelphia Naming Test.
J Speech Lang Hear Res. 2015 Jun 1;58(3):865-877. doi: 10.1044/2015_JSLHR-L-14-0249.
6
Emergence in cognitive science.
Top Cogn Sci. 2010 Oct;2(4):751-70. doi: 10.1111/j.1756-8765.2010.01116.x. Epub 2010 Sep 14.
7
The Apraxia of Speech Rating Scale: a tool for diagnosis and description of apraxia of speech.
J Commun Disord. 2014 Sep-Oct;51:43-50. doi: 10.1016/j.jcomdis.2014.06.008. Epub 2014 Jul 14.
8
Interrater reliability: the kappa statistic.
Biochem Med (Zagreb). 2012;22(3):276-82.
9
Short-form Philadelphia naming test: rationale and empirical evaluation.
Am J Speech Lang Pathol. 2012 May;21(2):S140-53. doi: 10.1044/1058-0360(2012/11-0089). Epub 2012 Jan 31.
10
A large, searchable, web-based database of aphasic performance on picture naming and other tests of cognitive function.
Cogn Neuropsychol. 2010 Sep;27(6):495-504. doi: 10.1080/02643294.2011.574112. Epub 2011 Jun 30.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验