Suppr超能文献

基于分数的评估决策有多准确和一致?使用线性因子模型的程序。

How Accurate and Consistent Are Score-Based Assessment Decisions? A Procedure Using the Linear Factor Model.

机构信息

The University of North Carolina at Chapel Hill, USA.

Arizona State University, Tempe, USA.

出版信息

Assessment. 2023 Jul;30(5):1640-1650. doi: 10.1177/10731911221113568. Epub 2022 Aug 11.

Abstract

When scales or tests are used to make decisions about individuals (e.g., to identify which adults should be assessed for psychiatric disorders), it is crucial that these decisions be accurate and consistent. However, it is not obvious how to assess accuracy and consistency when the scale was administered only once to a given sample and the true condition based on the latent variable is unknown. This article describes a method based on the linear factor model for evaluating the accuracy and consistency of scale-based decisions using data from a single administration of the scale. We illustrate the procedure and provide R code that investigators can use to apply the method in their own data. Finally, in a simulation study, we evaluate how the method performs when applied to discrete (vs. continuous) items, a practice that is common in published literature. The results suggest that the method is generally robust when applied to discrete items.

摘要

当使用量表或测试来对个体做出决策(例如,确定哪些成年人应接受精神障碍评估)时,这些决策的准确性和一致性至关重要。然而,当量表仅对给定样本进行一次施测,并且基于潜在变量的真实情况未知时,如何评估准确性和一致性并不明显。本文描述了一种基于线性因子模型的方法,用于使用量表单次施测的数据来评估基于量表的决策的准确性和一致性。我们展示了该程序,并提供了 R 代码,研究人员可以在自己的数据中应用该方法。最后,在一项模拟研究中,我们评估了当应用于离散(与连续)项目时,该方法的性能如何,这在已发表的文献中是很常见的做法。结果表明,该方法在应用于离散项目时通常是稳健的。

相似文献

1
How Accurate and Consistent Are Score-Based Assessment Decisions? A Procedure Using the Linear Factor Model.
Assessment. 2023 Jul;30(5):1640-1650. doi: 10.1177/10731911221113568. Epub 2022 Aug 11.
3
Diagnostic test accuracy and cost-effectiveness of tests for codeletion of chromosomal arms 1p and 19q in people with glioma.
Cochrane Database Syst Rev. 2022 Mar 2;3(3):CD013387. doi: 10.1002/14651858.CD013387.pub2.
4
Adapting Safety Plans for Autistic Adults with Involvement from the Autism Community.
Autism Adulthood. 2025 May 28;7(3):293-302. doi: 10.1089/aut.2023.0124. eCollection 2025 Jun.
6
The Lived Experience of Autistic Adults in Employment: A Systematic Search and Synthesis.
Autism Adulthood. 2024 Dec 2;6(4):495-509. doi: 10.1089/aut.2022.0114. eCollection 2024 Dec.
10

引用本文的文献

1
Estimating classification consistency of machine learning models for screening measures.
Psychol Assess. 2024 Jun-Jul;36(6-7):395-406. doi: 10.1037/pas0001313.

本文引用的文献

1
Estimating classification consistency of screening measures and quantifying the impact of measurement bias.
Psychol Assess. 2021 Jul;33(7):596-609. doi: 10.1037/pas0000938. Epub 2021 May 17.
2
When Does Differential Item Functioning Matter for Screening? A Method for Empirical Evaluation.
Assessment. 2021 Mar;28(2):446-456. doi: 10.1177/1073191120913618. Epub 2020 Apr 4.
3
A diagnostic procedure to detect departures from local independence in item response theory models.
Psychol Methods. 2018 Mar;23(1):138-149. doi: 10.1037/met0000121. Epub 2017 Apr 3.
8
Psychological distress across the lifespan: examining age-related item bias in the Kessler 6 Psychological Distress Scale.
Int Psychogeriatr. 2012 Feb;24(2):231-42. doi: 10.1017/S1041610211001852. Epub 2011 Sep 21.
10
Item response theory and clinical measurement.
Annu Rev Clin Psychol. 2009;5:27-48. doi: 10.1146/annurev.clinpsy.032408.153553.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验