Zhang Sijun, Colvin Kimberly
Institute of Educational Sciences, Hunan University, Changsha, China.
School of Education, University at Albany, Albany, NY, United States.
Front Psychol. 2024 Nov 1;15:1482016. doi: 10.3389/fpsyg.2024.1482016. eCollection 2024.
Single-item assessments have recently become popular in various fields, and researchers have developed methods for estimating the reliability of single-item assessments, some based on factor analysis and correction for attenuation, and others using the double monotonicity model, Guttman's λ, or the latent class model. However, no empirical study has investigated which method best estimates the reliability of single-item assessments. This study investigated this question using a simulation study. To represent assessments as they are found in practice, the simulation study varied several aspects: the item discrimination parameter, the test length of the multi-item assessment of the same construct, the sample size, and the correlation between the single-item assessment and the multi-item assessment of the same construct. The results suggest that by using the method based on the double monotonicity model and the method based on correction for attenuation simultaneously, researchers can obtain the most precise estimate of the range of reliability of a single-item assessment in 94.44% of cases. The test length of a multi-item assessment of the same construct, the item discrimination parameter, the sample size, and the correlation between the single-item assessment and the multi-item assessment of the same construct did not influence the choice of method choice.
单项评估最近在各个领域变得流行起来，研究人员已经开发出了估算单项评估信度的方法，一些基于因素分析和衰减校正，另一些则使用双单调性模型、古特曼λ系数或潜在类别模型。然而，尚无实证研究调查哪种方法能最佳估算单项评估的信度。本研究通过模拟研究对这个问题进行了调查。为了模拟实际中的评估情况，模拟研究在几个方面进行了变化：项目区分参数、同一构念的多项评估的测验长度、样本量以及单项评估与同一构念的多项评估之间的相关性。结果表明，通过同时使用基于双单调性模型的方法和基于衰减校正的方法，研究人员在94.44%的情况下能够获得对单项评估信度范围的最精确估计。同一构念的多项评估的测验长度、项目区分参数、样本量以及单项评估与同一构念的多项评估之间的相关性并不影响方法的选择。
