Department of Psychology, University of Edinburgh, F17, 7 George Square, Edinburgh, EH8 9JZ, UK.
Centre for Cognitive Ageing and Cognitive Epidemiology, University of Edinburgh, Edinburgh, UK.
Alzheimers Res Ther. 2021 Jan 15;13(1):26. doi: 10.1186/s13195-021-00768-w.
Whether in the context of monitoring disease progression or in assessing the effects of interventions, a major challenge in dementia research is determining when an individual has undergone meaningful change in symptoms and other relevant outcomes such as cognitive test performance. The challenge lies in differentiating genuine improvement or deterioration from change in scores due to random and systematic error. BODY: In this review, we discuss the advantages and limitations of available methods for assessing individual-level change in the context of key challenges, including imperfect and differential reliability of scores, and practice effects. We discuss indices of reliable change and the use of composite and item response theory (IRT) scores.
We conclude that IRT-based approaches hold particular promise because they have the flexibility to accommodate solutions to a wide range of issues that influence the accuracy of judgements of meaningful change. We close by discussing the practical implications of adopting IRT-based approaches.
无论是在监测疾病进展的情况下,还是在评估干预措施的效果时,痴呆症研究的一个主要挑战是确定个体在症状和其他相关结果(如认知测试表现)方面是否发生了有意义的变化。挑战在于区分真正的改善或恶化与由于随机和系统误差导致的分数变化。
在这篇综述中,我们讨论了在关键挑战背景下评估个体水平变化的可用方法的优缺点,包括分数的不完善和差异可靠性,以及练习效应。我们讨论了可靠变化的指标以及综合和项目反应理论(IRT)分数的使用。
我们得出的结论是,基于 IRT 的方法具有特殊的优势,因为它们具有灵活性,可以解决影响有意义变化判断准确性的一系列问题。最后,我们讨论了采用基于 IRT 的方法的实际意义。