Department of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA.
Department of Psychiatry, Brain Behavior Laboratory, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA; Lifespan Brain Institute (LiBI), Children's Hospital of Philadelphia and Penn Medicine, Philadelphia, PA 19104, USA.
Brain Cogn. 2024 Feb;174:106117. doi: 10.1016/j.bandc.2023.106117. Epub 2023 Dec 20.
The Penn Computerized Neurocognitive Battery is an efficient tool for assessing brain-behavior domains, and its efficiency was augmented via computerized adaptive testing (CAT). This battery requires validation in a separate sample to establish psychometric properties.
In a mixed community/clinical sample of N = 307 18-to-35-year-olds, we tested the relationships of the CAT tests with the full-form tests. We compared discriminability among recruitment groups (psychosis, mood, control) and examined how their scores relate to demographics. CAT-Full relationships were evaluated based on a minimum inter-test correlation of 0.70 or an inter-test correlation within at least 0.10 of the full-form correlation with a previous administration of the full battery. Differences in criterion relationships were tested via mixed models.
Most tests (15/17) met the minimum criteria for replacing the full-form with the updated CAT version (mean r = 0.67; range = 0.53-0.80) when compared to relationships of the full-forms with previous administrations of the full-forms (mean r = 0.68; range = 0.50-0.85). Most (16/17) CAT-based relationships with diagnostics and other validity criteria were indistinguishable (interaction p > 0.05) from their full-form counterparts.
The updated CNB shows psychometric properties acceptable for research. The full-forms of some tests should be retained due to insufficient time savings to justify the loss in precision.
宾夕法尼亚计算机化神经认知电池是一种评估大脑行为领域的有效工具，通过计算机自适应测试（CAT）提高了其效率。该电池需要在单独的样本中进行验证，以建立心理测量特性。
在一个由 N=307 名 18 至 35 岁的混合社区/临床样本中，我们测试了 CAT 测试与全式测试之间的关系。我们比较了招募组（精神病、情绪、对照组）之间的可区分性，并检查了他们的分数与人口统计学的关系。CAT-全式关系是基于最小测试间相关性为 0.70 或测试间相关性至少为全式相关性的 0.10 与之前全式电池的相关性来评估的。通过混合模型测试标准关系的差异。
与全式测试与之前全式测试的关系（平均 r=0.68；范围 0.50-0.85）相比，当与更新后的 CAT 版本相比时，大多数测试（15/17）满足了用更新后的 CAT 版本替代全式测试的最低标准（平均 r=0.67；范围 0.53-0.80）。与诊断和其他有效性标准相关的大多数（16/17）CAT 关系与全式测试关系（交互 p>0.05）无法区分。
更新后的 CNB 显示出可接受的研究心理测量特性。由于时间节省不足以证明精度损失，一些测试的全式仍应保留。
