Vermeent Stefan, Spaltman Mandy, van Elswijk Gijs, Miller Justin B, Schmand Ben
Digital Cognitive Diagnostics, Philips Healthcare, Eindhoven, The Netherlands.
Cleveland Clinic Lou Ruvo Center for Brain Health, Las Vegas, NV.
Clin Neuropsychol. 2022 Nov;36(8):2278-2299. doi: 10.1080/13854046.2021.1974565. Epub 2021 Sep 16.
To collect evidence of validity for a selection of digital tests on the Philips IntelliSpace Cognition (ISC) platform. A total of 200 healthy participants (age 50-80) completed both the ISC battery and an analog version of the battery during separate visits. The battery included the following screeners and cognitive tests: Mini-Mental State Examination (2 edition), Clock Drawing Test, Trail-Making Test (TMT), Rey Auditory Verbal Learning Test (RAVLT), Rey-Osterrieth Complex Figure Test (ROCFT), Letter Fluency, Star Cancellation Test, and Digit Span Test. The ISC tests were administered on an iPad Pro and were automatically scored using designated algorithms. The analog tests were administered in line with existing guidelines and scored by trained neuropsychologists. Criterion validity was established through relative agreement coefficients and raw score equivalence tests. In addition,measurement invariance analysis was used to compare the factor structures of both versions. Finally, we explored effects of demographics and experience with digital devices on performance. We found fair to excellent relative agreement between test versions. Absolute equivalence was found for RAVLT, Letter Fluency, Star Cancellation Test, and Digit Span Test. Importantly, we demonstrated equal loadings of the digital and analog test versions on the same set of underlying cognitive domains. Demographic effects were mostly comparable between modalities, and people's experience with digital devices was found to only influence performance on TMT B. This study provides several sources of evidence for the validity of the ISC test battery, offering an important step in validating ISC for clinical use.Supplemental data for this article is available online at https://doi.org/10.1080/13854046.2021.1974565.
为收集飞利浦IntelliSpace Cognition(ISC)平台上一系列数字测试的有效性证据。共有200名健康参与者(年龄50 - 80岁)在不同时间分别完成了ISC测试组和该测试组的模拟版本。该测试组包括以下筛查和认知测试:简易精神状态检查表(第2版)、画钟试验、连线测验(TMT)、雷伊听觉词语学习测验(RAVLT)、雷伊 - 奥斯特里赫复杂图形测验(ROCFT)、字母流畅性测验、星形删除测验和数字广度测验。ISC测试在iPad Pro上进行,并使用指定算法自动评分。模拟测试按照现有指南进行,并由训练有素的神经心理学家评分。通过相对一致性系数和原始分数等效性测试建立效标效度。此外,使用测量不变性分析来比较两个版本的因子结构。最后,我们探讨了人口统计学特征和数字设备使用经验对测试表现的影响。我们发现测试版本之间的相对一致性从中等到优秀。在RAVLT、字母流畅性测验、星形删除测验和数字广度测验中发现了绝对等效性。重要的是,我们证明了数字和模拟测试版本在同一组潜在认知领域上的负荷相等。不同测试方式下人口统计学特征的影响大多具有可比性,并且发现人们的数字设备使用经验仅影响连线测验B的表现。本研究为ISC测试组的有效性提供了多个证据来源,为ISC在临床应用中的验证迈出了重要一步。本文的补充数据可在https://doi.org/10.1080/13854046.2021.1974565在线获取。