Department of Graduate Psychology, Chatham University, Pittsburgh, PA, USA.
Electrical Engineering and Bioengineering, University of Texas at Arlington, Arlington, TX, USA.
Arch Clin Neuropsychol. 2021 Apr 21;36(3):322-328. doi: 10.1093/arclin/acaa056.
As computerized cognitive testing becomes increasingly popular in clinical and research settings, conducting studies on efficacy and psychometric properties is essential. One such program is RC21X, a web-based brain performance measurement tool. Based on empirically supported neurocognitive and neuromotor tasks, the 12-min test consists of 15 modules measuring memory, motor coordination, processing speed, and executive functioning. Because individuals may use RC21X repeatedly to track changes in cognitive performance, establishing reliability of the program is imperative. The current study examined test-retest reliability of RC21X within a 2-week period.
The sample consisted of 222 individuals: 192 (86.5%) were male, and 30 (13.5%) were female. Average age was 44.06 years (SD = 17.76), with ages ranging from 7 to 82 years. We computed Pearson's correlation coefficients for module and composite scores to determine reliability between performance at times 1 and 2.
All correlations were statistically significant (p < .001). The 2-week test-retest reliability for composite score was 0.72, with subtest coefficients ranging from 0.54 on an auditory memory recognition task to 0.89 on a finger tapping task. We replicated these analyses with participants' (n = 43) test sessions 3 and 4; we found similar results to those from test 1 and test 2 analyses, suggesting stability of results over multiple administrations.
Results for RC21X were comparable to existing literature that supports moderate to high reliability of other computer-based tests. Although future research needs to investigate validity of RC21X, our findings support potential applications in research, clinical use, and personal brain performance measurement.
随着计算机化认知测试在临床和研究环境中越来越受欢迎，对其疗效和心理测量学特性进行研究至关重要。RC21X 就是这样一个程序，它是一个基于网络的大脑性能测量工具。该 12 分钟的测试基于经验支持的神经认知和神经运动任务，由 15 个模块组成，测量记忆、运动协调、处理速度和执行功能。由于个体可能会重复使用 RC21X 来跟踪认知表现的变化，因此建立该程序的可靠性是至关重要的。本研究在两周的时间内检查了 RC21X 的测试-重测信度。
样本由 222 人组成：192 人（86.5%）为男性，30 人（13.5%）为女性。平均年龄为 44.06 岁（标准差=17.76），年龄范围为 7 至 82 岁。我们计算了模块和综合得分的皮尔逊相关系数，以确定两次测试之间的表现可靠性。
所有相关性均具有统计学意义（p<0.001）。综合得分的两周测试-重测信度为 0.72，子测试系数范围从听觉记忆识别任务的 0.54 到手指敲击任务的 0.89。我们使用参与者（n=43）的测试会话 3 和 4 重复了这些分析；我们发现与测试 1 和测试 2 分析的结果相似，这表明结果在多次测试中具有稳定性。
RC21X 的结果与支持其他基于计算机的测试具有中等至高度可靠性的现有文献一致。尽管未来的研究需要调查 RC21X 的有效性，但我们的发现支持了它在研究、临床应用和个人大脑表现测量中的潜在应用。
