Van Patten Ryan, Iverson Grant L, Muzeau Mélissa A, VanRavenhorst-Bell Heidi A
Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, United States.
Spaulding Rehabilitation Hospital, Charlestown, MA, United States.
Front Psychol. 2021 Oct 21;12:734947. doi: 10.3389/fpsyg.2021.734947. eCollection 2021.
: Remote mobile cognitive testing (MCT) is an expanding area of research, but psychometric data supporting these measures are limited. We provide preliminary data on test-retest reliability and reliable change estimates in four MCTs from SWAY Medical, Inc. Fifty-five adults from the U.S. Midwest completed the MCTs remotely on their personal mobile devices once per week for 3 consecutive weeks, while being supervised with a video-based virtual connection. The cognitive assessment measured simple reaction time ("Reaction Time"), go/no-go response inhibition ("Impulse Control"), timed visual processing ("Inspection Time"), and working memory ("Working Memory"). For each cognitive test except Working Memory, we analyzed both millisecond (ms) responses and an overall SWAY composite score. The mean age of the sample was 26.69years (SD=9.89; range=18-58). Of the 55 adults, 38 (69.1%) were women and 49 (89.1%) used an iPhone. Friedman's ANOVAs examining differences across testing sessions were nonsignificant (s>0.31). Intraclass correlations for Weeks 1-3 were: Reaction Time (ms): 0.83, Reaction Time (SWAY): 0.83, Impulse Control (ms): 0.68, Impulse Control (SWAY): 0.80, Inspection Time (ms): 0.75, Inspection Time (SWAY): 0.75, and Working Memory (SWAY): 0.88. Intraclass correlations for Weeks 1-2 were: Reaction Time (ms): 0.75, Reaction Time (SWAY): 0.74, Impulse Control (ms): 0.60, Impulse Control (SWAY): 0.76, Inspection Time (ms): 0.79, Inspection Time (SWAY): 0.79, and Working Memory (SWAY): 0.83. Natural distributions of difference scores were calculated and reliable change estimates are presented for 70, 80, and 90% CIs. : Test-retest reliability was adequate or better for the MCTs in this virtual remote testing study. Reliable change estimates allow for the determination of whether a particular level of improvement or decline in performance is within the range of probable measurement error. Additional reliability and validity data are needed in other age groups.
远程移动认知测试（MCT）是一个不断扩展的研究领域，但支持这些测试的心理测量数据有限。我们提供了来自SWAY Medical公司的四项MCT的重测信度和可靠变化估计的初步数据。55名来自美国中西部的成年人在连续3周内，每周通过个人移动设备远程完成一次MCT，同时通过基于视频的虚拟连接进行监督。认知评估测量了简单反应时间（“反应时间”）、go/no-go反应抑制（“冲动控制”）、定时视觉处理（“检查时间”）和工作记忆（“工作记忆”）。对于除工作记忆之外的每项认知测试，我们分析了毫秒（ms）反应和整体SWAY综合得分。样本的平均年龄为26.69岁（标准差=9.89；范围=18 - 58岁）。在55名成年人中，38名（69.1%）为女性，49名（89.1%）使用iPhone。检验各测试阶段差异的弗里德曼方差分析无显著差异（s>0.31）。第1 - 3周的组内相关系数为：反应时间（ms）：0.83，反应时间（SWAY）：0.83，冲动控制（ms）：0.68，冲动控制（SWAY）：0.80，检查时间（ms）：0.75，检查时间（SWAY）：0.75，工作记忆（SWAY）：0.88。第1 - 2周的组内相关系数为：反应时间（ms）：0.75，反应时间（SWAY）：0.74，冲动控制（ms）：0.60，冲动控制（SWAY）：0.76，检查时间（ms）：0.79，检查时间（SWAY）：0.79，工作记忆（SWAY）：0.83。计算了差异分数的自然分布，并给出了70%、80%和90%置信区间的可靠变化估计。：在这项虚拟远程测试研究中，MCT的重测信度足够或更好。可靠变化估计允许确定特定水平的成绩提高或下降是否在可能的测量误差范围内。其他年龄组还需要更多的信度和效度数据。
