1 Pennsylvania State University, University Park, PA, USA.
2 Albert Einstein College of Medicine, Bronx, NY, USA.
Assessment. 2018 Jan;25(1):14-30. doi: 10.1177/1073191116643164. Epub 2016 Apr 15.
Mobile technologies are increasingly used to measure cognitive function outside of traditional clinic and laboratory settings. Although ambulatory assessments of cognitive function conducted in people's natural environments offer potential advantages over traditional assessment approaches, the psychometrics of cognitive assessment procedures have been understudied. We evaluated the reliability and construct validity of ambulatory assessments of working memory and perceptual speed administered via smartphones as part of an ecological momentary assessment protocol in a diverse adult sample ( N = 219). Results indicated excellent between-person reliability (≥0.97) for average scores, and evidence of reliable within-person variability across measurement occasions (0.41-0.53). The ambulatory tasks also exhibited construct validity, as evidence by their loadings on working memory and perceptual speed factors defined by the in-lab assessments. Our findings demonstrate that averaging across brief cognitive assessments made in uncontrolled naturalistic settings provide measurements that are comparable in reliability to assessments made in controlled laboratory environments.
移动技术越来越多地用于在传统的临床和实验室环境之外测量认知功能。虽然在人们的自然环境中进行的认知功能的移动评估比传统的评估方法具有潜在的优势，但认知评估程序的心理测量学仍研究不足。我们评估了通过智能手机作为生态瞬间评估协议一部分进行的工作记忆和知觉速度的移动评估的可靠性和结构有效性，该协议在多样化的成人样本中进行（N=219）。结果表明，平均分数的个体间可靠性极好（≥0.97），并且在测量时刻之间存在可靠的个体内可变性（0.41-0.53）。移动任务也表现出结构有效性，这可以通过它们在实验室评估中定义的工作记忆和知觉速度因子上的负荷来证明。我们的研究结果表明，在不受控制的自然环境中进行的简短认知评估的平均值提供了与在受控实验室环境中进行的评估相当的可靠性测量。
