Min Jin-Young, Kim Duri, Jang Hana, Kim Hyunjoo, Kim Soojin, Lee Seungbo, Seo Yae-Eun, Kim Ye-Jin, Kim Jong-Yoon, Min Kyoung-Bok
Veterans Medical Research Institute, Veterans Health Service Medical Center, Seoul 05368, Republic of Korea.
Beluga Corp, Chang-up-ro, 54, Seongnam-si 13449, Gyeonggi-do, Republic of Korea.
Diagnostics (Basel). 2025 Jan 3;15(1):92. doi: 10.3390/diagnostics15010092.
The early detection of individuals at risk of cognitive impairment is a clinical imperative. With the recent advancement of digital devices, smartphone application-based cognitive assessment is considered a promising tool for cognitive screening and monitoring inside and outside the clinic. This study examined whether a smartphone-based cognitive assessment, Brain OK, was valid for evaluating cognitive performance and identifying people at risk of cognitive impairment. We recruited 88 study participants aged over 60. They completed two cognitive tests with the Montreal Cognitive Assessment (MoCA), a validated paper-and-pencil cognitive screening tool, and Brain OK, a smartphone-based cognitive testing application. To examine convergent validity, we conducted analyses of Spearman correlations between MoCA and BrainOK, a Bland-Atman plot with regression analysis, and the area under the curve (AUC). There was a significant positive association between Brain OK and the MoCA total score, with a coefficient of 0.9044 (SE = 0.057, t = 15.750, < 0.001). The Bland-Altman plot represented a reasonable level of agreement between the two tests. We conducted the AUC analysis of Brain OK to compare the cognitively normal and impaired groups. The AUC value for the Brain OK score of 13.5 was the highest at 0.941. The sensitivity and specificity were 0.958 and 0.925, respectively. The smartphone app-based Brain OK test was feasible for assessing cognitive function and acceptable for identifying subjects with cognitive impairment. The results suggest Brain OK complements traditional in-person cognitive assessments and may help enhance cognitive health dialogue between doctors and patients.
早期发现有认知障碍风险的个体是一项临床要务。随着数字设备的最新进展,基于智能手机应用程序的认知评估被认为是一种用于临床内外认知筛查和监测的有前景的工具。本研究考察了基于智能手机的认知评估应用程序“Brain OK”在评估认知表现和识别有认知障碍风险的人群方面是否有效。我们招募了88名60岁以上的研究参与者。他们使用蒙特利尔认知评估量表(MoCA,一种经过验证的纸笔式认知筛查工具)和“Brain OK”(一款基于智能手机的认知测试应用程序)完成了两项认知测试。为了检验收敛效度,我们对MoCA和“Brain OK”之间进行了斯皮尔曼相关性分析、带有回归分析的布兰德 - 奥特曼图分析以及曲线下面积(AUC)分析。“Brain OK”与MoCA总分之间存在显著正相关,系数为0.9044(标准误 = 0.057,t = 15.750,P < 0.001)。布兰德 - 奥特曼图表明这两项测试之间具有合理的一致性水平。我们对“Brain OK”进行了AUC分析以比较认知正常组和受损组。“Brain OK”得分为13.5时的AUC值最高,为0.941。敏感性和特异性分别为0.958和0.925。基于智能手机应用程序的“Brain OK”测试在评估认知功能方面是可行的,并且在识别有认知障碍的受试者方面是可接受的。结果表明“Brain OK”可补充传统的面对面认知评估,并可能有助于加强医生与患者之间关于认知健康的对话。