Department of Public Health and Preventive Medicine, School of Medicine, Jinan University, Guangzhou, China.
Division of Medical Psychology and Behaviour Science, School of Medicine, Jinan University, Guangzhou, China.
J Alzheimers Dis. 2024;97(3):1125-1137. doi: 10.3233/JAD-230703.
Emotion and cognition are intercorrelated. Impaired emotion is common in populations with Alzheimer's disease (AD) and mild cognitive impairment (MCI), showing promises as an early detection approach.
We aim to develop a novel automatic classification tool based on emotion features and machine learning.
Older adults aged 60 years or over were recruited among residents in the long-term care facilities and the community. Participants included healthy control participants with normal cognition (HC, n = 26), patients with MCI (n = 23), and patients with probable AD (n = 30). Participants watched emotional film clips while multi-dimensional emotion data were collected, including mental features of Self-Assessment Manikin (SAM), physiological features of electrodermal activity (EDA), and facial expressions. Emotional features of EDA and facial expression were abstracted by using continuous decomposition analysis and EomNet, respectively. Bidirectional long short-term memory (Bi-LSTM) was used to train classification model. Hybrid fusion was used, including early feature fusion and late decision fusion. Data from 79 participants were utilized into deep machine learning analysis and hybrid fusion method.
By combining multiple emotion features, the model's performance of AUC value was highest in classification between HC and probable AD (AUC = 0.92), intermediate between MCI and probable AD (AUC = 0.88), and lowest between HC and MCI (AUC = 0.82).
Our method demonstrated an excellent predictive power to differentiate HC/MCI/AD by fusion of multiple emotion features. The proposed model provides a cost-effective and automated method that can assist in detecting probable AD and MCI from normal aging.
情感和认知是相互关联的。在阿尔茨海默病(AD)和轻度认知障碍(MCI)患者中,情绪障碍很常见,这表明它是一种早期检测方法。
我们旨在开发一种基于情绪特征和机器学习的新型自动分类工具。
在长期护理机构和社区中招募 60 岁及以上的老年人。参与者包括认知正常的健康对照组(HC,n=26)、MCI 患者(n=23)和可能患有 AD 的患者(n=30)。参与者观看情绪电影片段,同时收集多维情绪数据,包括自我评估量表(SAM)的心理特征、皮肤电活动(EDA)的生理特征和面部表情。使用连续分解分析和 EomNet 分别提取 EDA 和面部表情的情绪特征。双向长短期记忆(Bi-LSTM)用于训练分类模型。使用混合融合,包括早期特征融合和晚期决策融合。来自 79 名参与者的数据用于深度学习分析和混合融合方法。
通过结合多种情绪特征,模型在区分 HC 和可能患有 AD 之间的 AUC 值最高(AUC=0.92),在区分 MCI 和可能患有 AD 之间的 AUC 值居中(AUC=0.88),在区分 HC 和 MCI 之间的 AUC 值最低(AUC=0.82)。
我们的方法通过融合多种情绪特征,显示出区分 HC/MCI/AD 的优异预测能力。所提出的模型提供了一种具有成本效益且自动化的方法,可以帮助从正常衰老中检测出可能患有 AD 和 MCI 的患者。