IEEE J Biomed Health Inform. 2022 Jul;26(7):3466-3477. doi: 10.1109/JBHI.2022.3165640. Epub 2022 Jul 1.
Aiming at the problem of depression recognition, this paper proposes a computer-aided recognition framework based on decision-level multimodal fusion. In Song Dynasty of China, the idea of multimodal fusion was contained in "one gets different impressions of a mountain when viewing it from the front or sideways, at a close range or from afar" poetry. Objective and comprehensive analysis of depression can more accurately restore its essence, and multimodal can represent more information about depression compared to single modal. Linear electroencephalography (EEG) features based on adaptive auto regression (AR) model and typical nonlinear EEG features are extracted. EEG features related to depression and graph metric features in depression related brain regions are selected as the data basis of multimodal fusion to ensure data diversity. Based on the theory of multi-agent cooperation, the computer-aided depression recognition model of decision-level is realized. The experimental data comes from 24 depressed patients and 29 healthy controls (HC). The results of multi-group controlled trials show that compared with single modal or independent classifiers, the decision-level multimodal fusion method has a stronger ability to recognize depression, and the highest accuracy rate 92.13% was obtained. In addition, our results suggest that improving the brain region associated with information processing can help alleviate and treat depression. In the field of classification and recognition, our results clarify that there is no universal classifier suitable for any condition.
针对抑郁识别问题,提出了一种基于决策级多模态融合的计算机辅助识别框架。在中国宋代,“横看成岭侧成峰,远近高低各不同”的诗句中蕴含了多模态融合的思想。客观全面地分析抑郁可以更准确地还原其本质,与单模态相比,多模态可以表示更多关于抑郁的信息。提取基于自适应自回归(AR)模型的线性脑电图(EEG)特征和典型的非线性 EEG 特征。选择与抑郁相关的 EEG 特征和抑郁相关脑区的图度量特征作为多模态融合的数据分析基础,以保证数据多样性。基于多智能体合作理论,实现了决策级的计算机辅助抑郁识别模型。实验数据来自 24 名抑郁患者和 29 名健康对照者(HC)。多组对照试验的结果表明,与单模态或独立分类器相比,决策级多模态融合方法具有更强的抑郁识别能力,最高准确率达到 92.13%。此外,我们的结果表明,改善与信息处理相关的脑区可以帮助缓解和治疗抑郁。在分类和识别领域,我们的结果阐明了没有一种通用的分类器适用于任何条件。