Yu Yanhong, Li Wentao, Zhao Yue, Ye Jiayu, Zheng Yunshao, Liu Xinxin, Wang Qingxiang
College of Traditional Chinese Medicine, Shandong University of Traditional Chinese Medicine, Jinan, China.
School of Computer Science and Technology, Qilu University of Technology, Jinan, China.
Front Neurol. 2022 Jun 30;13:905917. doi: 10.3389/fneur.2022.905917. eCollection 2022.
Relative limb movement is an important feature in assessing depression. In this study, we looked into whether a skeleton-mimetic task using natural stimuli may help people recognize depression. We innovatively used Kinect V2 to collect participant data. Sequential skeletal data was directly extracted from the original Kinect-3D and tetrad coordinates of the participant's 25 body joints. Two constructed skeletal datasets of whole-body joints (including binary classification and multi classification) were input into the proposed model for depression recognition after data preparation. We improved the temporal convolution network (TCN), creating novel spatial attention dilated TCN (SATCN) network that included a hierarchy of temporal convolution groups with different dilated convolution scales to capture important skeletal features and a spatial attention block for final result prediction. The depression and non-depression groups can be classified automatically with a maximum accuracy of 75.8% in the binary classification task, and 64.3% accuracy in the multi classification dataset to recognize more fine-grained identification of depression severity, according to experimental results. Our experiments and methods based on Kinect V2 can not only identify and screen depression patients but also effectively observe the recovery level of depression patients during the recovery process. For example, in the change from severe depression to moderate or mild depression multi classification dataset.
相对肢体运动是评估抑郁症的一个重要特征。在本研究中,我们探究了使用自然刺激的仿骨骼任务是否有助于人们识别抑郁症。我们创新性地使用Kinect V2来收集参与者数据。连续骨骼数据直接从参与者25个身体关节的原始Kinect 3D和四分坐标中提取。经过数据准备后,将两个构建的全身关节骨骼数据集(包括二分类和多分类)输入到所提出的抑郁症识别模型中。我们改进了时间卷积网络(TCN),创建了新颖的空间注意力扩张TCN(SATCN)网络,该网络包括具有不同扩张卷积尺度的时间卷积组层次结构,以捕获重要的骨骼特征,并设有一个空间注意力模块用于最终结果预测。根据实验结果,在二分类任务中,抑郁症组和非抑郁症组能够以最高75.8%的准确率自动分类,在多分类数据集中识别抑郁症严重程度的更细粒度识别准确率为64.3%。我们基于Kinect V2的实验和方法不仅可以识别和筛查抑郁症患者,还能在康复过程中有效观察抑郁症患者的康复水平。例如,在从重度抑郁症转变为中度或轻度抑郁症的多分类数据集中。