Shi Jiaqi, Wang Hongyu, Gou Haiyan, Chen Yan, He Jia, Qu Youyang, Wei Xinya, Fan Mingyue, Wang Yanlong, Zhu Yanmei, Zhu Yulan
Department of Neurology, The 2nd Affiliated Hospital of Harbin Medical University, Harbin, China.
Department of Neurology, The Fourth Affiliated Hospital of Harbin Medical University, Harbin, China.
Front Neurosci. 2025 Aug 21;19:1616957. doi: 10.3389/fnins.2025.1616957. eCollection 2025.
Construct a predictive model for rehabilitation outcomes in ischemic stroke patients 3 months post-stroke using resting state functional magnetic resonance imaging (fMRI) images, as well as synchronized electroencephalography (EEG) and electromyography (EMG) time series data.
A total of 102 hemiplegic patients with ischemic stroke were recruited. Resting - state functional magnetic resonance imaging (fMRI) scans were carried out on all patients and 86 of them underwent simultaneous electroencephalogram (EEG) and electromyogram (EMG) examinations. After data preprocessing, we established prediction models based on time-series data and fMRI images separately. The predictions of the time - series model and the fMRI model were integrated using ensemble learning methods to create a multimodal fusion prediction model. The accuracy, recall, precision, F1 - score, and the area under the ROC curve (AUC) were calculated to evaluate the performance of the model.
Compared to unimodal prediction models, multimodal fusion models demonstrated superior predictive performance. The ShuffleNet-LSTM model outperformed other multimodal fusion approaches. The area under the ROC curve was 0.8665, accuracy was 0.8031, F1-score was 0.7829, recall was 0.774, and precision was 0.833.
A deep learning-based rehabilitation prediction model utilizing multimodal signals was successfully developed. The ShuffleNet-LSTM model exhibited excellent performance among multimodal fusion models, effectively enhancing the accuracy of predicting lower-limb motor function recovery in stroke patients.
利用静息态功能磁共振成像(fMRI)图像以及同步脑电图(EEG)和肌电图(EMG)时间序列数据,构建缺血性中风患者中风后3个月康复结局的预测模型。
共招募了102例缺血性中风偏瘫患者。对所有患者进行静息态功能磁共振成像(fMRI)扫描,其中86例同时进行了脑电图(EEG)和肌电图(EMG)检查。经过数据预处理后,我们分别基于时间序列数据和fMRI图像建立了预测模型。使用集成学习方法整合时间序列模型和fMRI模型的预测结果,创建多模态融合预测模型。计算准确率、召回率、精确率、F1分数和ROC曲线下面积(AUC)来评估模型的性能。
与单模态预测模型相比,多模态融合模型表现出更好的预测性能。ShuffleNet-LSTM模型优于其他多模态融合方法。ROC曲线下面积为0.8665,准确率为0.8031,F1分数为0.7829,召回率为0.774,精确率为0.833。
成功开发了一种基于深度学习的利用多模态信号的康复预测模型。ShuffleNet-LSTM模型在多模态融合模型中表现出色,有效提高了中风患者下肢运动功能恢复预测的准确性。