Yang Fan, Li Shiyu, Sun Chang, Li Xingjiang, Xiao Zhangbo
The Second Affiliated Hospital, Qiqihar Medical University, Qiqihar, Heilongjiang, China.
The Second Affiliated Hospital, Pingfang District People's Hospital, Harbin, China.
Front Physiol. 2024 Dec 2;15:1472380. doi: 10.3389/fphys.2024.1472380. eCollection 2024.
This study addresses the limitations of traditional sports rehabilitation, emphasizing the need for improved accuracy and response speed in real-time action detection and recognition in complex rehabilitation scenarios. We propose the STA-C3DL model, a deep learning framework that integrates 3D Convolutional Neural Networks (C3D), Long Short-Term Memory (LSTM) networks, and spatiotemporal attention mechanisms to capture nuanced action dynamics more precisely. Experimental results on multiple datasets, including NTU RGB + D, Smarthome Rehabilitation, UCF101, and HMDB51, show that the STA-C3DL model significantly outperforms existing methods, achieving up to 96.42% accuracy and an F1 score of 95.83% on UCF101, with robust performance across other datasets. The model demonstrates particular strength in handling real-time feedback requirements, highlighting its practical application in enhancing rehabilitation processes. This work provides a powerful, accurate tool for action recognition, advancing the application of deep learning in rehabilitation therapy and offering valuable support to therapists and researchers. Future research will focus on expanding the model's adaptability to unconventional and extreme actions, as well as its integration into a wider range of rehabilitation settings to further support individualized patient recovery.
本研究探讨了传统运动康复的局限性,强调在复杂康复场景中实时动作检测与识别方面提高准确性和响应速度的必要性。我们提出了STA-C3DL模型,这是一个深度学习框架,它集成了3D卷积神经网络(C3D)、长短期记忆(LSTM)网络和时空注意力机制,以更精确地捕捉细微的动作动态。在包括NTU RGB + D、智能家居康复、UCF101和HMDB51在内的多个数据集上的实验结果表明,STA-C3DL模型显著优于现有方法,在UCF101上达到了高达96.42%的准确率和95.83%的F1分数,在其他数据集上也具有稳健的性能。该模型在处理实时反馈需求方面表现出特别的优势,突出了其在增强康复过程中的实际应用。这项工作为动作识别提供了一个强大、准确的工具,推动了深度学习在康复治疗中的应用,并为治疗师和研究人员提供了有价值的支持。未来的研究将集中在扩大模型对非常规和极端动作的适应性,以及将其集成到更广泛的康复环境中,以进一步支持个性化的患者康复。