Suppr超能文献

智能舞蹈动作评估:一种基于关键帧获取的音乐节拍特征评估方法。

Intelligent Dance Motion Evaluation: An Evaluation Method Based on Keyframe Acquisition According to Musical Beat Features.

机构信息

School of Music, Wenzhou University, Wenzhou 325035, China.

College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou 325035, China.

出版信息

Sensors (Basel). 2024 Sep 28;24(19):6278. doi: 10.3390/s24196278.

Abstract

Motion perception is crucial in competitive sports like dance, basketball, and diving. However, evaluations in these sports heavily rely on professionals, posing two main challenges: subjective assessments are uncertain and can be influenced by experience, making it hard to guarantee timeliness and accuracy, and increasing labor costs with multi-expert voting. While video analysis methods have alleviated some pressure, challenges remain in extracting key points/frames from videos and constructing a suitable, quantifiable evaluation method that aligns with the static-dynamic nature of movements for accurate assessment. Therefore, this study proposes an innovative intelligent evaluation method aimed at enhancing the accuracy and processing speed of complex video analysis tasks. Firstly, by constructing a keyframe extraction method based on musical beat detection, coupled with prior knowledge, the beat detection is optimized through a perceptually weighted window to accurately extract keyframes that are highly correlated with dance movement changes. Secondly, OpenPose is employed to detect human joint points in the keyframes, quantifying human movements into a series of numerically expressed nodes and their relationships (i.e., pose descriptions). Combined with the positions of keyframes in the time sequence, a standard pose description sequence is formed, serving as the foundational data for subsequent quantitative evaluations. Lastly, an Action Sequence Evaluation method (ASCS) is established based on all action features within a single action frame to precisely assess the overall performance of individual actions. Furthermore, drawing inspiration from the Rouge-L evaluation method in natural language processing, a Similarity Measure Approach based on Contextual Relationships (SMACR) is constructed, focusing on evaluating the coherence of actions. By integrating ASCS and SMACR, a comprehensive evaluation of dancers is conducted from both the static and dynamic dimensions. During the method validation phase, the research team judiciously selected 12 representative samples from the popular dance game , meticulously classifying them according to the complexity of dance moves and physical exertion levels. The experimental results demonstrate the outstanding performance of the constructed automated evaluation method. Specifically, this method not only achieves the precise assessments of dance movements at the individual keyframe level but also significantly enhances the evaluation of action coherence and completeness through the innovative SMACR. Across all 12 test samples, the method accurately selects 2 to 5 keyframes per second from the videos, reducing the computational load to 4.1-10.3% compared to traditional full-frame matching methods, while the overall evaluation accuracy only slightly decreases by 3%, fully demonstrating the method's combination of efficiency and precision. Through precise musical beat alignment, efficient keyframe extraction, and the introduction of intelligent dance motion analysis technology, this study significantly improves upon the subjectivity and inefficiency of traditional manual evaluations, enhancing the scientificity and accuracy of assessments. It provides robust tool support for fields such as dance education and competition evaluations, showcasing broad application prospects.

摘要

运动感知在舞蹈、篮球和跳水等竞技体育中至关重要。然而,这些运动的评估主要依赖于专业人员,这带来了两个主要挑战:主观评估不确定,并且可能受到经验的影响,难以保证及时性和准确性,并且多专家投票会增加劳动力成本。虽然视频分析方法缓解了一些压力,但在从视频中提取关键帧/帧以及构建适合的、可量化的评估方法方面仍然存在挑战,该方法与运动的静态-动态性质相匹配,以进行准确评估。因此,本研究提出了一种创新的智能评估方法,旨在提高复杂视频分析任务的准确性和处理速度。首先,通过构建基于音乐节拍检测的关键帧提取方法,并结合先验知识,通过感知加权窗口优化节拍检测,以准确提取与舞蹈运动变化高度相关的关键帧。其次,使用 OpenPose 检测关键帧中的人体关节点,将人体运动量化为一系列用数值表示的节点及其关系(即姿势描述)。结合关键帧在时间序列中的位置,形成标准的姿势描述序列,作为后续定量评估的基础数据。最后,基于单个动作帧内的所有动作特征,建立了动作序列评估方法(ASCS),精确评估单个动作的整体性能。此外,受自然语言处理中的 Rouge-L 评估方法的启发,构建了基于上下文关系的相似性度量方法(SMACR),专注于评估动作的连贯性。通过整合 ASCS 和 SMACR,从静态和动态两个维度对舞者进行全面评估。在方法验证阶段,研究团队从流行的舞蹈游戏中精心挑选了 12 个具有代表性的样本,根据舞蹈动作的复杂程度和体力消耗水平进行了细致的分类。实验结果表明,所构建的自动化评估方法具有出色的性能。具体来说,该方法不仅实现了对单个关键帧级别的舞蹈动作的精确评估,而且通过创新的 SMACR 显著提高了对动作连贯性和完整性的评估。在所有 12 个测试样本中,该方法每秒从视频中精确选择 2 到 5 个关键帧,与传统的全帧匹配方法相比,计算负载降低了 4.1%至 10.3%,而整体评估准确性仅略有下降 3%,充分证明了该方法的效率和精度的结合。通过精确的音乐节拍对齐、高效的关键帧提取以及智能舞蹈运动分析技术的引入,本研究极大地提高了传统手动评估的主观性和低效性,提高了评估的科学性和准确性。它为舞蹈教育和比赛评估等领域提供了强大的工具支持,展示了广阔的应用前景。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/12224cc593fe/sensors-24-06278-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验