• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

智能舞蹈动作评估:一种基于关键帧获取的音乐节拍特征评估方法。

Intelligent Dance Motion Evaluation: An Evaluation Method Based on Keyframe Acquisition According to Musical Beat Features.

机构信息

School of Music, Wenzhou University, Wenzhou 325035, China.

College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou 325035, China.

出版信息

Sensors (Basel). 2024 Sep 28;24(19):6278. doi: 10.3390/s24196278.

DOI:10.3390/s24196278
PMID:39409318
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11478525/
Abstract

Motion perception is crucial in competitive sports like dance, basketball, and diving. However, evaluations in these sports heavily rely on professionals, posing two main challenges: subjective assessments are uncertain and can be influenced by experience, making it hard to guarantee timeliness and accuracy, and increasing labor costs with multi-expert voting. While video analysis methods have alleviated some pressure, challenges remain in extracting key points/frames from videos and constructing a suitable, quantifiable evaluation method that aligns with the static-dynamic nature of movements for accurate assessment. Therefore, this study proposes an innovative intelligent evaluation method aimed at enhancing the accuracy and processing speed of complex video analysis tasks. Firstly, by constructing a keyframe extraction method based on musical beat detection, coupled with prior knowledge, the beat detection is optimized through a perceptually weighted window to accurately extract keyframes that are highly correlated with dance movement changes. Secondly, OpenPose is employed to detect human joint points in the keyframes, quantifying human movements into a series of numerically expressed nodes and their relationships (i.e., pose descriptions). Combined with the positions of keyframes in the time sequence, a standard pose description sequence is formed, serving as the foundational data for subsequent quantitative evaluations. Lastly, an Action Sequence Evaluation method (ASCS) is established based on all action features within a single action frame to precisely assess the overall performance of individual actions. Furthermore, drawing inspiration from the Rouge-L evaluation method in natural language processing, a Similarity Measure Approach based on Contextual Relationships (SMACR) is constructed, focusing on evaluating the coherence of actions. By integrating ASCS and SMACR, a comprehensive evaluation of dancers is conducted from both the static and dynamic dimensions. During the method validation phase, the research team judiciously selected 12 representative samples from the popular dance game , meticulously classifying them according to the complexity of dance moves and physical exertion levels. The experimental results demonstrate the outstanding performance of the constructed automated evaluation method. Specifically, this method not only achieves the precise assessments of dance movements at the individual keyframe level but also significantly enhances the evaluation of action coherence and completeness through the innovative SMACR. Across all 12 test samples, the method accurately selects 2 to 5 keyframes per second from the videos, reducing the computational load to 4.1-10.3% compared to traditional full-frame matching methods, while the overall evaluation accuracy only slightly decreases by 3%, fully demonstrating the method's combination of efficiency and precision. Through precise musical beat alignment, efficient keyframe extraction, and the introduction of intelligent dance motion analysis technology, this study significantly improves upon the subjectivity and inefficiency of traditional manual evaluations, enhancing the scientificity and accuracy of assessments. It provides robust tool support for fields such as dance education and competition evaluations, showcasing broad application prospects.

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/dd24873cc654/sensors-24-06278-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/12224cc593fe/sensors-24-06278-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/f610260aa101/sensors-24-06278-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/ce5f215af7ad/sensors-24-06278-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/095c37f03ce9/sensors-24-06278-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/e6cd3e3873f7/sensors-24-06278-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/174e1e8cc510/sensors-24-06278-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/53abec517511/sensors-24-06278-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/4bdbc257daf4/sensors-24-06278-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/e9ded384d49f/sensors-24-06278-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/9b7b7597e8c2/sensors-24-06278-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/ccbcc85f2b1f/sensors-24-06278-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/351cccdf2cc3/sensors-24-06278-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/dd24873cc654/sensors-24-06278-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/12224cc593fe/sensors-24-06278-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/f610260aa101/sensors-24-06278-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/ce5f215af7ad/sensors-24-06278-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/095c37f03ce9/sensors-24-06278-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/e6cd3e3873f7/sensors-24-06278-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/174e1e8cc510/sensors-24-06278-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/53abec517511/sensors-24-06278-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/4bdbc257daf4/sensors-24-06278-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/e9ded384d49f/sensors-24-06278-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/9b7b7597e8c2/sensors-24-06278-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/ccbcc85f2b1f/sensors-24-06278-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/351cccdf2cc3/sensors-24-06278-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/602d/11478525/dd24873cc654/sensors-24-06278-g013.jpg
摘要

运动感知在舞蹈、篮球和跳水等竞技体育中至关重要。然而,这些运动的评估主要依赖于专业人员,这带来了两个主要挑战:主观评估不确定,并且可能受到经验的影响,难以保证及时性和准确性,并且多专家投票会增加劳动力成本。虽然视频分析方法缓解了一些压力,但在从视频中提取关键帧/帧以及构建适合的、可量化的评估方法方面仍然存在挑战,该方法与运动的静态-动态性质相匹配,以进行准确评估。因此,本研究提出了一种创新的智能评估方法,旨在提高复杂视频分析任务的准确性和处理速度。首先,通过构建基于音乐节拍检测的关键帧提取方法,并结合先验知识,通过感知加权窗口优化节拍检测,以准确提取与舞蹈运动变化高度相关的关键帧。其次,使用 OpenPose 检测关键帧中的人体关节点,将人体运动量化为一系列用数值表示的节点及其关系(即姿势描述)。结合关键帧在时间序列中的位置,形成标准的姿势描述序列,作为后续定量评估的基础数据。最后,基于单个动作帧内的所有动作特征,建立了动作序列评估方法(ASCS),精确评估单个动作的整体性能。此外,受自然语言处理中的 Rouge-L 评估方法的启发,构建了基于上下文关系的相似性度量方法(SMACR),专注于评估动作的连贯性。通过整合 ASCS 和 SMACR,从静态和动态两个维度对舞者进行全面评估。在方法验证阶段,研究团队从流行的舞蹈游戏中精心挑选了 12 个具有代表性的样本,根据舞蹈动作的复杂程度和体力消耗水平进行了细致的分类。实验结果表明,所构建的自动化评估方法具有出色的性能。具体来说,该方法不仅实现了对单个关键帧级别的舞蹈动作的精确评估,而且通过创新的 SMACR 显著提高了对动作连贯性和完整性的评估。在所有 12 个测试样本中,该方法每秒从视频中精确选择 2 到 5 个关键帧,与传统的全帧匹配方法相比,计算负载降低了 4.1%至 10.3%,而整体评估准确性仅略有下降 3%,充分证明了该方法的效率和精度的结合。通过精确的音乐节拍对齐、高效的关键帧提取以及智能舞蹈运动分析技术的引入,本研究极大地提高了传统手动评估的主观性和低效性,提高了评估的科学性和准确性。它为舞蹈教育和比赛评估等领域提供了强大的工具支持,展示了广阔的应用前景。

相似文献

1
Intelligent Dance Motion Evaluation: An Evaluation Method Based on Keyframe Acquisition According to Musical Beat Features.智能舞蹈动作评估:一种基于关键帧获取的音乐节拍特征评估方法。
Sensors (Basel). 2024 Sep 28;24(19):6278. doi: 10.3390/s24196278.
2
The Collection and Recognition Method of Music and Dance Movement Based on Intelligent Sensor.基于智能传感器的音乐和舞蹈动作采集与识别方法。
Comput Intell Neurosci. 2022 Jun 3;2022:2654892. doi: 10.1155/2022/2654892. eCollection 2022.
3
Keyframe extraction from laparoscopic videos based on visual saliency detection.基于视觉显著性检测的腹腔镜视频关键帧提取。
Comput Methods Programs Biomed. 2018 Oct;165:13-23. doi: 10.1016/j.cmpb.2018.07.004. Epub 2018 Jul 18.
4
Pose Estimation-Assisted Dance Tracking System Based on Convolutional Neural Network.基于卷积神经网络的姿态估计辅助舞蹈跟踪系统。
Comput Intell Neurosci. 2022 Jun 3;2022:2301395. doi: 10.1155/2022/2301395. eCollection 2022.
5
Example-based automatic music-driven conventional dance motion synthesis.基于实例的自动音乐驱动的传统舞蹈动作合成。
IEEE Trans Vis Comput Graph. 2012 Mar;18(3):501-15. doi: 10.1109/TVCG.2011.73.
6
Optimization Simulation of Dance Technical Movements and Music Matching Based on Multifeature Fusion.基于多特征融合的舞蹈技术动作与音乐匹配优化仿真。
Comput Intell Neurosci. 2022 Jun 8;2022:8679748. doi: 10.1155/2022/8679748. eCollection 2022.
7
Visual Timing of Structured Dance Movements Resembles Auditory Rhythm Perception.结构化舞蹈动作的视觉计时类似于听觉节奏感知。
Neural Plast. 2016;2016:1678390. doi: 10.1155/2016/1678390. Epub 2016 May 30.
8
The geometry of interpersonal synchrony in human dance.人类舞蹈中人际同步的几何结构。
Curr Biol. 2024 Jul 8;34(13):3011-3019.e4. doi: 10.1016/j.cub.2024.05.055. Epub 2024 Jun 21.
9
Technical Note: Quantifying music-dance synchrony during salsa dancing with a deep learning-based 2D pose estimator.技术说明:使用基于深度学习的二维姿态估计器量化萨尔萨舞中的音乐-舞蹈同步性。
J Biomech. 2022 Aug;141:111178. doi: 10.1016/j.jbiomech.2022.111178. Epub 2022 Jun 8.
10
DanceIt: Music-Inspired Dancing Video Synthesis.DanceIt:音乐启发式舞蹈视频合成。
IEEE Trans Image Process. 2021;30:5559-5572. doi: 10.1109/TIP.2021.3086082. Epub 2021 Jun 16.

本文引用的文献

1
Development and Evaluation of a Hybrid Measurement System to Determine the Kinematics of the Wrist.一种用于确定手腕运动学的混合测量系统的开发与评估
Sensors (Basel). 2024 Apr 16;24(8):2543. doi: 10.3390/s24082543.
2
Ergonomic Risk Assessment of Oral and Maxillofacial Surgeons - RULA Applied to Objective Kinematic Data.口腔颌面外科医生的人体工程学风险评估——应用于客观运动学数据的快速上肢评估法(RULA)
Hum Factors. 2023 Dec;65(8):1655-1673. doi: 10.1177/00187208211053073. Epub 2022 Mar 3.
3
Image Segmentation Using Deep Learning: A Survey.基于深度学习的图像分割技术综述。
IEEE Trans Pattern Anal Mach Intell. 2022 Jul;44(7):3523-3542. doi: 10.1109/TPAMI.2021.3059968. Epub 2022 Jun 3.
4
Sensorimotor integration is enhanced in dancers and musicians.舞者和音乐家的感觉运动整合能力得到增强。
Exp Brain Res. 2016 Mar;234(3):893-903. doi: 10.1007/s00221-015-4524-1. Epub 2015 Dec 15.
5
"Just Dance": The Effects of Exergame Feedback and Controller Use on Physical Activity and Psychological Outcomes.《Just Dance》:体感游戏反馈及控制器使用对身体活动和心理结果的影响
Games Health J. 2015 Jun;4(3):183-9. doi: 10.1089/g4h.2014.0092. Epub 2015 Mar 19.
6
Musical training generalises across modalities and reveals efficient and adaptive mechanisms for reproducing temporal intervals.音乐训练具有跨模态的普遍性,并揭示了用于再现时间间隔的高效且适应性强的机制。
Acta Psychol (Amst). 2014 Mar;147:25-33. doi: 10.1016/j.actpsy.2013.10.007. Epub 2013 Oct 31.
7
Marching to the beat of the same drummer: the spontaneous tempo of human locomotion.跟随同一鼓手的节奏行进:人类行走的自发节奏。
J Appl Physiol (1985). 2005 Sep;99(3):1164-73. doi: 10.1152/japplphysiol.00138.2005. Epub 2005 May 12.