Chae Han Joo, Kim Ji-Been, Park Gwanmo, O'Sullivan David Michael, Seo Jinwook, Park Jung-Jun
Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea.
Division of Sports Science, Pusan National University, Busan, Republic of Korea.
Interact J Med Res. 2023 Sep 12;12:e37604. doi: 10.2196/37604.
Insufficient physical activity due to social distancing and suppressed outdoor activities increases vulnerability to diseases like cardiovascular diseases, sarcopenia, and severe COVID-19. While bodyweight exercises, such as squats, effectively boost physical activity, incorrect postures risk abnormal muscle activation joint strain, leading to ineffective sessions or even injuries. Avoiding incorrect postures is challenging for novices without expert guidance. Existing solutions for remote coaching and computer-assisted posture correction often prove costly or inefficient.
This study aimed to use deep neural networks to develop a personal workout assistant that offers feedback on squat postures using only mobile devices-smartphones and tablets. Deep learning mimicked experts' visual assessments of proper exercise postures. The effectiveness of the mobile app was evaluated by comparing it with exercise videos, a popular at-home workout choice.
Twenty participants were recruited without squat exercise experience and divided into an experimental group (EXP) with 10 individuals aged 21.90 (SD 2.18) years and a mean BMI of 20.75 (SD 2.11) and a control group (CTL) with 10 individuals aged 22.60 (SD 1.95) years and a mean BMI of 18.72 (SD 1.23) using randomized controlled trials. A data set with over 20,000 squat videos annotated by experts was created and a deep learning model was trained using pose estimation and video classification to analyze the workout postures. Subsequently, a mobile workout assistant app, Home Alone Exercise, was developed, and a 2-week interventional study, in which the EXP used the app while the CTL only followed workout videos, showed how the app helps people improve squat exercise.
The EXP significantly improved their squat postures evaluated by the app after 2 weeks (Pre: 0.20 vs Mid: 4.20 vs Post: 8.00, P=.001), whereas the CTL (without the app) showed no significant change in squat posture (Pre: 0.70 vs Mid: 1.30 vs Post: 3.80, P=.13). Significant differences were observed in the left (Pre: 75.06 vs Mid: 76.24 vs Post: 63.13, P=.02) and right (Pre: 71.99 vs Mid: 76.68 vs Post: 62.82, P=.03) knee joint angles in the EXP before and after exercise, with no significant effect found for the CTL in the left (Pre: 73.27 vs Mid: 74.05 vs Post: 70.70, P=.68) and right (Pre: 70.82 vs Mid: 74.02 vs Post: 70.23, P=.61) knee joint angles.
EXP participants trained with the app experienced faster improvement and learned more nuanced details of the squat exercise. The proposed mobile app, offering cost-effective self-discovery feedback, effectively taught users about squat exercises without expensive in-person trainer sessions.
Clinical Research Information Service KCT0008178 (retrospectively registered); https://cris.nih.go.kr/cris/search/detailSearch.do/24006.
由于社交距离和户外活动受限导致身体活动不足,增加了患心血管疾病、肌肉减少症和重症 COVID-19 等疾病的风险。虽然深蹲等体重训练能有效促进身体活动,但姿势不正确会有肌肉异常激活和关节劳损的风险,导致训练效果不佳甚至受伤。对于没有专业指导的新手来说,避免不正确姿势具有挑战性。现有的远程指导和计算机辅助姿势纠正解决方案往往成本高昂或效率低下。
本研究旨在使用深度神经网络开发一款个人锻炼助手,仅通过移动设备(智能手机和平板电脑)提供深蹲姿势反馈。深度学习模仿专家对正确运动姿势的视觉评估。通过将该移动应用程序与锻炼视频(一种流行的家庭锻炼选择)进行比较,评估其有效性。
招募 20 名无深蹲锻炼经验的参与者,采用随机对照试验将其分为实验组(EXP),共 10 人,年龄 21.90(标准差 2.18)岁,平均体重指数为 20.75(标准差 2.11);对照组(CTL),共 10 人,年龄 22.60(标准差 1.95)岁,平均体重指数为 18.72(标准差 1.23)。创建了一个由专家标注的超过 20000 个深蹲视频的数据集,并使用姿势估计和视频分类训练深度学习模型来分析锻炼姿势。随后,开发了一款移动锻炼助手应用程序“独自在家锻炼”,并进行了为期 2 周的干预研究,其中实验组使用该应用程序,而对照组仅遵循锻炼视频,以展示该应用程序如何帮助人们改善深蹲锻炼。
两周后,实验组通过应用程序评估的深蹲姿势有显著改善(前测:0.20 对比中期:4.20 对比后测:8.00,P = 0.001),而对照组(未使用应用程序)的深蹲姿势无显著变化(前测:0.70 对比中期:1.30 对比后测:3.80,P = 0.13)。实验组锻炼前后左膝(前测:75.06 对比中期:76.24 对比后测:63.13,P = 0.02)和右膝(前测:71.99 对比中期:76.68 对比后测:62.82,P = 0.03)关节角度有显著差异,而对照组左膝(前测:73.27 对比中期:74.05 对比后测:70.70,P = 0.68)和右膝(前测:70.82 对比中期:74.02 对比后测:70.23,P = 0.61)关节角度无显著影响。
使用该应用程序训练的实验组参与者改善更快,并且学到了深蹲锻炼更细微的细节。所提出的移动应用程序提供了具有成本效益的自我发现反馈,无需昂贵的面对面教练课程就能有效地教会用户进行深蹲锻炼。
临床研究信息服务 KCT0008178(回顾性注册);https://cris.nih.go.kr/cris/search/detailSearch.do/24006 。