Mohapatra Payal, Aravind Vasudev, Bisram Marisa, Lee Young-Joong, Jeong Hyoyoung, Jinkins Katherine, Gardner Richard, Streamer Jill, Bowers Brent, Cavuoto Lora, Banks Anthony, Xu Shuai, Rogers John, Cao Jian, Zhu Qi, Guo Ping
Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL 60208, USA.
Department of Mechanical Engineering, Northwestern University, Evanston, IL 60208, USA.
PNAS Nexus. 2024 Oct 15;3(10):pgae421. doi: 10.1093/pnasnexus/pgae421. eCollection 2024 Oct.
Manufacturing workers face prolonged strenuous physical activities, impacting both financial aspects and their health due to work-related fatigue. Continuously monitoring physical fatigue and providing meaningful feedback is crucial to mitigating human and monetary losses in manufacturing workplaces. This study introduces a novel application of multimodal wearable sensors and machine learning techniques to quantify physical fatigue and tackle the challenges of real-time monitoring on the factory floor. Unlike past studies that view fatigue as a dichotomous variable, our central formulation revolves around the ability to predict multilevel fatigue, providing a more nuanced understanding of the subject's physical state. Our multimodal sensing framework is designed for continuous monitoring of vital signs, including heart rate, heart rate variability, skin temperature, and more, as well as locomotive signs by employing inertial motion units strategically placed at six locations on the upper body. This comprehensive sensor placement allows us to capture detailed data from both the torso and arms, surpassing the capabilities of single-point data collection methods. We developed an innovative asymmetric loss function for our machine learning model, which enhances prediction accuracy for numerical fatigue levels and supports real-time inference. We collected data on 43 subjects following an authentic manufacturing protocol and logged their self-reported fatigue. Based on the analysis, we provide insights into our multilevel fatigue monitoring system and discuss results from an in-the-wild evaluation of actual operators on the factory floor. This study demonstrates our system's practical applicability and contributes a valuable open-access database for future research.
制造业工人面临长时间的高强度体力活动,由于工作相关的疲劳,这对他们的经济状况和健康都产生了影响。持续监测身体疲劳并提供有意义的反馈对于减少制造业工作场所的人力和金钱损失至关重要。本研究介绍了多模态可穿戴传感器和机器学习技术的一种新应用,用于量化身体疲劳并应对工厂车间实时监测的挑战。与过去将疲劳视为二分变量的研究不同,我们的核心公式围绕预测多级疲劳的能力展开,从而对受试者的身体状态有更细致入微的理解。我们的多模态传感框架旨在持续监测生命体征,包括心率、心率变异性、皮肤温度等,以及通过将惯性运动单元战略性地放置在上半身的六个位置来监测运动体征。这种全面的传感器布置使我们能够从躯干和手臂获取详细数据,超越了单点数据收集方法的能力。我们为机器学习模型开发了一种创新的不对称损失函数,它提高了对数值疲劳水平的预测准确性并支持实时推理。我们按照真实的制造协议收集了43名受试者的数据,并记录了他们自我报告的疲劳情况。基于分析,我们深入了解了我们的多级疲劳监测系统,并讨论了对工厂车间实际操作人员进行的现场评估结果。本研究展示了我们系统的实际适用性,并为未来研究贡献了一个有价值的开放获取数据库。