Department of Computer Science, Texas State University, San Marcos, TX 78666, USA.
Sensors (Basel). 2023 Jan 18;23(3):1105. doi: 10.3390/s23031105.
Falls in the elderly are associated with significant morbidity and mortality. While numerous fall detection devices incorporating AI and machine learning algorithms have been developed, no known smartwatch-based system has been used successfully in real-time to detect falls for elderly persons. We have developed and deployed a SmartFall system on a commodity-based smartwatch which has been trialled by nine elderly participants. The system, while being usable and welcomed by the participants in our trials, has two serious limitations. The first limitation is the inability to collect a large amount of personalized data for training. When the fall detection model, which is trained with insufficient data, is used in the real world, it generates a large amount of false positives. The second limitation is the model drift problem. This means an accurate model trained using data collected with a specific device performs sub-par when used in another device. Therefore, building one model for each type of device/watch is not a scalable approach for developing smartwatch-based fall detection system. To tackle those issues, we first collected three datasets including accelerometer data for fall detection problem from different devices: the Microsoft watch (MSBAND), the Huawei watch, and the meta-sensor device. After that, a transfer learning strategy was applied to first explore the use of transfer learning to overcome the small dataset training problem for fall detection. We also demonstrated the use of transfer learning to generalize the model across the heterogeneous devices. Our preliminary experiments demonstrate the effectiveness of transfer learning for improving fall detection, achieving an F1 score higher by over 10% on average, an AUC higher by over 0.15 on average, and a smaller false positive prediction rate than the non-transfer learning approach across various datasets collected using different devices with different hardware specifications.
老年人跌倒与较高的发病率和死亡率相关。虽然已经开发出许多结合人工智能和机器学习算法的跌倒检测设备,但目前尚无已知的基于智能手表的系统能够成功实时检测老年人跌倒。我们已经开发并部署了一个基于商用智能手表的 SmartFall 系统,并对 9 名老年人参与者进行了试用。该系统虽然在我们的试验中具有可用性和受参与者欢迎,但存在两个严重的局限性。第一个局限性是无法收集大量个性化数据进行训练。当使用数据不足训练的跌倒检测模型在现实世界中使用时,会产生大量的误报。第二个局限性是模型漂移问题。这意味着使用特定设备收集的数据训练出的准确模型在另一个设备上使用时表现不佳。因此,为每种类型的设备/手表构建一个模型不是开发基于智能手表的跌倒检测系统的可扩展方法。为了解决这些问题,我们首先从不同设备(Microsoft watch[MSBAND]、Huawei watch 和 meta-sensor 设备)中收集了包括加速度计数据在内的三个数据集,用于跌倒检测问题。之后,应用了迁移学习策略,首先探索了迁移学习在解决跌倒检测中小数据集训练问题方面的应用。我们还展示了迁移学习在跨异构设备上推广模型的应用。我们的初步实验表明,迁移学习在提高跌倒检测方面是有效的,在各种数据集上的平均 F1 得分提高了 10%以上,平均 AUC 提高了 0.15 以上,并且假阳性预测率低于非迁移学习方法,而这些数据集是使用不同硬件规格的不同设备收集的。