Brew Bruce, Faux Steven G, Blanchard Elizabeth
Department of Neurology, St Vincent's Hospital, Sydney, Australia.
University of New South Wales, Sydney, Australia.
JMIR Form Res. 2022 Mar 21;6(3):e30121. doi: 10.2196/30121.
Older adults are at an increased risk of falls with the consequent impacts on the health of the individual and health expenditure for the population. Smartwatch apps have been developed to detect a fall, but their sensitivity and specificity have not been subjected to blinded assessment nor have the factors that influence the effectiveness of fall detection been fully identified.
This study aims to assess accuracy metrics for a novel fall detection smartwatch algorithm.
We performed a cross-sectional study of 22 healthy adults comparing the detection of induced forward, side (left and right), and backward falls and near falls provided by a smartwatch threshold-based algorithm, with a video record of induced falls serving as the gold standard; a blinded assessor compared the two. Three different smartwatches with two different operating systems were used. There were 226 falls: 64 were backward, 51 forward, 55 left sided, and 56 right sided.
The overall smartwatch app sensitivity for falls was 77%, the specificity was 99%, the false-positive rate was 1.7%, and the false-negative rate was 16.4%. The positive and negative predictive values were 98% and 84%, respectively, while the accuracy was 89%. There were 249 near falls: the sensitivity was 89%, the specificity was 100%, there were no false positives, 11% were false negatives, the positive predictive value was 100%, the false-negative predictive value was 83%, and the accuracy was 93%.
Falls were more likely to be detected if the fall was on the same side as the wrist with the smartwatch. There was a trend toward some smartwatches and operating systems having superior sensitivity, but these did not reach statistical significance. The effectiveness data and modifying factors pertaining to this smartwatch app can serve as a reference point for other similar smartwatch apps.
老年人跌倒风险增加,这会对个人健康及人群医疗支出产生影响。已开发出智能手表应用程序来检测跌倒,但它们的敏感性和特异性尚未经过盲法评估,影响跌倒检测有效性的因素也未被完全识别。
本研究旨在评估一种新型跌倒检测智能手表算法的准确性指标。
我们对22名健康成年人进行了一项横断面研究,将基于智能手表阈值算法检测到的向前、向侧面(左侧和右侧)及向后跌倒和接近跌倒情况,与作为金标准的跌倒诱导视频记录进行比较;由一名盲法评估者对二者进行比较。使用了三款不同的智能手表,搭载两种不同的操作系统。共发生226次跌倒:向后跌倒64次,向前跌倒51次,左侧跌倒55次,右侧跌倒56次。
智能手表应用程序对跌倒检测的总体敏感性为77%,特异性为99%,假阳性率为1.7%,假阴性率为16.4%。阳性预测值和阴性预测值分别为98%和84%,而准确率为89%。共发生249次接近跌倒:敏感性为89%,特异性为100%,无假阳性,11%为假阴性,阳性预测值为100%,阴性预测值为83%,准确率为93%。
如果跌倒发生在佩戴智能手表的手腕同侧,则更有可能被检测到。某些智能手表和操作系统有敏感性更高的趋势,但未达到统计学显著性。与该智能手表应用程序相关的有效性数据和修正因素可为其他类似智能手表应用程序提供参考。