Stone Jason D, Ulman Hana K, Tran Kaylee, Thompson Andrew G, Halter Manuel D, Ramadan Jad H, Stephenson Mark, Finomore Victor S, Galster Scott M, Rezai Ali R, Hagen Joshua A
Rockefeller Neuroscience Institute, West Virginia University, Morgantown, WV, United States.
Department of Chemical and Biomedical Engineering, West Virginia University, Morgantown, WV, United States.
Front Sports Act Living. 2021 Mar 1;3:585870. doi: 10.3389/fspor.2021.585870. eCollection 2021.
Commercial off-the shelf (COTS) wearable devices continue development at unprecedented rates. An unfortunate consequence of their rapid commercialization is the lack of independent, third-party accuracy verification for reported physiological metrics of interest, such as heart rate (HR) and heart rate variability (HRV). To address these shortcomings, the present study examined the accuracy of seven COTS devices in assessing resting-state HR and root mean square of successive differences (rMSSD). Five healthy young adults generated 148 total trials, each of which compared COTS devices against a validation standard, multi-lead electrocardiogram (mECG). All devices accurately reported mean HR, according to absolute percent error summary statistics, although the highest mean absolute percent error (MAPE) was observed for CameraHRV (17.26%). The next highest MAPE for HR was nearly 15% less (HRV4Training, 2.34%). When measuring rMSSD, MAPE was again the highest for CameraHRV [112.36%, concordance correlation coefficient (CCC): 0.04], while the lowest MAPEs observed were from HRV4Training (4.10%; CCC: 0.98) and OURA (6.84%; CCC: 0.91). Our findings support extant literature that exposes varying degrees of veracity among COTS devices. To thoroughly address questionable claims from manufacturers, elucidate the accuracy of data parameters, and maximize the real-world applicative value of emerging devices, future research must continually evaluate COTS devices.
商用现货（COTS）可穿戴设备正以前所未有的速度持续发展。其迅速商业化带来的一个不幸后果是，对于所报告的诸如心率（HR）和心率变异性（HRV）等感兴趣的生理指标，缺乏独立的第三方准确性验证。为解决这些不足，本研究考察了七款COTS设备在评估静息心率和逐次差值均方根（rMSSD）方面的准确性。五名健康的年轻成年人共产生了148次试验，每次试验都将COTS设备与验证标准多导联心电图（mECG）进行比较。根据绝对百分比误差汇总统计，所有设备均准确报告了平均心率，不过CameraHRV的平均绝对百分比误差（MAPE）最高（17.26%）。心率方面的第二高MAPE低了近15%（HRV4Training，2.34%）。在测量rMSSD时，CameraHRV的MAPE再次最高[112.36%，一致性相关系数（CCC）：0.04]，而观察到的最低MAPE来自HRV4Training（4.10%；CCC：0.98）和OURA（6.84%；CCC：0.91）。我们的研究结果支持了现有文献中关于COTS设备准确性存在不同程度差异的观点。为了彻底解决制造商提出的可疑说法、阐明数据参数的准确性并最大化新兴设备的实际应用价值，未来的研究必须持续评估COTS设备。
