Daluwatte Chathuri, Vicente Jose, Galeotti Loriano, Johannesen Lars, Strauss David G, Scully Christopher G
Office of Science and Engineering Laboratories, CDRH, US FDA, Silver Spring, MD, USA.
Office of New Drugs, CDER, US FDA, Silver Spring, MD, USA.
J Electrocardiol. 2018 Jan-Feb;51(1):68-73. doi: 10.1016/j.jelectrocard.2017.08.030. Epub 2017 Sep 1.
Performance of ECG beat detectors is traditionally assessed on long intervals (e.g.: 30min), but only incorrect detections within a short interval (e.g.: 10s) may cause incorrect (i.e., missed+false) heart rate limit alarms (tachycardia and bradycardia). We propose a novel performance metric based on distribution of incorrect beat detection over a short interval and assess its relationship with incorrect heart rate limit alarm rates.
Six ECG beat detectors were assessed using performance metrics over long interval (sensitivity and positive predictive value over 30min) and short interval (Area Under empirical cumulative distribution function (AUecdf) for short interval (i.e., 10s) sensitivity and positive predictive value) on two ECG databases. False heart rate limit and asystole alarm rates calculated using a third ECG database were then correlated (Spearman's rank correlation) with each calculated performance metric.
False alarm rates correlated with sensitivity calculated on long interval (i.e., 30min) (ρ=-0.8 and p<0.05) and AUecdf for sensitivity (ρ=0.9 and p<0.05) in all assessed ECG databases. Sensitivity over 30min grouped the two detectors with lowest false alarm rates while AUecdf for sensitivity provided further information to identify the two beat detectors with highest false alarm rates as well, which was inseparable with sensitivity over 30min.
Short interval performance metrics can provide insights on the potential of a beat detector to generate incorrect heart rate limit alarms.
传统上,心电图心搏检测算法的性能是在较长时间间隔(如30分钟)上进行评估的,但只有短时间间隔(如10秒)内的错误检测才可能导致错误的(即漏检+误检)心率限制警报(心动过速和心动过缓)。我们提出了一种基于短时间间隔内错误心搏检测分布的新型性能指标,并评估其与错误心率限制警报率的关系。
在两个心电图数据库上,使用长时间间隔性能指标(30分钟内的灵敏度和阳性预测值)和短时间间隔性能指标(短时间间隔(即10秒)灵敏度和阳性预测值的经验累积分布函数下面积(AUecdf))对六种心电图心搏检测算法进行评估。然后,使用第三个心电图数据库计算的错误心率限制和心搏停止警报率与每个计算出的性能指标进行相关性分析(Spearman等级相关性)。
在所有评估的心电图数据库中,误报率与长时间间隔(即30分钟)计算的灵敏度(ρ=-0.8,p<0.05)和灵敏度的AUecdf(ρ=0.9,p<0.05)相关。30分钟内的灵敏度将误报率最低的两种检测算法归为一组,而灵敏度的AUecdf也提供了进一步的信息来识别误报率最高的两种心搏检测算法,这与30分钟内的灵敏度是分不开的。
短时间间隔性能指标可以深入了解心搏检测算法产生错误心率限制警报的可能性。