Systematic analysis and comparison of commercial seizure-detection software.

OBJECTIVE

To determine if three different commercially available seizure-detection software packages (Besa 2.0, Encevis 1.7, and Persyst 13) accurately detect seizures with high sensitivity, high specificity, and short detection delay in epilepsy patients undergoing long-term video-electroencephalography (EEG) monitoring (VEM).

METHODS

Comparison of sensitivity (detection rate), specificity (false alarm rate), and detection delay of three commercially available seizure-detection software packages in 81 randomly selected patients with epilepsy undergoing long-term VEM.

RESULTS

Detection rates on a per-patient basis were not significantly different between Besa (mean 67.6%, range 0-100%), Encevis (77.8%, 0-100%) and Persyst (81%, 0-100%; P = .059). False alarm rate (per hour) was significantly different between Besa (mean 0.7/h, range 0.01-6.2/h), Encevis (0.2/h, 0.01-0.5/h), and Persyst (0.9/h, 0.04-6.5/h; P < .001). Detection delay was significantly different between Besa (mean 30 s, range 0-431 s), Encevis (25 s, 2-163 s), and Persyst (20 s, 0-167 s; P = .007). Kappa statistics showed moderate to substantial agreement between the reference standard and each seizure-detection software (Besa: 0.47, 95% confidence interval [CI] 0.36-0.59; Encevis: 0.59, 95% CI 0.47-0.7; Persyst: 0.63, 95% CI 0.51-0.74).

SIGNIFICANCE

Three commercially available seizure-detection software packages showed similar, reasonable sensitivities on the same data set, but differed in false alarm rates and detection delay. Persyst 13 showed the highest detection rate and false alarm rate with the shortest detection delay, whereas Encevis 1.7 had a slightly lower sensitivity, the lowest false alarm rate, and longer detection delay.