Action prediction based on anticipatory brain potentials during simulated driving.

OBJECTIVE

The ability of an automobile to infer the driver's upcoming actions directly from neural signals could enrich the interaction of the car with its driver. Intelligent vehicles fitted with an on-board brain-computer interface able to decode the driver's intentions can use this information to improve the driving experience. In this study we investigate the neural signatures of anticipation of specific actions, namely braking and accelerating.

APPROACH

We investigated anticipatory slow cortical potentials in electroencephalogram recorded from 18 healthy participants in a driving simulator using a variant of the contingent negative variation (CNV) paradigm with Go and No-go conditions: count-down numbers followed by 'Start'/'Stop' cue. We report decoding performance before the action onset using a quadratic discriminant analysis classifier based on temporal features.

MAIN RESULTS

(i) Despite the visual and driving related cognitive distractions, we show the presence of anticipatory event related potentials locked to the stimuli onset similar to the widely reported CNV signal (with an average peak value of -8 μV at electrode Cz). (ii) We demonstrate the discrimination between cases requiring to perform an action upon imperative subsequent stimulus (Go condition, e.g. a 'Red' traffic light) versus events that do not require such action (No-go condition; e.g. a 'Yellow' light); with an average single trial classification performance of 0.83 ± 0.13 for braking and 0.79 ± 0.12 for accelerating (area under the curve). (iii) We show that the centro-medial anticipatory potentials are observed as early as 320 ± 200 ms before the action with a detection rate of 0.77 ± 0.12 in offline analysis.

SIGNIFICANCE

We show for the first time the feasibility of predicting the driver's intention through decoding anticipatory related potentials during simulated car driving with high recognition rates.