Centre for Computational Engineering Sciences, Cranfield University, Cranfield MK43 0AL, UK.
Machine Learning and Data Analytics Laboratory, Digital Aviation Research and Technology Centre (DARTeC), Cranfield University, Cranfield MK43 0AL, UK.
Sensors (Basel). 2023 Nov 8;23(22):9052. doi: 10.3390/s23229052.
Predicting pilots' mental states is a critical challenge in aviation safety and performance, with electroencephalogram data offering a promising avenue for detection. However, the interpretability of machine learning and deep learning models, which are often used for such tasks, remains a significant issue. This study aims to address these challenges by developing an interpretable model to detect four mental states-channelised attention, diverted attention, startle/surprise, and normal state-in pilots using EEG data. The methodology involves training a convolutional neural network on power spectral density features of EEG data from 17 pilots. The model's interpretability is enhanced via the use of SHapley Additive exPlanations values, which identify the top 10 most influential features for each mental state. The results demonstrate high performance in all metrics, with an average accuracy of 96%, a precision of 96%, a recall of 94%, and an F1 score of 95%. An examination of the effects of mental states on EEG frequency bands further elucidates the neural mechanisms underlying these states. The innovative nature of this study lies in its combination of high-performance model development, improved interpretability, and in-depth analysis of the neural correlates of mental states. This approach not only addresses the critical need for effective and interpretable mental state detection in aviation but also contributes to our understanding of the neural underpinnings of these states. This study thus represents a significant advancement in the field of EEG-based mental state detection.
预测飞行员的心理状态是航空安全和性能的关键挑战,脑电图数据为检测提供了有前途的途径。然而,机器学习和深度学习模型的可解释性仍然是一个重大问题,这些模型通常用于此类任务。本研究旨在通过开发一种可解释的模型来解决这些挑战,该模型使用脑电图数据检测飞行员的四种心理状态——集中注意力、分散注意力、惊跳/惊讶和正常状态。该方法涉及在 17 名飞行员的脑电图数据的功率谱密度特征上训练卷积神经网络。通过使用 Shapley Additive exPlanations 值来增强模型的可解释性,该值确定了每个心理状态的前 10 个最有影响力的特征。结果表明,在所有指标中都表现出了很高的性能,平均准确率为 96%,精确率为 96%,召回率为 94%,F1 得分为 95%。进一步检查心理状态对脑电图频带的影响,阐明了这些状态的神经机制。这项研究的创新性在于它结合了高性能模型的开发、可解释性的提高以及对心理状态的神经相关性的深入分析。这种方法不仅满足了航空领域中有效和可解释的心理状态检测的迫切需求,还有助于我们理解这些状态的神经基础。因此,这项研究代表了脑电图基心理状态检测领域的重大进展。