IEEE Trans Neural Syst Rehabil Eng. 2023;31:3417-3427. doi: 10.1109/TNSRE.2023.3307481. Epub 2023 Aug 29.
Mental workload can be monitored in real time, which helps us improve work efficiency by maintaining an appropriate workload level. Based on previous studies, we have known that features, such as band power and brain connectivity, can be utilized to classify the levels of mental workload. As band power and brain connectivity represent different but complementary information related to mental workload, it is helpful to integrate them together for workload classification. Although deep learning models have been utilized for workload classification based on EEG, the classification performance is not satisfactory. This is because the current models cannot well tackle variances in the features extracted from non-stationary EEG. In order to address this problem, we, in this study, proposed a novel deep learning model, called latent space coding capsule network (LSCCN). The features of band power and brain connectivity were fused and then modelled in a latent space. The subsequent convolutional and capsule modules were used for workload classification. The proposed LSCCN was compared to the state-of-the-art methods. The results demonstrated that the proposed LSCCN was superior to the compared methods. LSCCN achieved a higher testing accuracy with a relatively smaller standard deviation, indicating a more reliable classification across participants. In addition, we explored the distribution of the features and found that top discriminative features were localized in the frontal, parietal, and occipital regions. This study not only provides a novel deep learning model but also informs further studies in workload classification and promotes practical usage of workload monitoring.
可以实时监测脑力负荷,这有助于我们通过保持适当的工作负荷水平来提高工作效率。基于先前的研究,我们已经知道,频带功率和大脑连通性等特征可用于对脑力负荷水平进行分类。由于频带功率和大脑连通性代表与脑力负荷相关的不同但互补的信息,因此将它们整合在一起进行工作负荷分类是有帮助的。尽管已经基于 EEG 利用深度学习模型进行了工作负荷分类,但分类性能并不理想。这是因为当前的模型无法很好地解决从非平稳 EEG 中提取的特征的变异性。为了解决这个问题,我们在这项研究中提出了一种新的深度学习模型,称为潜在空间编码胶囊网络(LSCCN)。频带功率和大脑连通性的特征被融合并在潜在空间中建模。随后的卷积和胶囊模块用于工作负荷分类。将所提出的 LSCCN 与最先进的方法进行了比较。结果表明,所提出的 LSCCN 优于比较方法。LSCCN 在相对较小的标准偏差下实现了更高的测试精度,表明在参与者之间具有更可靠的分类。此外,我们还探索了特征的分布,发现具有区分能力的特征主要集中在前额、顶叶和枕叶区域。这项研究不仅提供了一种新的深度学习模型,还为工作负荷分类的进一步研究提供了信息,并促进了工作负荷监测的实际应用。