Worcester Polytechnic Institute, P.O. Box 1212, Worcester, MA 016091, United States of America.
Massachusetts Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139, United States of America.
J Neural Eng. 2021 Mar 8;18(3). doi: 10.1088/1741-2552/abd2ca.
. Understanding the cognitive load of drivers is crucial for road safety. Brain sensing has the potential to provide an objective measure of driver cognitive load. We aim to develop an advanced machine learning framework for classifying driver cognitive load using functional near-infrared spectroscopy (fNIRS).. We conducted a study using fNIRS in a driving simulator with the-back task used as a secondary task to impart structured cognitive load on drivers. To classify different driver cognitive load levels, we examined the application of convolutional autoencoder (CAE) and Echo State Network (ESN) autoencoder for extracting features from fNIRS.. By using CAE, the accuracies for classifying two and four levels of driver cognitive load with the 30 s window were 73.25% and 47.21%, respectively. The proposed ESN autoencoder achieved state-of-art classification results for group-level models without window selection, with accuracies of 80.61% and 52.45% for classifying two and four levels of driver cognitive load.. This work builds a foundation for using fNIRS to measure driver cognitive load in real-world applications. Also, the results suggest that the proposed ESN autoencoder can effectively extract temporal information from fNIRS data and can be useful for other fNIRS data classification tasks.
理解驾驶员的认知负荷对于道路安全至关重要。脑传感有潜力提供驾驶员认知负荷的客观测量。我们旨在开发一种先进的机器学习框架,使用功能近红外光谱 (fNIRS) 对驾驶员认知负荷进行分类。
我们在驾驶模拟器中使用 fNIRS 进行了一项研究,使用后向任务作为次要任务,给驾驶员施加结构化的认知负荷。为了对不同的驾驶员认知负荷水平进行分类,我们研究了卷积自动编码器 (CAE) 和回声状态网络 (ESN) 自动编码器在从 fNIRS 中提取特征方面的应用。
通过使用 CAE,在 30 秒窗口下对驾驶员认知负荷的两个和四个水平进行分类的准确率分别为 73.25%和 47.21%。所提出的 ESN 自动编码器在不进行窗口选择的情况下实现了群体水平模型的最新分类结果,对驾驶员认知负荷的两个和四个水平进行分类的准确率分别为 80.61%和 52.45%。
这项工作为在实际应用中使用 fNIRS 测量驾驶员认知负荷奠定了基础。此外,结果表明,所提出的 ESN 自动编码器可以有效地从 fNIRS 数据中提取时间信息,并且对于其他 fNIRS 数据分类任务可能很有用。