Department of Engineering and Geology, University G. d'Annunzio of Chieti-Pescara, 65127 Pescara, Italy.
Department of Neurosciences, Imaging and Clinical Sciences, University G. d'Annunzio of Chieti-Pescara, 66100 Chieti, Italy.
Sensors (Basel). 2022 Sep 26;22(19):7300. doi: 10.3390/s22197300.
Mental workload (MW) represents the amount of brain resources required to perform concurrent tasks. The evaluation of MW is of paramount importance for Advanced Driver-Assistance Systems, given its correlation with traffic accidents risk. In the present research, two cognitive tests (Digit Span Test-DST and Ray Auditory Verbal Learning Test-RAVLT) were administered to participants while driving in a simulated environment. The tests were chosen to investigate the drivers' response to predefined levels of cognitive load to categorize the classes of MW. Infrared (IR) thermal imaging concurrently with heart rate variability (HRV) were used to obtain features related to the psychophysiology of the subjects, in order to feed machine learning (ML) classifiers. Six categories of models have been compared basing on unimodal IR/unimodal HRV/multimodal IR + HRV features. The best classifier performances were reached by the multimodal IR + HRV features-based classifiers (DST: accuracy = 73.1%, sensitivity = 0.71, specificity = 0.69; RAVLT: accuracy = 75.0%, average sensitivity = 0.75, average specificity = 0.87). The unimodal IR features based classifiers revealed high performances as well (DST: accuracy = 73.1%, sensitivity = 0.73, specificity = 0.73; RAVLT: accuracy = 71.1%, average sensitivity = 0.71, average specificity = 0.85). These results demonstrated the possibility to assess drivers' MW levels with high accuracy, also using a completely non-contact and non-invasive technique alone, representing a key advancement with respect to the state of the art in traffic accident prevention.
精神工作负荷(MW)表示执行并发任务所需的大脑资源量。鉴于其与交通事故风险的相关性,MW 的评估对于高级驾驶辅助系统至关重要。在本研究中,参与者在模拟环境中驾驶时进行了两项认知测试(数字跨度测试-DST 和 Ray 听觉言语学习测试-RAVLT)。选择这些测试是为了研究驾驶员对预定义认知负荷水平的反应,以对 MW 的类别进行分类。同时使用近红外(IR)热成像和心率变异性(HRV)来获取与受试者心理生理学相关的特征,以便为机器学习(ML)分类器提供信息。基于单模态 IR/单模态 HRV/多模态 IR+HRV 特征比较了六种模型类别。基于多模态 IR+HRV 特征的分类器达到了最佳的分类器性能(DST:准确率=73.1%,灵敏度=0.71,特异性=0.69;RAVLT:准确率=75.0%,平均灵敏度=0.75,平均特异性=0.87)。基于单模态 IR 特征的分类器也表现出了很高的性能(DST:准确率=73.1%,灵敏度=0.73,特异性=0.73;RAVLT:准确率=71.1%,平均灵敏度=0.71,平均特异性=0.85)。这些结果表明,即使仅使用完全非接触式和非侵入式技术,也有可能以高精度评估驾驶员的 MW 水平,这是在预防交通事故方面相对于现有技术的一项重大进展。