Asgher Umer, Khalil Khurram, Khan Muhammad Jawad, Ahmad Riaz, Butt Shahid Ikramullah, Ayaz Yasar, Naseer Noman, Nazir Salman
School of Mechanical and Manufacturing Engineering (SMME), National University of Sciences and Technology (NUST), Islamabad, Pakistan.
Directorate of Quality Assurance and International Collaboration, National University of Sciences and Technology (NUST), Islamabad, Pakistan.
Front Neurosci. 2020 Jun 23;14:584. doi: 10.3389/fnins.2020.00584. eCollection 2020.
Cognitive workload is one of the widely invoked human factors in the areas of human-machine interaction (HMI) and neuroergonomics. The precise assessment of cognitive and mental workload (MWL) is vital and requires accurate neuroimaging to monitor and evaluate the cognitive states of the brain. In this study, we have decoded four classes of MWL using long short-term memory (LSTM) with 89.31% average accuracy for brain-computer interface (BCI). The brain activity signals are acquired using functional near-infrared spectroscopy (fNIRS) from the prefrontal cortex (PFC) region of the brain. We performed a supervised MWL experimentation with four varying MWL levels on 15 participants (both male and female) and 10 trials of each MWL per participant. Real-time four-level MWL states are assessed using fNIRS system, and initial classification is performed using three strong machine learning (ML) techniques, support vector machine (SVM), -nearest neighbor (-NN), and artificial neural network (ANN) with obtained average accuracies of 54.33, 54.31, and 69.36%, respectively. In this study, novel deep learning (DL) frameworks are proposed, which utilizes convolutional neural network (CNN) and LSTM with 87.45 and 89.31% average accuracies, respectively, to solve high-dimensional four-level cognitive states classification problem. Statistical analysis, -test, and one-way -test (ANOVA) are also performed on accuracies obtained through ML and DL algorithms. Results show that the proposed DL (LSTM and CNN) algorithms significantly improve classification performance as compared with ML (SVM, ANN, and -NN) algorithms.
认知工作量是人机交互(HMI)和神经工效学领域中广泛提及的人为因素之一。准确评估认知和心理工作量(MWL)至关重要,需要精确的神经成像来监测和评估大脑的认知状态。在本研究中,我们使用长短期记忆(LSTM)对四类MWL进行了解码,用于脑机接口(BCI)的平均准确率达到89.31%。大脑活动信号通过功能近红外光谱(fNIRS)从大脑前额叶皮层(PFC)区域获取。我们对15名参与者(包括男性和女性)进行了四种不同MWL水平的监督式MWL实验,每位参与者每种MWL水平进行10次试验。使用fNIRS系统评估实时四级MWL状态,并使用三种强大的机器学习(ML)技术进行初始分类,即支持向量机(SVM)、-最近邻(-NN)和人工神经网络(ANN),获得的平均准确率分别为54.33%、54.31%和69.36%。在本研究中,提出了新颖的深度学习(DL)框架,分别利用卷积神经网络(CNN)和LSTM,平均准确率分别为87.45%和89.31%,以解决高维四级认知状态分类问题。还对通过ML和DL算法获得的准确率进行了统计分析、-检验和单因素-检验(方差分析)。结果表明,与ML(SVM、ANN和-NN)算法相比,所提出的DL(LSTM和CNN)算法显著提高了分类性能。