Khan Haroon, Khadka Rabindra, Sultan Malik Shahid, Yazidi Anis, Ombao Hernando, Mirtaheri Peyman
Department of Mechanical, Electronics and Chemical Engineering, OsloMet - Oslo Metropolitan University, Oslo, Norway.
Department of Information Technology, Oslomet - Oslo Metropolitan University, Oslo, Norway.
Front Hum Neurosci. 2024 Feb 16;18:1354143. doi: 10.3389/fnhum.2024.1354143. eCollection 2024.
In this study, we explore the potential of using functional near-infrared spectroscopy (fNIRS) signals in conjunction with modern machine-learning techniques to classify specific anatomical movements to increase the number of control commands for a possible fNIRS-based brain-computer interface (BCI) applications. The study focuses on novel individual finger-tapping, a well-known task in fNIRS and fMRI studies, but limited to left/right or few fingers. Twenty-four right-handed participants performed the individual finger-tapping task. Data were recorded by using sixteen sources and detectors placed over the motor cortex according to the 10-10 international system. The event's average oxygenated Δ HbO and deoxygenated Δ HbR hemoglobin data were utilized as features to assess the performance of diverse machine learning (ML) models in a challenging multi-class classification setting. These methods include LDA, QDA, MNLR, XGBoost, and RF. A new DL-based model named "Hemo-Net" has been proposed which consists of multiple parallel convolution layers with different filters to extract the features. This paper aims to explore the efficacy of using fNRIS along with ML/DL methods in a multi-class classification task. Complex models like RF, XGBoost, and Hemo-Net produce relatively higher test set accuracy when compared to LDA, MNLR, and QDA. Hemo-Net has depicted a superior performance achieving the highest test set accuracy of 76%, however, in this work, we do not aim at improving the accuracies of models rather we are interested in exploring if fNIRS has the neural signatures to help modern ML/DL methods in multi-class classification which can lead to applications like brain-computer interfaces. Multi-class classification of fine anatomical movements, such as individual finger movements, is difficult to classify with fNIRS data. Traditional ML models like MNLR and LDA show inferior performance compared to the ensemble-based methods of RF and XGBoost. DL-based method Hemo-Net outperforms all methods evaluated in this study and demonstrates a promising future for fNIRS-based BCI applications.
在本研究中,我们探索了结合使用功能性近红外光谱(fNIRS)信号与现代机器学习技术来对特定解剖运动进行分类的潜力,以增加用于基于fNIRS的脑机接口(BCI)应用的控制命令数量。该研究聚焦于新颖的单指敲击,这是fNIRS和功能磁共振成像(fMRI)研究中的一个知名任务,但仅限于左右或少数几根手指。24名右利手参与者执行了单指敲击任务。根据10-10国际系统,使用16个源和探测器放置在运动皮层上记录数据。事件的平均含氧血红蛋白ΔHbO和脱氧血红蛋白ΔHbR数据被用作特征,以评估各种机器学习(ML)模型在具有挑战性的多类分类设置中的性能。这些方法包括线性判别分析(LDA)、二次判别分析(QDA)、多项逻辑回归(MNLR)、极端梯度提升(XGBoost)和随机森林(RF)。已经提出了一种名为“Hemo-Net”的基于深度学习(DL)的新模型,它由具有不同滤波器的多个并行卷积层组成以提取特征。本文旨在探索在多类分类任务中使用fNRIS以及ML/DL方法的有效性。与LDA、MNLR和QDA相比,像RF、XGBoost和Hemo-Net这样的复杂模型产生相对更高的测试集准确率。Hemo-Net表现出卓越的性能,实现了76%的最高测试集准确率,然而,在这项工作中,我们的目标不是提高模型的准确率,而是探索fNIRS是否具有神经特征来帮助现代ML/DL方法进行多类分类,这可能会带来诸如脑机接口之类的应用。精细解剖运动的多类分类,如单指运动,使用fNIRS数据很难进行分类。与基于集成的RF和XGBoost方法相比,像MNLR和LDA这样的传统ML模型表现较差。基于DL的方法Hemo-Net优于本研究中评估的所有方法,并为基于fNIRS的BCI应用展示了广阔的前景。