Engineering Division, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi 129188, United Arab Emirates.
J Neural Eng. 2023 Sep 29;20(5). doi: 10.1088/1741-2552/acfbf9.
. Single-trial electroencephalography (EEG) classification is a promising approach to evaluate the cognitive experience associated with haptic feedback. Convolutional neural networks (CNNs), which are among the most widely used deep learning techniques, have demonstrated their effectiveness in extracting EEG features for the classification of different cognitive functions, including the perception of vibration intensity that is often experienced during human-computer interaction. This paper proposes a novel CNN ensemble model to classify the vibration-intensity from a single trial EEG data that outperforms the state-of-the-art EEG models.. The proposed ensemble model, named SE NexFusion, builds upon the observed complementary learning behaviors of the EEGNex and TCNet Fusion models, exhibited in learning personal as well generic neural features associated with vibration intensity. The proposed ensemble employs multi-branch feature encoders corroborated with squeeze-and-excitation units that enables rich-feature encoding while at the same time recalibrating the weightage of the obtained feature maps based on their discriminative power. The model takes in a single trial of raw EEG as an input and does not require complex EEG signal-preprocessing.. The proposed model outperforms several state-of-the-art bench-marked EEG models by achieving an average accuracy of 60.7% and 61.6% under leave-one-subject-out and within-subject cross-validation (three-classes), respectively. We further validate the robustness of the model through Shapley values explainability method, where the most influential spatio-temporal features of the model are counter-checked with the neural correlates that encode vibration intensity.. Results show that SE NexFusion outperforms other benchmarked EEG models in classifying the vibration intensity. Additionally, explainability analysis confirms the robustness of the model in attending to features associated with the neural correlates of vibration intensity.
. 单试脑电 (EEG) 分类是评估与触觉反馈相关的认知体验的一种很有前途的方法。卷积神经网络 (CNN) 是应用最广泛的深度学习技术之一,已证明其在提取 EEG 特征以分类不同认知功能方面的有效性,包括在人机交互中经常体验到的振动强度感知。本文提出了一种新的 CNN 集成模型,用于对单试 EEG 数据进行振动强度分类,优于最先进的 EEG 模型。所提出的集成模型名为 SE NexFusion,它基于 EEGNex 和 TCNet Fusion 模型在学习与振动强度相关的个人和通用神经特征方面观察到的互补学习行为。所提出的集成模型采用多分支特征编码器,并辅以挤压激励单元,能够在丰富特征编码的同时,根据其判别能力重新校准获得的特征图的权重。该模型以单试原始 EEG 作为输入,不需要复杂的 EEG 信号预处理。该模型在留一受试者外和受试者内交叉验证(三类)下的平均准确率分别达到 60.7%和 61.6%,优于几种最先进的基准 EEG 模型。我们进一步通过 Shapley 值可解释性方法验证了模型的稳健性,其中模型的最具影响力的时空特征与编码振动强度的神经相关性进行了核对。结果表明,SE NexFusion 在分类振动强度方面优于其他基准 EEG 模型。此外,可解释性分析证实了模型在关注与振动强度的神经相关性相关的特征方面的稳健性。