Alsuradi Haneen, Hong Joseph, Sarmadi Alireza, Volcic Robert, Salam Hanan, Atashzar S Farokh, Khorrami Farshad, Eid Mohamad
Engineering DivisionNew York University Abu Dhabi Abu Dhabi 129188 UAE.
Department of Electrical and Computer EngineeringNew York University New York NY 10012 USA.
IEEE Open J Eng Med Biol. 2025 Feb 3;6:305-311. doi: 10.1109/OJEMB.2025.3537760. eCollection 2025.
Human movement augmentation through supernumerary effectors is an emerging field of research. However, controlling these effectors remains challenging due to issues with agency, control, and synchronizing movements with natural limbs. A promising control strategy for supernumerary effectors involves utilizing electroencephalography (EEG) through motor imagery (MI) functions. In this work, we investigate whether MI activity associated with a supernumerary effector could be reliably differentiated from that of a natural one, thus addressing the concern of concurrency. Twenty subjects were recruited to participate in a two-fold experiment in which they observed movements of natural and supernumerary thumbs, then engaged in MI of the observed movements, conducted in a virtual reality setting. A lightweight deep-learning model that accounts for the temporal, spatial and spectral nature of the EEG data is proposed and called BandFocusNet, achieving an average classification accuracy of 70.9% using the leave-one-subject-out cross validation method. The trustworthiness of the model is examined through explainability analysis, and influential regions-of-interests are cross-validated through event-related-spectral-perturbation (ERSPs) analysis. Explainability results showed the importance of the right and left frontal cortical regions, and ERSPs analysis showed an increase in the delta and theta powers in these regions during the MI of the natural thumb but not during the MI of the supernumerary thumb. Evidence in the literature indicates that such activation is observed during the MI of natural effectors, and its absence could be interpreted as a lack of embodiment of the supernumerary thumb.
通过额外效应器增强人体运动是一个新兴的研究领域。然而,由于代理、控制以及与自然肢体运动同步等问题,控制这些效应器仍然具有挑战性。一种有前景的额外效应器控制策略涉及通过运动想象(MI)功能利用脑电图(EEG)。在这项工作中,我们研究与额外效应器相关的MI活动是否能与自然效应器的MI活动可靠区分,从而解决并发问题。招募了20名受试者参与一项双重实验,在虚拟现实环境中,他们先观察自然拇指和额外拇指的运动,然后对观察到的运动进行MI。提出了一种考虑EEG数据的时间、空间和频谱特性的轻量级深度学习模型,称为BandFocusNet,使用留一法交叉验证方法实现了70.9%的平均分类准确率。通过可解释性分析检验模型的可信度,并通过事件相关频谱扰动(ERSPs)分析对有影响的感兴趣区域进行交叉验证。可解释性结果显示了左右额叶皮质区域的重要性,ERSPs分析显示在自然拇指的MI过程中这些区域的δ和θ功率增加,而在额外拇指的MI过程中没有增加。文献中的证据表明,在自然效应器的MI过程中会观察到这种激活,而其缺失可解释为额外拇指缺乏具身性。