Wang Fufeng, Luo Zihe, Lv Wei, Zhu XiaoLin
School of Big Data, Zhuhai College of Science and Technology, Zhuhai, China.
Front Comput Neurosci. 2025 Jul 9;19:1627819. doi: 10.3389/fncom.2025.1627819. eCollection 2025.
ECoG signals are widely used in Brain-Computer Interfaces (BCIs) due to their high spatial resolution and superior signal quality, particularly in the field of neural control. ECoG enables more accurate decoding of brain activity compared to traditional EEG. By obtaining cortical ECoG signals directly from the cerebral cortex, complex motor commands, such as finger movement trajectories, can be decoded more efficiently. However, existing studies still face significant challenges in accurately decoding finger movement trajectories. Specifically, current models tend to confuse the movement information of different fingers and fail to fully exploit the dependencies within time series when predicting long sequences, resulting in limited decoding performance. To address these challenges, this paper proposes a novel decoding method that transforms 2D ECoG data samples into 3D spatio-temporal spectrograms with time-stamped features via wavelet transform. The method further enables accurate decoding of finger bending by using a 1D convolutional network composed of Dilated-Transposed convolution, which together extract channel band features and temporal variations in tandem. The proposed method achieved the best performance among three subjects in BCI Competition IV. Compared with existing studies, our method made the correlation coefficient between the predicted multi-finger motion trajectory and the actual multi-finger motion trajectory exceed 80% for the first time, with the highest correlation coefficient reaching 82%. This approach provides new insights and solutions for high-precision decoding of brain-machine signals, particularly in precise command control tasks, and advances the application of BCI systems in real-world neuroprosthetic control.
由于具有高空间分辨率和卓越的信号质量,脑皮层电图(ECoG)信号在脑机接口(BCI)中被广泛应用,尤其是在神经控制领域。与传统脑电图相比,ECoG能够更准确地解码大脑活动。通过直接从大脑皮层获取皮层ECoG信号,可以更高效地解码复杂的运动指令,如手指运动轨迹。然而,现有研究在准确解码手指运动轨迹方面仍面临重大挑战。具体而言,当前模型往往会混淆不同手指的运动信息,并且在预测长序列时未能充分利用时间序列内的依赖性,导致解码性能有限。为应对这些挑战,本文提出了一种新颖的解码方法,该方法通过小波变换将二维ECoG数据样本转换为具有时间戳特征的三维时空频谱图。该方法还通过使用由扩张转置卷积组成的一维卷积网络,实现了对手指弯曲的准确解码,该网络共同串联提取通道频段特征和时间变化。所提出的方法在BCI竞赛IV的三个受试者中取得了最佳性能。与现有研究相比,我们的方法首次使预测的多手指运动轨迹与实际多手指运动轨迹之间的相关系数超过80%,最高相关系数达到82%。这种方法为脑机信号的高精度解码提供了新的见解和解决方案,特别是在精确命令控制任务中,并推动了BCI系统在现实世界神经假体控制中的应用。