Pan Yudong, Li Ning, Zhang Yangsong, Xu Peng, Yao Dezhong
School of Computer Science and Technology, Laboratory for Brain Science and Medical Artificial Intelligence, Southwest University of Science and Technology, Mianyang, 621010 China.
Key Laboratory of Testing Technology for Manufacturing Process, Ministry of Education, Southwest University of Science and Technology, Mianyang, 621010 China.
Cogn Neurodyn. 2024 Oct;18(5):2925-2945. doi: 10.1007/s11571-024-10134-9. Epub 2024 May 31.
Steady-state visual evoked potentials (SSVEPs) based brain-computer interface (BCI) has received considerable attention due to its high information transfer rate (ITR) and available quantity of targets. However, the performance of frequency identification methods heavily hinges on the amount of user calibration data and data length, which hinders the deployment in real-world applications. Recently, generative adversarial networks (GANs)-based data generation methods have been widely adopted to create synthetic electroencephalography data, holds promise to address these issues. In this paper, we proposed a GAN-based end-to-end signal transformation network for Time-window length Extension, termed as TEGAN. TEGAN transforms short-length SSVEP signals into long-length artificial SSVEP signals. Additionally, we introduced a two-stage training strategy and the LeCam-divergence regularization term to regularize the training process of GAN during the network implementation. The proposed TEGAN was evaluated on two public SSVEP datasets (a 4-class and 12-class dataset). With the assistance of TEGAN, the performance of traditional frequency recognition methods and deep learning-based methods have been significantly improved under limited calibration data. And the classification performance gap of various frequency recognition methods has been narrowed. This study substantiates the feasibility of the proposed method to extend the data length for short-time SSVEP signals for developing a high-performance BCI system. The proposed GAN-based methods have the great potential of shortening the calibration time and cutting down the budget for various real-world BCI-based applications.
基于稳态视觉诱发电位(SSVEP)的脑机接口(BCI)因其高信息传输率(ITR)和可用目标数量而受到了广泛关注。然而,频率识别方法的性能在很大程度上取决于用户校准数据的数量和数据长度,这阻碍了其在实际应用中的部署。最近,基于生成对抗网络(GAN)的数据生成方法已被广泛用于创建合成脑电图数据,有望解决这些问题。在本文中,我们提出了一种基于GAN的用于时间窗口长度扩展的端到端信号转换网络,称为TEGAN。TEGAN将短长度的SSVEP信号转换为长长度的人工SSVEP信号。此外,我们引入了两阶段训练策略和LeCam散度正则化项,以在网络实现过程中对GAN的训练过程进行正则化。我们在两个公开的SSVEP数据集(一个4类和一个12类数据集)上对所提出的TEGAN进行了评估。在TEGAN的帮助下,传统频率识别方法和基于深度学习的方法在有限的校准数据下的性能得到了显著提高。并且各种频率识别方法的分类性能差距也得到了缩小。本研究证实了所提出的方法对于扩展短时SSVEP信号的数据长度以开发高性能BCI系统的可行性。所提出的基于GAN的方法在缩短校准时间和降低各种基于BCI的实际应用预算方面具有巨大潜力。