Zhang Yao, Liu Dongyuan, Gao Feng
School of Precision Instrument and Optoelectronics Engineering, Tianjin University, Tianjin 300072, P. R. China.
Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin 300072, P. R. China.
Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2024 Aug 25;41(4):673-683. doi: 10.7507/1001-5515.202310002.
In the field of brain-computer interfaces (BCIs) based on functional near-infrared spectroscopy (fNIRS), traditional subject-specific decoding methods suffer from the limitations of long calibration time and low cross-subject generalizability, which restricts the promotion and application of BCI systems in daily life and clinic. To address the above dilemma, this study proposes a novel deep transfer learning approach that combines the revised inception-residual network (rIRN) model and the model-based transfer learning (TL) strategy, referred to as TL-rIRN. This study performed cross-subject recognition experiments on mental arithmetic (MA) and mental singing (MS) tasks to validate the effectiveness and superiority of the TL-rIRN approach. The results show that the TL-rIRN significantly shortens the calibration time, reduces the training time of the target model and the consumption of computational resources, and dramatically enhances the cross-subject decoding performance compared to subject-specific decoding methods and other deep transfer learning methods. To sum up, this study provides a basis for the selection of cross-subject, cross-task, and real-time decoding algorithms for fNIRS-BCI systems, which has potential applications in constructing a convenient and universal BCI system.
在基于功能近红外光谱(fNIRS)的脑机接口(BCI)领域,传统的针对特定个体的解码方法存在校准时间长和跨个体通用性低的局限性,这限制了BCI系统在日常生活和临床中的推广与应用。为了解决上述困境,本研究提出了一种新颖的深度迁移学习方法,该方法将改进的初始残差网络(rIRN)模型与基于模型的迁移学习(TL)策略相结合,称为TL-rIRN。本研究对心算(MA)和心理歌唱(MS)任务进行了跨个体识别实验,以验证TL-rIRN方法的有效性和优越性。结果表明,与针对特定个体的解码方法和其他深度迁移学习方法相比,TL-rIRN显著缩短了校准时间,减少了目标模型的训练时间和计算资源消耗,并显著提高了跨个体解码性能。综上所述,本研究为fNIRS-BCI系统选择跨个体、跨任务和实时解码算法提供了依据,在构建便捷通用的BCI系统方面具有潜在应用价值。