Intheon, La Jolla, CA, United States of America.
J Neural Eng. 2024 Sep 6;21(5). doi: 10.1088/1741-2552/ad731b.
Functional near-infrared spectroscopy (fNIRS) can measure neural activity through blood oxygenation changes in the brain in a wearable form factor, enabling unique applications for research in and outside the lab and in practical occupational settings. fNIRS has proven capable of measuring cognitive states such as mental workload, often using machine learning (ML) based brain-computer interfaces (BCIs). To date, this research has largely relied on probes with channel counts from under ten to several hundred, although recently a new class of wearable NIRS devices featuring thousands of channels has emerged. This poses unique challenges for ML classification, as fNIRS is typically limited by few training trials which results in severely under-determined estimation problems. So far, it is not well understood how such high-resolution data is best leveraged in practical BCIs and whether state-of-the-art or better performance can be achieved.To address these questions, we propose an ML strategy to classify working-memory load that relies on spatio-temporal regularization and transfer learning from other subjects in a combination that, to our knowledge, has not been used in previous fNIRS BCIs. The approach can be interpreted as an end-to-end generalized linear model and allows for a high degree of interpretability using channel-level or cortical imaging approaches.We show that using the proposed methodology, it is possible to achieve state-of-the-art decoding performance with high-resolution fNIRS data. We also replicated several state-of-the-art approaches on our dataset of 43 participants wearing a 3198 dual-channel NIRS device while performing the-Back task and show that these existing methodologies struggle in the high-channel regime and are largely outperformed by the proposed pipeline.Our approach helps establish high-channel NIRS devices as a viable platform for state-of-the-art BCI and opens new applications using this class of headset while also enabling high-resolution model imaging and interpretation.
功能性近红外光谱(fNIRS)可以通过穿戴式设备测量大脑血氧变化来测量神经活动,为实验室内外的研究和实际职业环境中的应用提供独特的机会。fNIRS 已经证明能够测量认知状态,例如心理工作量,通常使用基于机器学习(ML)的脑机接口(BCI)。迄今为止,这项研究主要依赖于通道计数从不到十个到几百个的探头,尽管最近出现了一种新的具有数千个通道的可穿戴式 NIRS 设备。这对 ML 分类提出了独特的挑战,因为 fNIRS 通常受到训练试验次数少的限制,这导致估计问题严重不足。到目前为止,人们还不太清楚如何在实际的 BCI 中最好地利用这种高分辨率数据,以及是否可以实现最先进的或更好的性能。为了解决这些问题,我们提出了一种基于 ML 的工作记忆负荷分类策略,该策略依赖于时空正则化和从其他受试者的转移学习,这种组合在我们的知识范围内尚未在以前的 fNIRS BCI 中使用过。该方法可以被解释为一个端到端的广义线性模型,并允许使用通道级或皮质成像方法进行高度可解释性。我们表明,使用所提出的方法,可以使用高分辨率 fNIRS 数据实现最先进的解码性能。我们还在我们的数据集上复制了几个最先进的方法,该数据集由 43 名参与者佩戴 3198 个双通道 NIRS 设备执行 Back 任务,并表明这些现有的方法在高通道状态下存在困难,并且在很大程度上被提出的管道所超越。我们的方法有助于确立高通道 NIRS 设备作为最先进的 BCI 的可行平台,并为使用此类耳机的新应用开辟了道路,同时还实现了高分辨率模型成像和解释。