Hou Xianda, Iacobacci Carrina, Card Nicholas S, Wairagkar Maitreyee, Singer-Clark Tyler, Kunz Erin M, Fan Chaofei, Kamdar Foram, Hahn Nick, Hochberg Leigh R, Henderson Jaimie M, Willett Francis R, Brandman David M, Stavisky Sergey D
Department of Neurological Surgery, University of California, Davis, Davis, CA, USA.
Computer Science Graduate Group, University of California, Davis, Davis, CA, USA.
bioRxiv. 2025 Jun 8:2025.06.07.658426. doi: 10.1101/2025.06.07.658426.
Humans monitor their actions, including detecting errors during speech production. This self-monitoring capability also enables speech neuroprosthesis users to recognize mistakes in decoded output upon receiving visual or auditory feedback. However, it remains unknown whether neural activity related to error detection is present in the speech motor cortex. In this study, we demonstrate the existence of neural error signals in speech motor cortex firing rates during intracortical brain-to-text speech neuroprosthesis use. This activity could be decoded to enable the neuroprosthesis to identify its own errors with up to 86% accuracy. Additionally, we observed distinct neural patterns associated with specific types of mistakes, such as phonemic or semantic differences between the person's intended and displayed words. These findings reveal how feedback errors are represented within the speech motor cortex, and suggest strategies for leveraging these additional cognitive signals to improve neuroprostheses.
人类会监控自己的行为,包括在言语产生过程中检测错误。这种自我监控能力也使言语神经假体的使用者在收到视觉或听觉反馈时,能够识别解码输出中的错误。然而,与错误检测相关的神经活动是否存在于言语运动皮层中仍不清楚。在本研究中,我们证明了在使用脑内脑到文本言语神经假体期间,言语运动皮层放电率中存在神经错误信号。这种活动可以被解码,使神经假体能够以高达86%的准确率识别自身错误。此外,我们观察到与特定类型错误相关的不同神经模式,例如人的意图词和显示词之间的音素或语义差异。这些发现揭示了言语运动皮层中反馈错误是如何被表征的,并提出了利用这些额外认知信号来改进神经假体的策略。