Department of Health Science and Technology, Aalborg University, Aalborg, Denmark.
Department of Bioengineering, Faculty of Engineering, Imperial College London, London, SW7 2AZ, UK.
Sci Rep. 2023 Aug 1;13(1):12461. doi: 10.1038/s41598-023-38753-y.
Bidirectional human-machine interfaces involve commands from the central nervous system to an external device and feedback characterizing device state. Such feedback may be elicited by electrical stimulation of somatosensory nerves, where a task-relevant variable is encoded in stimulation amplitude or frequency. Recently, concurrent modulation in amplitude and frequency (multimodal encoding) was proposed. We hypothesized that feedback with multimodal encoding may effectively be processed by the central nervous system as two independent inputs encoded in amplitude and frequency, respectively, thereby increasing state estimate quality in accordance with maximum-likelihood estimation. Using an adaptation paradigm, we tested this hypothesis during a grasp force matching task where subjects received electrotactile feedback encoding instantaneous force in amplitude, frequency, or both, in addition to their natural force feedback. The results showed that adaptations in grasp force with multimodal encoding could be accurately predicted as the integration of three independent inputs according to maximum-likelihood estimation: amplitude modulated electrotactile feedback, frequency modulated electrotactile feedback, and natural force feedback (r = 0.73). These findings show that multimodal electrotactile feedback carries an intrinsic advantage for state estimation accuracy with respect to single-variable modulation and suggest that this scheme should be the preferred strategy for bidirectional human-machine interfaces with electrotactile feedback.
双向人机接口涉及来自中枢神经系统到外部设备的命令以及表征设备状态的反馈。这种反馈可以通过对躯体感觉神经进行电刺激来引出,其中与任务相关的变量被编码在刺激幅度或频率中。最近,提出了幅度和频率的同时调制(多模态编码)。我们假设,具有多模态编码的反馈可以有效地被中枢神经系统作为两个独立的输入进行处理,分别编码在幅度和频率中,从而根据最大似然估计提高状态估计质量。使用适应范式,我们在一个抓握力匹配任务中测试了这一假设,在该任务中,除了自然力反馈之外,受试者还接受了编码瞬时力幅度、频率或两者的电触觉反馈。结果表明,多模态编码的抓握力适应可以根据最大似然估计准确地预测为三个独立输入的整合:幅度调制的电触觉反馈、频率调制的电触觉反馈和自然力反馈(r=0.73)。这些发现表明,与单变量调制相比,多模态电触觉反馈在状态估计精度方面具有内在优势,并表明对于具有电触觉反馈的双向人机接口,这种方案应该是首选策略。