Hoffmann Anne H, Crevecoeur Frédéric
Institute of Information and Communication Technologies, Electronics and Applied Mathematics (ICTEAM), Université Catholique de Louvain, Louvain-la-Neuve 1348, Belgium
Institute of Neuroscience (IoNS), Université Catholique de Louvain, Brussels 1200, Belgium.
eNeuro. 2024 Dec 9;11(12). doi: 10.1523/ENEURO.0262-24.2024. Print 2024 Dec.
When making perceptual decisions, humans combine information across sensory modalities dependent on their respective uncertainties. However, it remains unknown how the brain integrates multisensory feedback during movement and which factors besides sensory uncertainty influence sensory contributions. We performed two reaching experiments on healthy adults to investigate whether movement corrections to combined visual and mechanical perturbations scale with visual uncertainty. To describe the dynamics of multimodal feedback responses, we further varied movement time and visual feedback duration during the movement. The results of our first experiment show that the contribution of visual feedback decreased with uncertainty. Additionally, we observed a transient phase during which visual feedback responses were stronger during faster movements. In a follow-up experiment, we found that the contribution of vision increased more quickly during slow movements when we presented the visual feedback for a longer time. Muscle activity corresponding to these visual responses exhibited modulations with sensory uncertainty and movement speed ca. 100 ms following the onset of the visual feedback. Using an optimal feedback control model, we show that the increased response to visual feedback during fast movements can be explained by an urgency-dependent increase in control gains. Further, the fact that a longer viewing duration increased the visual contributions suggests that the brain accumulates sensory information over time to estimate the state of the arm during reaching. Our results provide additional evidence concerning the link between reaching control and decision-making, both of which appear to be influenced by sensory evidence accumulation and response urgency.
在做出感知决策时,人类会根据各自的不确定性整合跨感觉模态的信息。然而,大脑在运动过程中如何整合多感觉反馈,以及除了感觉不确定性之外哪些因素会影响感觉贡献,目前仍不清楚。我们对健康成年人进行了两项伸手实验,以研究对视觉和机械扰动组合的运动校正是否会随着视觉不确定性而变化。为了描述多模态反馈响应的动态变化,我们在运动过程中进一步改变了运动时间和视觉反馈持续时间。我们第一个实验的结果表明,视觉反馈的贡献随着不确定性的增加而减少。此外,我们观察到一个瞬态阶段,在此期间,在较快运动过程中视觉反馈响应更强。在后续实验中,我们发现当我们延长视觉反馈的呈现时间时,在缓慢运动过程中视觉的贡献增加得更快。与这些视觉响应相对应的肌肉活动在视觉反馈开始后约100毫秒表现出随感觉不确定性和运动速度的调制。使用最优反馈控制模型,我们表明在快速运动过程中对视觉反馈增加的响应可以通过与紧迫性相关的控制增益增加来解释。此外,较长的观看持续时间增加了视觉贡献这一事实表明,大脑会随着时间积累感觉信息,以在伸手过程中估计手臂的状态。我们的结果为伸手控制与决策之间的联系提供了更多证据,这两者似乎都受到感觉证据积累和响应紧迫性的影响。