Shadmehr Reza, Huang Helen J, Ahmed Alaa A
Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, 410 Traylor Building, 720 Rutland Avenue, Baltimore, MD 21205, USA.
Neuromechanics Laboratory, Department of Integrative Physiology, University of Colorado, 354 UCB, Boulder, CO 80309-0354, USA.
Curr Biol. 2016 Jul 25;26(14):1929-34. doi: 10.1016/j.cub.2016.05.065. Epub 2016 Jun 30.
Given two rewarding stimuli, animals tend to choose the more rewarding (or less effortful) option. However, they also move faster toward that stimulus [1-5]. This suggests that reward and effort not only affect decision-making, they also influence motor control [6, 7]. How does the brain compute the effort requirements of a task? Here, we considered data acquired during walking, reaching, flying, or isometric force production. In analyzing the decision-making and motor-control behaviors of various animals, we considered the possibility that the brain may estimate effort objectively, via the metabolic energy consumed to produce the action. We measured the energetic cost of reaching and found that, like walking, it was convex in time, with a global minimum, implying that there existed a movement speed that minimized effort. However, reward made it worthwhile to be energetically inefficient. Using a framework in which utility of an action depended on reward and energetic cost, both discounted in time, we found that it was possible to account for a body of data in which animals were free to choose how to move (reach slow or fast), as well as what to do (walk or fly, produce force F1 or F2). We suggest that some forms of decision-making and motor control may share a common utility in which the brain represents the effort associated with performing an action objectively via its metabolic energy cost and then, like reward, temporally discounts it as a function of movement duration.
给定两种有奖励的刺激,动物倾向于选择奖励更多(或更省力)的选项。然而,它们也会更快地朝着那个刺激移动[1 - 5]。这表明奖励和努力不仅影响决策,还会影响运动控制[6, 7]。大脑是如何计算一项任务的努力需求的呢?在这里,我们考虑了在行走、伸手够物、飞行或等长力量产生过程中获取的数据。在分析各种动物的决策和运动控制行为时,我们考虑了大脑可能通过产生动作所消耗的代谢能量来客观估计努力的可能性。我们测量了伸手够物的能量消耗,发现和行走一样,它在时间上呈凸形,有一个全局最小值,这意味着存在一个使努力最小化的运动速度。然而,奖励使得在能量利用上低效变得值得。使用一个行动效用取决于奖励和能量消耗(两者都随时间贴现)的框架,我们发现有可能解释这样一组数据,即动物可以自由选择如何移动(慢或快地伸手够物)以及做什么(行走或飞行,产生力F1或F2)。我们认为某些形式的决策和运动控制可能共享一种共同的效用,在这种效用中,大脑通过动作的代谢能量成本客观地表示与执行一个动作相关的努力,然后像奖励一样,根据运动持续时间在时间上对其进行贴现。