Department of Biomedical Engineering, University of Southern California, Los Angeles, U.S.A.
Neural Comput. 2011 Aug;23(8):1911-34. doi: 10.1162/NECO_a_00151. Epub 2011 Apr 26.
Control in the natural environment is difficult in part because of uncertainty in the effect of actions. Uncertainty can be due to added motor or sensory noise, unmodeled dynamics, or quantization of sensory feedback. Biological systems are faced with further difficulties, since control must be performed by networks of cooperating neurons and neural subsystems. Here, we propose a new mathematical framework for modeling and simulation of distributed control systems operating in an uncertain environment. Stochastic differential operators can be derived from the stochastic differential equation describing a system, and they map the current state density into the differential of the state density. Unlike discrete-time Markov update operators, stochastic differential operators combine linearly for a large class of linear and nonlinear systems, and therefore the combined effects of multiple controllable and uncontrollable subsystems can be predicted. Design using these operators yields systems whose statistical behavior can be specified throughout state-space. The relationship to Bayesian estimation and discrete-time Markov processes is described.
在自然环境中进行控制具有一定难度,部分原因是因为难以确定行为的效果。不确定性可能源于附加的运动或感觉噪声、未建模的动态性或感觉反馈的量化。由于控制必须通过协作神经元和神经子系统的网络来执行,因此生物系统面临着更多的困难。在这里,我们提出了一种新的数学框架,用于对在不确定环境中运行的分布式控制系统进行建模和仿真。随机微分算子可以从描述系统的随机微分方程中推导出来,并且它们将当前状态密度映射到状态密度的微分。与离散时间马尔可夫更新算子不同,随机微分算子对于一大类线性和非线性系统可以线性组合,因此可以预测多个可控和不可控子系统的综合影响。使用这些算子进行设计可以得到其整个状态空间的统计行为都可指定的系统。还描述了与贝叶斯估计和离散时间马尔可夫过程的关系。