Carlucho Ignacio, De Paula Mariano, Acosta Gerardo G
INTELYMEC, Centro de Investigaciones en Física e Ingeniería del Centro CIFICEN - UNICEN - CICpBA - CONICET, 7400 Olavarría, Argentina.
ISA Trans. 2020 Jul;102:280-294. doi: 10.1016/j.isatra.2020.02.017. Epub 2020 Feb 19.
Intelligent control systems are being developed for the control of plants with complex dynamics. However, the simplicity of the PID (proportional-integrative-derivative) controller makes it still widely used in industrial applications and robotics. This paper proposes an intelligent control system based on a deep reinforcement learning approach for self-adaptive multiple PID controllers for mobile robots. The proposed hybrid control strategy uses an actor-critic structure and it only receives low-level dynamic information as input and simultaneously estimates the multiple parameters or gains of the PID controllers. The proposed approach was tested in several simulated environments and in a real time robotic platform showing the feasibility of the approach for the low-level control of mobile robots. From the simulation and experimental results, our proposed approach demonstrated that it can be of aid by providing with behavior that can compensate or even adapt to changes in the uncertain environments providing a model free unsupervised solution. Also, a comparative study against other adaptive methods for multiple PIDs tuning is presented, showing a successful performance of the approach.
正在开发智能控制系统以控制具有复杂动态特性的工厂。然而,PID(比例-积分-微分)控制器的简单性使其仍广泛应用于工业应用和机器人技术中。本文提出了一种基于深度强化学习方法的智能控制系统,用于移动机器人的自适应多PID控制器。所提出的混合控制策略采用了一种智能体-评论家结构,它仅接收低级动态信息作为输入,并同时估计PID控制器的多个参数或增益。所提出的方法在几个模拟环境和一个实时机器人平台上进行了测试,展示了该方法用于移动机器人低级控制的可行性。从仿真和实验结果来看,我们提出的方法表明,它可以通过提供能够补偿甚至适应不确定环境变化的行为来提供帮助,从而提供一种无模型的无监督解决方案。此外,还对其他用于多PID整定的自适应方法进行了比较研究,显示了该方法的成功性能。