Wang Jing, Zhao Wei, Cao Jinde, Park Ju H, Shen Hao
IEEE Trans Cybern. 2024 Nov;54(11):6345-6357. doi: 10.1109/TCYB.2024.3431670. Epub 2024 Oct 30.
A novel reinforcement learning-based predefined-time tracking control scheme with prescribed performance is presented in this article for nonlinear systems in the presence of external disturbances. First, by employing the backstepping strategy, an adaptive optimized controller is developed under the identifier-critic-actor framework. Therein, the unknown nonlinear dynamics and the system control behavior can be learned effectively through neural networks. Moreover, aiming at obtaining the preset tracking performance, the prescribed performance control is integrated with the predefined-time control. In contrast to previous studies, the proposed scheme can not only constrain the tracking error rapidly to a prearranged vicinity of origin, but also ensure that the upper bound of convergence time can be adjusted in advance via a separate control parameter. In terms of the predefined-time stability theory, the boundedness of all system states can be proven within a predefined time. Finally, the availability and improved performances of the proposed control scheme are demonstrated by a numerical example and a single-link manipulator example.
本文针对存在外部干扰的非线性系统,提出了一种基于强化学习的具有规定性能的预定义时间跟踪控制方案。首先,通过采用反步策略,在识别器-评论家-执行器框架下开发了一种自适应优化控制器。其中,未知非线性动力学和系统控制行为可以通过神经网络有效学习。此外,为了获得预设的跟踪性能,将规定性能控制与预定义时间控制相结合。与先前的研究相比,所提出的方案不仅可以将跟踪误差迅速约束在原点的预先安排的邻域内,而且还可以确保收敛时间的上限可以通过一个单独的控制参数预先调整。根据预定义时间稳定性理论,可以证明所有系统状态在预定义时间内是有界的。最后,通过数值例子和单连杆机械手例子验证了所提出控制方案的有效性和改进的性能。