Continuous-Time Single Network Adaptive Critic for Regulator Design of Nonlinear Control Affine Syst
World Congress, Volume # 17 | Part# 1
Kumar, Swagat; Padhi, Radhakant; Behera, Laxmidhar
Digital Object Identifier (DOI)
Optimal control theory; Regulation; Optimization based controller synthesis
An optimal control law for a general nonlinear system can be obtained by solving Hamilton-Jacobi-Bellman equation. However, it is difficult to obtain an analytical solution of this equation even for a moderately complex system. In this paper, we propose a continuoustime single network adaptive critic scheme for nonlinear control affine systems where the optimal cost-to-go function is approximated using a parametric positive semi-definite function. Unlike earlier approaches, a continuous-time weight update law is derived from the HJB equation. The stability of the system is analysed during the evolution of weights using Lyapunov theory. The effectiveness of the scheme is demonstrated through simulation examples.
A. E. Bryson and Y. C. Ho. Applied Optimal Control. Taylor and Francis, 1975. R. A. Freeman and P. V. Kokotovic. Inverse optimality in robust stabilization. SIAM Journal of Control and Optimization, 34(4):13651391, July 1996. D. S. Naidu. Optimal Control Systems. CRC Press, 2003. Chapter 5, Discrete-time optimal control systems. R. Padhi, N. Unnikrishnan, X. Wang, and S. N. Bal- akrishnan. A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems. Neural Networks, Science Direct, Elsevier, 19:16481660, 2006. D. V. Prokhorov and D. C. Wunsch II. Adaptive critic designs. IEEE Transactions on Neural Networks, 8(5): 9971007, September 1997. J. Si, A. G. Barto, W. B. Powell, and D. Wunsch II, ed- itors. Handbook of learning and Approximate Dynamic Programming, chapter 3. IEEE Press, 2005. J. J. E. Slotine and W. Li. Applied Nonlinear Control. Prentice Hall, New Jersey, 1991.