Online optimal control of nonlinear discrete-time systems using approximate dynamic programming  

作　　者：Travis DIERKS Sarangapani JAGANNATHAN 

机构地区：[1]DRS Sustainment Systems,Inc.,201 Evans Lane [2]Department of Electrical and Computer Engineering,Missouri University of Science and Technology

出　　处：《控制理论与应用（英文版）》2011年第3期361-369,共9页

基　　金：partly supported by the National Science Foundation (No.ECCS#0621924,ECCS-#0901562);the Intelligent Systems Center

摘　　要：In this paper,the optimal control of a class of general affine nonlinear discrete-time(DT) systems is undertaken by solving the Hamilton Jacobi-Bellman(HJB) equation online and forward in time.The proposed approach,referred normally as adaptive or approximate dynamic programming(ADP),uses online approximators(OLAs) to solve the infinite horizon optimal regulation and tracking control problems for affine nonlinear DT systems in the presence of unknown internal dynamics.Both the regulation and tracking controllers are designed using OLAs to obtain the optimal feedback control signal and its associated cost function.Additionally,the tracking controller design entails a feedforward portion that is derived and approximated using an additional OLA for steady state conditions.Novel update laws for tuning the unknown parameters of the OLAs online are derived.Lyapunov techniques are used to show that all signals are uniformly ultimately bounded and that the approximated control signals approach the optimal control inputs with small bounded error.In the absence of OLA reconstruction errors,an optimal control is demonstrated.Simulation results verify that all OLA parameter estimates remain bounded,and the proposed OLA-based optimal control scheme tunes itself to reduce the cost HJB equation.In this paper,the optimal control of a class of general affine nonlinear discrete-time(DT) systems is undertaken by solving the Hamilton Jacobi-Bellman(HJB) equation online and forward in time.The proposed approach,referred normally as adaptive or approximate dynamic programming(ADP),uses online approximators(OLAs) to solve the infinite horizon optimal regulation and tracking control problems for affine nonlinear DT systems in the presence of unknown internal dynamics.Both the regulation and tracking controllers are designed using OLAs to obtain the optimal feedback control signal and its associated cost function.Additionally,the tracking controller design entails a feedforward portion that is derived and approximated using an additional OLA for steady state conditions.Novel update laws for tuning the unknown parameters of the OLAs online are derived.Lyapunov techniques are used to show that all signals are uniformly ultimately bounded and that the approximated control signals approach the optimal control inputs with small bounded error.In the absence of OLA reconstruction errors,an optimal control is demonstrated.Simulation results verify that all OLA parameter estimates remain bounded,and the proposed OLA-based optimal control scheme tunes itself to reduce the cost HJB equation.

关 键 词：Online nonlinear optimal control Hamilton Jacobi-Bellman Online approximators Discrete-time systems 

分 类 号：TP13[自动化与计算机技术—控制理论与控制工程]