一类离散时间非齐次马尔可夫跳跃系统最优控制  

Optimal control for a class of discrete-time nonhomogeneous Markovian jump linear systems

作　　者：张高生[1] 朱进[1] 谢宛青[2] 奚宏生[1] 

机构地区：[1]中国科学技术大学自动化系,安徽合肥230026 [2]中国科学技术大学信息科学技术学院,安徽合肥230026

出　　处：《控制理论与应用》2016年第1期128-132,共5页Control Theory & Applications

基　　金：国家自然科学基金项目(61374073);中央高校基本科研业务费专项资金(WK2100000003);安徽省自然科学基金项目(1308085QF107)资助~~

摘　　要：本文研究了一类离散时间非齐次马尔可夫跳跃线性系统的线型二次高斯(linear quadratic Gaussian,LQG)问题,其中系统模态转移概率矩阵随时间随机变化,其变化特性由一高阶马尔可夫链描述.对于该系统的LQG问题,文中首先给出了线性最优滤波器,得到最优状态估计;其次,验证分离定理成立,并利用利用动态规划方法设计了系统最优控制器;最后,数值仿真结果验证了所设计控制器的有效性.This paper concerns the linear quadratic Gaussian （LQG） problem for a class of discrete-time nonhomoge- neous Markovian jump linear systems （MJLSs） in the presence of process and observation noises. In such nonhomogeneous MJLSs, the mode transition probability matrix （MTPM） varies randomly instead of being time-invariant. Assuming that the stochastic variation of MTPM is governed by a high level Markov chain, we propose an MJLS model with two-level Markov chains to describe the concerned characteristics. Firstly, a mode-MTPM based optimal filter is developed to es- timate system states where the filter gain can be obtained from the coupled Riccati equations. Furthermore, we prove in details the validity of separation principle for such MJLSs. On this basis, we design the optimal output feedback controller by applying the dynamic programming method. Finally a numerical example is given to show the effectiveness of the developed theoretical results.

关 键 词：随机系统 非齐次马尔可夫链 最优控制 分离定理 

分 类 号：O211.62[理学—概率论与数理统计] O232[理学—数学]