Data Analytics of an Information System Based on a Markov Decision Process and a Partially Observable Markov Decision Process  

作　　者：Lidong Wang Reed L.Mosher Terril C.Falls Patti Duett 

机构地区：[1]Institute for Systems Engineering Research,Mississippi State University,Vicksburg,MS 39180,USA

出　　处：《Journal of Computer Science Research》2023年第1期21-30,共10页计算机科学研究（英文）

摘　　要：Data analytics of an information system is conducted based on a Markov decision process(MDP)and a partially observable Markov decision process(POMDP)in this paper.Data analytics over a finite planning horizon and an infinite planning horizon for a discounted MDP is performed,respectively.Value iteration(VI),policy iteration(PI),and Q-learning are utilized in the data analytics for a discounted MDP over an infinite planning horizon to evaluate the validity of the MDP model.The optimal policy to minimize the total expected cost of states of the information system is obtained based on the MDP.In the analytics for a discounted POMDP over an infinite planning horizon of the information system,the effects of various parameters on the total expected cost of the information system are studied.

关 键 词：Predictive modelling Information system MDP POMDP CYBERSECURITY Q-LEARNING 

分 类 号：F41[经济管理—产业经济]