基于Markov切换空间的分布式协同接入控制模型  

Distributed collaborative admission control model based on Markov switching space

作　　者：刘兴华[1] 奚宏生[1] 

机构地区：[1]中国科学技术大学信息科学技术学院自动化系,安徽合肥230026

出　　处：《太赫兹科学与电子信息学报》2013年第6期970-976,980,共8页Journal of Terahertz Science and Electronic Information Technology

基　　金：国家重点基金资助项目(61233003);中国博士研究生教育基金资助项目(20093402110019)

摘　　要：基于3层架构的映射框架,本文以视频业务为主要研究对象,研究了分布式协同接入控制系统的建模和调控机理。不失一般性,假设视频业务需求近似服从泊松分布,而服务时间服从指数分布,将一个资源节点上的业务接入状态的演化用Markov过程来描述,则所有的N个资源节点的分布式协同接入控制可以由一个Markov切换空间控制过程来阐述。针对构建的Markov切换空间控制系统,基于系统灵敏度的观点对系统性能进行优化,本文提出了基于策略梯度的随机逼近算法;同时,证明了该随机逼近算法的收敛性。此外,本文给出了一个仿真实例来说明此随机逼近算法的有效性。The modeling of distributed collaborative admission control system and mechanism are studied based on the three-layer structure of mapping framework. The video service is considered as the main research object, which is assumed approximating Poisson distribution, and service time obeys exponential distribution. A resource node in the evolution of the state of the service can be described in Markov process. Accordingly, all the N resource nodes of distributed collaborative admission control can be elaborated by a Markov switching space control process. According to the proposed Markov switching system, the performance of the system is optimized from the viewpoint of sensitivity. A stochastic approximation algorithm is put forward based on the strategy of the gradient. Meanwhile, the convergence of the algorithm is proved, and an example is given to verify the effectiveness of the algorithm.

关 键 词：MARKOV决策过程 MARKOV切换系统 性能势 策略迭代 

分 类 号：TN915.6[电子电信—通信与信息系统]