基于Q学习的自主联合无线资源管理算法  

A Q-learning Based Autonomic Joint Radio Resource Management Algorithm

作　　者：张永靖[1] 冯志勇[1] 张平[1] 

机构地区：[1]北京邮电大学电信工程学院,北京100876

出　　处：《电子与信息学报》2008年第3期676-680,共5页Journal of Electronics & Information Technology

基　　金：欧盟FP6端到端重配置(IST-2005-027714);国家自然科学基金重点项目(60502035);国家863计划(2006AA01Z276);科技部中欧盟科技合作项目(0516)资助课题

摘　　要：该文提出了一种基于Q学习的联合无线资源管理(JRRM)算法,用于异构无线接入技术条件下B3G系统的自主资源优化。JRRM控制器通过与无线环境的"试错"交互,学会为每个会话分配合适的接入技术和业务带宽。为降低存储需求,算法引入了反向传播神经网络用于泛化其输入状态空间。仿真结果表明,该算法不仅通过在线学习实现了JRRM的自主化,且在频谱效用和阻塞率之间获得了很好的性能折衷。A Q-learning based Joint Radio Resource Management （JRRM） algorithm is proposed for the autonomic resource optimization in a B3G system with heterogeneous Radio Access Technologies （RAT）. Through the ＂trial-and-error＂ interactions with the radio environment, the JRRM controller learns to allocate the proper RAT and the service bandwidth for each session. A backpropagation neural network is adopted to generalize the large input state space to reduce memory requirement. Simulation results show that the proposed algorithm not only realizes the autonomy of JRRM through the online learning process, but also achieves well trade-off between the spectrum utility and the blocking probability.

关 键 词：无线接入技术(RAT) 联合接纳控制 带宽分配 Q学习 神经网络 

分 类 号：TN915.65[电子电信—通信与信息系统]