基于多Agent强化学习的Ad hoc网络跨层拥塞控制策略  

Research on Cross-layer Congestion Control Strategy Based on Multi-agent Reinforcement Learning in Ad hoc Network

作　　者：邵飞[1] 伍春[1] 汪李峰 

机构地区：[1]西安电子科技大学通信工程学院,西安710071 [2]中国电子系统工程公司研究所,北京100141

出　　处：《电子与信息学报》2010年第6期1520-1524,共5页Journal of Electronics & Information Technology

基　　金：国家973计划项目(2009CB320403);国家自然科学基金(60832008;60832006)资助课题

摘　　要：该文首先证明基于MAC层竞争造成的网络拥塞模型中存在纳什均衡点。其次,基于WOLF-PHC学习策略提出了一种跨层拥塞控制(WCS)机制。它在路由层中选择一对去耦合节点作为转发节点,同时在MAC层对源节点的发送数据进行分流,从而提高链路的空间重用性。仿真结果表明:在不需要交互任何信息的情况下,通过节点之间的相互博弈以后,采用WOLF-PHC算法能够找到每个节点的最佳分流概率进而使整体网络吞吐量达到最大值;同时当外界环境发生改变时,该算法能够较快地找到新的最佳分流概率从而实现对环境的自适应能力。In the paper,the existence of an Nash equilibrium in the network congestion mode induced by MAC layer competition is proved firstly;Secondly,a cross-layer congestion-control mechanism named WCS is proposed based on WOLF-PHC learning strategy.WCS selects a couple of decoupled node as next-hop nodes at routing layer;Meanwhile,source＇s traffic is spitted and forwarded at MAC layer,which improves the space reusing efficiency of link.Simulation result shows that：without any exchanging information,optimum split-flow point of source node will be sought by WOLF-PHC in order to maximize the network throughput;Furthermore,WOLF-PHC will discover new optimum split-flow point in order to adapt to new network environment.

关 键 词：Ad HOC 拥塞控制 跨层设计 博弈论 WOLF-PHC 

分 类 号：TN915[电子电信—通信与信息系统]