基于马尔可夫的多功能雷达认知干扰决策建模研究  

Research on decision-making modeling of cognitive jamming for multi-functional radar based on Markov

作　　者：朱霸坤 朱卫纲 李伟 杨莹 高天昊 ZHU Bakun;ZHU Weigang;LI Wei;YANG Ying;GAO Tianhao(Department of Electronic and Optical Engineering,Space Engineering University,Beijing 101416,China;State Key Laboratory of Complex Electromagnetic Environment Effects on Electronics and Information System,Luoyang 471032,China;Graduate School,Space Engineering University,Beijing 101416,China)

机构地区：[1]航天工程大学电子光学工程系,北京101416 [2]电子信息系统复杂电磁环境效应国家重点实验室,河南洛阳471032 [3]航天工程大学研究生院,北京101416

出　　处：《系统工程与电子技术》2022年第8期2488-2497,共10页Systems Engineering and Electronics

基　　金：CEMEE国家重点实验室项目(CEMEE2020Z0203B)资助课题。

摘　　要：多功能雷达是现代电磁战场上不可或缺的重要装备,针对多功能雷达的干扰一直是一个难题。本文在研究多功能雷达信号特点和雷达对抗过程的基础上,提出了雷达状态联合表征的方法,将多功能雷达的干扰决策问题建模为一个带收益的马尔可夫决策过程,设计了认知干扰决策系统,并通过基于Q-Learning的认知干扰决策算法求解该模型下的最佳干扰策略。通过仿真实验,证明了基于Q-Learning的认知干扰决策算法能够在缺乏先验经验的情况下学习到最佳干扰策略,具备“认知”的特性,并且在不稳定的环境中也具有较强的适应性,有效支撑了本文所提的干扰决策模型。Multi-functional radar is an indispensable and important equipment in modern electromagnetic battlefield. The interference of multi-functional radar is always a difficult problem. In this paper, based on the study of the characteristics of multi-functional radar signal and the radar countermeasure process, the method of joint representation of radar state is proposed, and the interference problem of multi-functional radar is modeled as a Markov decision process with benefits. The cognitive interference decision system is designed. The interference strategy is solved by the cognitive interference decision algorithm based on Q-learning. Through the simulation experiment, it is proved that the cognitive interference decision algorithm based on Q-learning can learn the optimal interference strategy in the absence of prior experience, have the characteristic of “cognition”, and have strong adaptability in the unstable environment, which effectively supports the interference decision model mentioned above.

关 键 词：雷达对抗 马尔可夫决策过程 雷达状态 强化学习 Q-LEARNING 

分 类 号：TN974[电子电信—信号与信息处理]