异构联邦双向知识蒸馏传递半监督调制类型识别  

Heterogeneous federated bidirectional knowledge distillation transfer semi-supervised modulation recognition

作　　者：齐佩汉 丁渊磊 尹凯 徐佳波 李赞[1] QI Peihan;DING Yuanlei;YIN Kai;XU Jiabo;LI Zan(School of Telecommunications Engineering,Xidian University,Xi’an 710071,China)

机构地区：[1]西安电子科技大学通信工程学院,陕西西安710071

出　　处：《通信学报》2023年第11期183-200,共18页Journal on Communications

基　　金：国家自然科学基金资助项目(No.62171334,No.61971337,No.61825104)。

摘　　要：新一代移动通信系统的规模化部署和快速发展支撑巨量多样物联网设备的广泛应用。然而物联网设备的分布式应用导致的私有数据迥异和本地处理模型差别,严重制约全局智能模型的聚合能力。因此,针对认知物联网中智能调制类型识别面临的数据异质、模型异构和标记不足等问题,提出异构联邦双向知识蒸馏传递半监督调制类型识别算法,通过变分自编码器在云端生成公开伪数据集支持上行全局知识蒸馏,自适应共享至本地辅助下行异质知识蒸馏,并在蒸馏过程中内嵌半监督算法。仿真结果表明,在通信信号处理领域中,所提算法的有效性和适用性优于现有的联邦学习算法。The large-scale deployment and rapid development of the new generation mobile communication system underpin the widespread application of a massive and diverse range of Internet of things(IoT)devices.However,the distributed application of IoT devices results to significant disparities in private data and substantial heterogeneity in local processing models,which severely limits the aggregation capability of global intelligent model.Therefore,to tackle the challenges of data heterogeneity,model heterogeneity,and insufficient labeling faced by intelligent modulation recognition in cognitive IoT,an algorithm was proposed for heterogeneous federated bidirectional semi-supervised modulation recognition,which incorporated bidirectional knowledge distillation.In the proposed algorithm,a public pseudo dataset was generated by variational autoencoder in the cloud for supporting uplink global knowledge distillation,and adaptively sharing to the local devices for downlink heterogeneous knowledge distillation,while integrating a semi-supervised algorithm within the distillation process.The simulation results indicate that the proposed algorithm outperforms current federated learning algorithms in terms of effectiveness and applicability in the field of communication signal processing.

关 键 词：联邦半监督学习 模型异构 变分自编码器 知识蒸馏 

分 类 号：TN92[电子电信—通信与信息系统]