线性编码联邦学习  

Linear coding-based federated learning

作　　者：史洪玮[1,2,3] 王志超 施连敏[4,5] 杨迎尧 Shi Hongwei;Wang Zhichao;Shi Lianmin;Yang Yingyao(School of Information Engineering,Suqian University,Suqian Jiangsu 223800,China;Institute for Industrial Technology Research,Suqian University,Suqian Jiangsu 223800,China;School of Information&Control Engineering,China University of Mining&Technology,Xuzhou Jiangsu 221116,China;School of Computer Science&Technology,Soochow University,Suzhou Jiangsu 215031,China;The Key Laboratory of Cognitive Computing&Intelligent Information Processing of Fujian Education Institutions,Wuyi University,Wuyishan Fujian 354300,China)

机构地区：[1]宿迁学院信息工程学院,江苏宿迁223800 [2]宿迁学院产业技术研究院,江苏宿迁223800 [3]中国矿业大学信息与控制工程学院,江苏徐州221116 [4]苏州大学计算机科学与技术学院,江苏苏州215031 [5]武夷学院认知计算与智能信息处理福建省高校重点实验室,福建武夷山354300

出　　处：《计算机应用研究》2023年第4期1113-1118,共6页Application Research of Computers

基　　金：2021江苏省重点研发计划(现代农业)资助项目(BE2021354);2020宿迁市项目(Z2020133);2021宿迁市现代农业项目(L202109);2019年苏州市科技计划资助项目(SNG201908);认知计算与智能信息处理福建省高校重点实验室开放课题基金资助项目(KLCCIIP2021201)。

摘　　要：联邦学习能够在边缘设备的协作训练中,保护边缘设备的数据隐私。而在通用联邦学习场景中,联邦学习的参与者通常由异构边缘设备构成,其中资源受限的设备会占用更长的时间,导致联邦学习系统的训练速度下降。现有方案或忽略掉队者,或根据分布式思想将计算任务进行分发,但是分发过程中涉及到原始数据的传递,无法保证数据隐私。为了缓解中小型规模的多异构设备协作训练场景下的掉队者问题,提出了编码联邦学习方案,结合线性编码的数学特性设计了高效调度算法,在确保数据隐私的同时,加速异构系统中联邦学习系统速度。同时,在实际实验平台中完成的实验结果表明,当异构设备之间性能差异较大时,编码联邦学习方案能将掉队者训练时间缩短92.85%。Federated learning can protect the data privacy of edge devices in collaborative training of edge devices.In the general FL scenarios,the participants of FL are usually composed of heterogeneous edge devices,where resource-constrained devices will consume more time,resulting in the decline of the training speed.The existing schemes either ignore stragglers,or distribute the computing tasks according to the distributed idea,but the distribution process involves the transmission of raw data,which cannot guarantee data privacy.To alleviate the straggler problem in small or medium-sized multiple heterogeneous devices scenario,this paper proposed a coding-based FL scheme,and it designed an efficient scheduling algorithm combined with the mathematical characteristics of linear coding to ensure data privacy and accelerate the speed of heterogeneous FL system.Meanwhile,the experimental results completed in the actual experimental platform show that when the performance diffe-rence between heterogeneous devices is large,the coding-based FL scheme can shorten the training time of the straggler by 92.85%.

关 键 词：联邦学习 线性编码 边缘计算 调度策略 

分 类 号：TP305[自动化与计算机技术—计算机系统结构]