基于差分隐私的联邦学习方案  

Federated Learning Scheme Based on Differential Privacy

作　　者：孙敏[1] 丁希宁 成倩 SUN Min;DING Xining;CHENG Qian(College of Computer and Information Technology,Shanxi University,Taiyuan 030000,China)

机构地区：[1]山西大学计算机与信息技术学院,太原030000

出　　处：《计算机科学》2024年第S01期900-905,共6页Computer Science

基　　金：山西省基础研究计划(20210302123455,201701D121052)。

摘　　要：联邦学习的特点之一是进行训练的服务器并不直接接触数据,因此联邦学习本身就具有保护数据安全的特性。但是研究表明,联邦学习在本地数据训练和中心模型聚合等方面均存在隐私泄露的问题。差分隐私是一种加噪技术,通过加入适当噪声达到攻击者区分不出用户信息的目的。文中研究了一种基于本地和中心差分隐私的混合加噪算法(LCDP-FL),该算法能根据各个客户端不同权重、不同隐私需求,为这些客户端提供本地或混合差分隐私保护。而且我们证明该算法能够在尽可能减少计算开支的同时,为用户提供他们所需的隐私保障。在MNIST数据集和CIFAR-10数据集上对该算法进行了测试,并与本地差分隐私(LDP-FL)和中心差分隐私(CDP-FL)等算法进行对比,结果显示该混合算法在精确度、损失率和隐私安全方面均有改进,其算法性能最优。One of the characteristics of federated learning is that the server being trained does not directly contact the data,so federated learning itself has the characteristics of protecting data security.However,research shows that federated learning has privacy leakage problems in local data training and central model aggregation.Differential privacy is a noise augmentation technique that adds appropriate noise to prevent an attacker from distinguishing user information.We study a hybrid noise adding algorithm based on local and central differential privacy(LCDP-FL),which can provide local or hybrid differential privacy protection for each client according to its different weights and privacy requirements.It’s shown that the algorithm can provide users with the privacy they need with minimal computational overhead.The algorithm is tested on the MNIST dataset and CIFAR-10 dataset,and compared with local differential privacy(LDP-FL)and central differential privacy(CDP-FL)algorithms,and the results show that the hybrid algorithm has improved accuracy,loss rate and privacy security,and its algorithm performance is the best.

关 键 词：联邦学习 差分隐私 隐私保护 混合加噪 梯度下降 

分 类 号：TP393[自动化与计算机技术—计算机应用技术]