基于动态调整的差分隐私联邦学习优化方法
Differential Private Federate Learning Method Based on Dynamic Adjustment
目前,联邦学习凭借其数据本地化处理优势,成为了学术界与工业界关注的焦点。然而,联邦学习在实际应用过程中面临着数据异质性问题和隐私泄露问题。现有的研究工作已明确指出,当联邦学习模型在同时面临数据异质性和差分隐私机制的双重约束下进行训练时,其效用往往会遭受显著的损失。现有工作提出的优化方法存在可移植性差、提升效果有限等问题。为此,本文提出了一种基于动态调整的差分隐私联邦学习优化方法。方法中,针对本地模型方向偏移问题,进行了基于梯度大小的动态裁剪以根据梯度信息计算对应的裁剪阈值;针对联邦聚合带来的噪音污染问题,进行了基于动态聚合的本地降噪以利用生成数据确定最佳聚合参数;在公开数据集上的实验结果表明,本文所提出的算法能够有效的提升异质数据下隐私保护联邦算法的预测精度。
urrently, federated learning has become a focus of attention in both academia and industry due to its advantage of processing data locally. However, federated learning faces challenges of data heterogeneity and privacy leakage in practical applications. Existing research has clearly indicated that when federated learning models are trained under the dual constraints of data heterogeneity and differential privacy mechanisms, their utility often suffers significant losses. The optimization methods proposed in existing work have issues such as poor portability and limited improvement effects. Therefore, this paper proposes an optimized federated learning method with differential privacy based on dynamic adjustment. In this method, dynamic clipping based on gradient magnitude is applied to calculate the corresponding clipping threshold according to gradient information, addressing the issue of local model direction deviation. Additionally, local noise reduction based on dynamic aggregation is implemented to determine the optimal aggregation parameters using generated data, tackling the noise pollution caused by federated aggregation. Experimental results on public datasets demonstrate that the proposed algorithm can effectively improve the model prediction accuracy.
潘佳安、程祥
计算技术、计算机技术
人工智能联邦学习数据异质性差分隐私
rtificial IntelligenceFederated LearningData HeterogeneityDifferential Privacy
潘佳安,程祥.基于动态调整的差分隐私联邦学习优化方法[EB/OL].(2025-02-26)[2025-08-16].http://www.paper.edu.cn/releasepaper/content/202502-130.点此复制
评论