Adaptive federated learning algorithm based on evolution strategies

公, 茂果; 高, 原; 王, 炯乾; 张, 元侨; 王, 善峰; 谢, 飞

doi:10.1360/ssi-2021-0190

Cited by 2 publications

(1 citation statement)

References 22 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Clients finetune their models with the global model to resolve client heterogeneity issues. Gong [45] introduced an adaptive FL algorithm based on evolutionary strategy. Each client is treated as an individual in the evolutionary strategy, adapting to generate different personalized sub-models through global optimization.…”

Section: B Federated Optimization For Communication Cost and Data Het...mentioning

confidence: 99%

FedDBO: A Novel Federated Learning Approach for Communication Cost and Data Heterogeneity Using Dung Beetle Optimizer

Wang,

Chen,

et al. 2024

IEEE Access

View full text Add to dashboard Cite

As an emerging distributed machine learning technology, federated learning has gained widespread attention due to its critical privacy protection mechanism. However, it also faces challenges such as high communication costs and heterogeneous client data.In order to address the above issues. This paper proposes a federated learning approach based on the dung beetle optimizer, named FedDBO. In this method, the model parameters uploaded from clients to the server are transformed into model scores. In each round of training, only some of the clients with high model scores need to be selected to upload their parameters to the server, thus reducing communication costs; Simultaneously, a model retraining strategy is introduced. After aggregating the model parameters sent by clients, the server performs a second iterative training on the aggregated model using its own metadata, thereby reducing data heterogeneity and improving model performance. In addition, a proof of convergence is provided, demonstrating that the model aggregated by FedDBO converges to the aggregated model of FedAvg after each training round. Finally, experiments indicate that when simulating various data heterogeneous environments on datasets, FedDBO exhibits higher accuracy and better stability compared to three other algorithms: FedAvg, FedShare, and FedPSO.

show abstract

Section: B Federated Optimization For Communication Cost and Data Het...mentioning

confidence: 99%