This paper proposes a novel scheme for cell-free massive multiple-input multiple-output (CFmMIMO) networks to support any federated learning (FL) framework. This scheme allows each instead of all the iterations of the FL framework to happen in a large-scale coherence time to guarantee a stable operation of an FL process. To show how to optimize the FL performance using this proposed scheme, we consider an existing FL framework as an example and target FL training time minimization for this framework. An optimization problem is then formulated to jointly optimize the local accuracy, transmit power, data rate, and users' processing frequency. This mixedtimescale stochastic nonconvex problem captures the complex interactions among the training time, and transmission and computation of training updates of one FL process. By employing the online successive convex approximation approach, we develop a new algorithm to solve the formulated problem with proven convergence to the neighbourhood of its stationary points. Our numerical results confirm that the presented joint design reduces the training time by up to 55% over baseline approaches. They also show that CFmMIMO here requires the lowest training time for FL processes compared with cell-free time-division multiple access massive MIMO and collocated massive MIMO. Index Terms-Cell-free massive MIMO, federated learning.
This paper aims to maximize the spectral and energy efficiencies of a content-centric cloud radio access network (C-RAN), where users requesting the same contents are grouped together. Data are transferred from a central baseband unit to multiple remote radio heads (RRHs) equipped with local caches. The RRHs then send the received data to each group's user. Both multicast and unicast schemes are considered for data transmission. We formulate mixed-integer nonlinear problems in which user association, RRH activation, data rate allocation and signal precoding are jointly designed. These challenging problems are subject to minimum data rate requirements, limited fronthaul capacity and maximum RRH transmit power. Employing successive convex quadratic programming, we propose iterative algorithms with guaranteed convergence to Fritz John solutions. Numerical results confirm that the proposed joint designs markedly improve the spectral and energy efficiencies of the considered content-centric C-RAN compared to benchmark schemes. Importantly, they show that unicasting outperforms multicasting in terms of spectral efficiency in both cache and cache-less scenarios. In terms of energy efficiency, multicasting is the best choice for the system without cache whereas unicasting is best for the system with cache. Finally, edge caching is shown to improve both spectral and energy efficiencies.
Non-Independent and Identically Distributed (non-IID) data distribution among clients is considered as the key factor that degrades the performance of federated learning (FL). Several approaches to handle non-IID data such as personalized FL and federated multi-task learning (FMTL) are of great interest to research communities. In this work, first, we formulate the FMTL problem using Laplacian regularization to explicitly leverage the relationships among the models of clients for multi-task learning. Then, we introduce a new view of the FMTL problem, which in the first time shows that the formulated FMTL problem can be used for conventional FL and personalized FL. We also propose two algorithms FedU and dFedU to solve the formulated FMTL problem in communication-centralized and decentralized schemes, respectively. Theoretically, we prove that the convergence rates of both algorithms achieve linear speedup for strongly convex and sublinear speedup of order 1/2 for nonconvex objectives. Experimentally, we show that our algorithms outperform the conventional algorithm FedAvg, FedProx, SCAFFOLD, and AFL in FL settings, MOCHA in FMTL settings, as well as pFedMe and Per-FedAvg in personalized FL settings.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.