Federated_Learning_Final.pdf (792.22 kB)
Download fileLyapunov-based Optimization of Edge Resources for Energy-Efficient Adaptive Federated Learning
preprint
posted on 2021-10-12, 10:36 authored by Claudio BattiloroClaudio Battiloro, Paolo Di Lorenzo, Mattia Merluzzi, Sergio BarbarossaThe aim of this paper is to propose a novel dynamic resource allocation strategy for energy-efficient adaptive federated learning at the wireless network edge, with latency and learning performance guarantees. We consider a set of devices collecting local data and uploading processed information to an edge server, which runs stochastic gradient-based algorithms to perform continuous learning and adaptation. Hinging on Lyapunov stochastic optimization tools, we dynamically optimize radio parameters (e.g., set of transmitting devices, transmit powers, bits, and rates) and computation resources (e.g., CPU cycles at devices and at server) in order to strike the best trade-off between power, latency, and performance of the federated learning task. The framework admits both a model-based implementation, where the learning performance metrics are available in closed-form, and a data-driven approach, which works with online estimates of the learning performance of interest. The method is then customized to the case of federated least mean squares (LMS) estimation, and federated training of deep convolutional neural networks. Numerical results illustrate the effectiveness of our strategy to perform energy-efficient, low-latency, adaptive federated learning at the wireless network edge.
Funding
H2020 EU-Taiwan Project 5G-CONNI nr. AMD-861459-3
H2020 project Hexa-X nr. 101015956
History
Email Address of Submitting Author
battiloro.claudio@gmail.comORCID of Submitting Author
0000-0003-0090-5355Submitting Author's Institution
La Sapienza University of RomeSubmitting Author's Country
- Italy