Title
Stochastic Client Selection for Federated Learning With Volatile Clients
Abstract
Federated learning (FL), arising as a privacy-preserving machine learning paradigm, has received notable attention from the public. In each round of synchronous FL training, only a fraction of available clients are chosen to participate, and the selection decision might have a significant effect on the training efficiency, as well as the final model performance. In this article, we investigate the client selection problem under a volatile context, in which the local training of heterogeneous clients is likely to fail due to various kinds of reasons and in different levels of frequency. Intuitively, too much training failure might potentially reduce the training efficiency, while too much selection on clients with greater stability might introduce bias, thereby resulting in degradation of the training effectiveness. To tackle this tradeoff, we, in this article, formulate the client selection problem under joint consideration of effective participation and fairness. Furthermore, we propose E3CS, a stochastic client selection scheme as a solution. According to our experimental results over a public data set, the proposed selection scheme is able to achieve up to <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$2\times $ </tex-math></inline-formula> faster convergence to a fixed model accuracy while maintaining the same level of final model accuracy, compared with the state-of-the-art selection schemes.
Year
DOI
Venue
2022
10.1109/JIOT.2022.3172113
IEEE Internet of Things Journal
Keywords
DocType
Volume
Adversarial multiarm bandit (MAB),client selection,exponential-weight algorithm for exploration and exploitation (Exp3),fairness scheduling,federated learning (FL)
Journal
9
Issue
ISSN
Citations 
20
2327-4662
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Tiansheng Huang160.84
Weiwei Lin214312.22
Keqin Li32778242.13
Albert Y. Zomaya45709454.84