Title
Reputation-Aware Hedonic Coalition Formation for Efficient Serverless Hierarchical Federated Learning
Abstract
Amid growing concerns on data privacy, Federated Learning (FL) has emerged as a promising privacy preserving distributed machine learning paradigm. Given that the FL network is expected to be implemented at scale, several studies have proposed system architectures towards improving the network scalability and efficiency. Specifically, the Hierarchical FL (HFL) network utilizes cluster heads, e.g., base stations, for the intermediate aggregation and relay of model parameters. Serverless FL is also proposed recently, in which the data owners, i.e., workers, exchange the local model parameters among a neighborhood of workers. This decentralized approach reduces the risk of a single point of failure but inevitably incurs significant communication overheads. To achieve the best of both worlds, we propose the Serverless Hierarchical Federated Learning (SHFL) framework in this article. The SHFL framework adopts a two-layer system architecture. In the lower layer, the FL workers are grouped into clusters under cluster heads. In the upper layer, the cluster heads exchange the intermediate parameters with their one-hop neighbors without the aid of a central server. To improve the sustainable efficiency of the FL system while taking into account the incentive design for workers’ marginal contributions in the system, we propose the reputation-aware hedonic coalition formation game in this article. Specifically, the workers are rewarded for their marginal contribution to the cluster, whereas the reputation opinions of each cluster head is updated in a decentralized manner, thereby deterring malicious behaviors by the cluster head. This improves the performance of the network since cluster heads with higher reputation scores are more reliable in relaying the intermediate model parameters. The simulation results show that our proposed hedonic coalition formation algorithm converges to a Nash-stable partition and improves the network efficiency.
Year
DOI
Venue
2022
10.1109/TPDS.2021.3139039
IEEE Transactions on Parallel and Distributed Systems
Keywords
DocType
Volume
Federated learning,serverless federated learning,decentralized edge intelligence,hedonic coalition formation
Journal
33
Issue
ISSN
Citations 
11
1045-9219
1
PageRank 
References 
Authors
0.35
25
8
Name
Order
Citations
PageRank
JS Ng1112.50
WYB Lim2163.24
Zehui Xiong358654.94
Xianbin Cao460960.26
Jiong Jin551146.66
Niyato Dusit69486547.06
CS Leung710.35
Chunyan Miao82307195.72