Title
FedSyL: Computation-Efficient Federated Synergy Learning on Heterogeneous IoT Devices
Abstract
As a popular privacy-preserving model training technique, Federated Learning (FL) enables multiple end-devices to collaboratively train Deep Neural Network (DNN) models without exposing local privately-owned data. According to the FL paradigm, resource-constrained end-devices in IoT should perform model training which is computation-intensive, whereas the edge server occupied with powerful computation capability only performs model aggregation. Due to the above unbalanced computation pattern, IoT-oriented FL is time-consuming and inefficient. In order to alleviate the computation burden of end-devices, recent countermeasures introduce the edge server to assist end-devices in model training. However, existing works neither efficiently address the computation heterogeneity across end-devices nor reduce the leakage risk of data privacy. To this end, we propose a Federated Synergy Learning (FedSyL) paradigm which innovatively strikes a balance between training efficiency and data leakage risk. We explore the complicated relationship between the local training latency and multi-dimensional training configurations, and design a uniform training latency prediction method by applying the polynomial quadratic regression analysis. Additionally, we design the optimal model offloading strategy with the consideration of resource limitation and computation heterogeneity of end-devices, so as to accurately assign capability=matched device-side sub-models for heterogeneous end-devices. We implement FedSyL on a real test-bed comprising multiple heterogeneous end-devices. Experimental results demonstrate the superiority of FedSyL on training efficiency and privacy protection.
Year
DOI
Venue
2022
10.1109/IWQoS54832.2022.9812907
2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS)
Keywords
DocType
ISSN
Federated Learning,Device-Edge Synergy,Model Offloading,Split Learning
Conference
1548-615X
ISBN
Citations 
PageRank 
978-1-6654-6825-1
0
0.34
References 
Authors
11
5
Name
Order
Citations
PageRank
Hui Jiang100.34
Min Liu233540.49
Sheng Sun300.34
Yuwei Wang400.34
Xiaobing Guo500.34