Title
The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining
Abstract
In Machine Learning, the emergence of the right to be forgotten gave birth to a paradigm named machine unlearning, which enables data holders to proactively erase their data from a trained model. Existing machine unlearning techniques focus on centralized training, where access to all holders’ training data is a must for the server to conduct the unlearning process. It remains largely underexplored about how to achieve unlearning when full access to all training data becomes unavailable. One noteworthy example is Federated Learning (FL), where each participating data holder trains locally, without sharing their training data to the central server. In this paper, we investigate the problem of machine unlearning in FL systems. We start with a formal definition of the unlearning problem in FL and propose a rapid retraining approach to fully erase data samples from a trained FL model. The resulting design allows data holders to jointly conduct the unlearning process efficiently while keeping their training data locally. Our formal convergence and complexity analysis demonstrate that our design can preserve model utility with high efficiency. Extensive evaluations on four real-world datasets illustrate the effectiveness and performance of our proposed realization.
Year
DOI
Venue
2022
10.1109/INFOCOM48880.2022.9796721
IEEE INFOCOM 2022 - IEEE Conference on Computer Communications
Keywords
DocType
ISSN
Federated Learning,Machine Learning,paradigm named machine unlearning,data holders,trained model,centralized training,unlearning process,training data,participating data holder trains,unlearning problem,rapid retraining approach,data samples,trained FL model
Conference
0743-166X
ISBN
Citations 
PageRank 
978-1-6654-5823-8
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Yi Liu100.34
Lei Xu2315.26
Xingliang Yuan317125.91
Cong Wang44463204.50
Bo Li557845.93