Paper Info
Title
FRL-FI: Transient Fault Analysis for Federated Reinforcement Learning-Based Navigation Systems
Abstract
Swarm intelligence is being increasingly deployed in autonomous systems, such as drones and unmanned vehicles. Federated reinforcement learning (FRL), a key swarm intelligence paradigm where agents interact with their own environments and cooperatively learn a consensus policy while preserving privacy, has recently shown potential advantages and gained popularity. However, transient faults are increasing in the hardware system with continuous technology node scaling and can pose threats to FRL systems. Meanwhile, conventional redundancy-based protection methods are challenging to deploy on resource-constrained edge applications. In this paper, we experimentally evaluate the fault tolerance of FRL navigation systems at various scales with respect to fault models, fault locations, learning algorithms, layer types, communication intervals, and data types at both training and inference stages. We further propose two cost-effective fault detection and recovery techniques that can achieve up to <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$3.3\times$</tex> improvement in resilience with <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$&lt;2.7\%$</tex> overhead in FRL systems.
Year
DOI
Venue
2022
10.23919/DATE54114.2022.9774562
2022 Design, Automation & Test in Europe Conference & Exhibition (DATE)
Keywords
DocType
ISSN
fault tolerance,resource-constrained edge applications,continuous technology node scaling,hardware system,transient faults,consensus policy,key swarm intelligence paradigm,unmanned vehicles,autonomous systems,federated reinforcement learning-based navigation systems,transient fault analysis,FRL-FI,recovery techniques,cost-effective fault detection,fault locations,fault models,FRL navigation systems
Conference
1530-1591
ISBN
Citations 
PageRank 
978-1-6654-9637-7
0
0.34
References 
Authors
3
7
Name
Order
Citations
PageRank
Zishen Wan100.68
Aqeel Anwar211.03
Abdulrahman Mahmoud321.06
Tianyu Jia401.35
Yu-Shun Hsiao501.01
Vijay Janapa Reddi62931140.26
Arijit Raychowdhury728448.04