Title
Transfer And Online Reinforcement Learning In Stt-Mram Based Embedded Systems For Autonomous Drones
Abstract
In this paper we present an algorithm-hardware co design for camera-based autonomous flight in small drones. We show that the large write-latency and write-energy for nonvolatile memory (NVM) based embedded systems makes them unsuitable for real-time reinforcement learning (RL), We address this by performing transfer learning (TL) on meta environments and RL on the last few layers of a deep convolutional network. While the NVM stores the meta-model from TL, an on-die SRAM stores the weights of the last few layers. Thus all the real-time updates sia RL are carried out on the SRAM arrays. This provides us with a practical platform with comparable performance as end-to-end RL and 83.4% lower energy per image frame.
Year
DOI
Venue
2019
10.23919/DATE.2019.8715066
2019 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE)
DocType
Volume
ISSN
Journal
abs/1905.06314
1530-1591
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Insik Yoon193.36
Malik Aqeel Anwar211.37
Titash Rakshit301.69
Arijit Raychowdhury428448.04