Title
Deep Learning on Computational-Resource-Limited Platforms: A Survey.
Abstract
Nowadays, Internet of Things (IoT) gives rise to a huge amount of data. IoT nodes equipped with smart sensors can immediately extract meaningful knowledge from the data through machine learning technologies. Deep learning (DL) is constantly contributing significant progress in smart sensing due to its dramatic superiorities over traditional machine learning. The promising prospect of wide-range applications puts forwards demands on the ubiquitous deployment of DL under various contexts. As a result, performing DL on mobile or embedded platforms is becoming a common requirement. Nevertheless, a typical DL application can easily exhaust an embedded or mobile device owing to a large amount of multiply and accumulate (MAC) operations and memory access operations. Consequently, it is a challenging task to bridge the gap between deep learning and resource-limited platforms. We summarize typical applications of resource-limited deep learning and point out that deep learning is an indispensable impetus of pervasive computing. Subsequently, we explore the underlying reasons for the high computational overhead of DL through reviewing the fundamental concepts including capacity, generalization, and backpropagation of a neural network. Guided by these concepts, we investigate on principles of representative research works, as well as three types of solutions: algorithmic design, computational optimization, and hardware revolution. In pursuant to these solutions, we identify challenges to be addressed.
Year
DOI
Venue
2020
10.1155/2020/8454327
MOBILE INFORMATION SYSTEMS
Field
DocType
Volume
Computer science,Artificial intelligence,Deep learning,Computational resource,Distributed computing
Journal
2020
ISSN
Citations 
PageRank 
1574-017X
0
0.34
References 
Authors
42
7
Name
Order
Citations
PageRank
Chunlei Chen102.37
Peng Zhang200.34
Huixiang Zhang300.34
Jiangyan Dai4144.19
Yugen Yi59215.25
Huihui Zhang600.34
Yonghui Zhang701.01