Title
DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications.
Abstract
The rapid emergence of head-mounted devices such as the Microsoft Holo-lens enables a wide variety of continuous vision applications. Such applications often adopt deep-learning algorithms such as CNN and RNN to extract rich contextual information from the first-person-view video streams. Despite the high accuracy, use of deep learning algorithms in mobile devices raises critical challenges, i.e., high processing latency and power consumption. In this paper, we propose DeepMon, a mobile deep learning inference system to run a variety of deep learning inferences purely on a mobile device in a fast and energy-efficient manner. For this, we designed a suite of optimization techniques to efficiently offload convolutional layers to mobile GPUs and accelerate the processing; note that the convolutional layers are the common performance bottleneck of many deep learning models. Our experimental results show that DeepMon can classify an image over the VGG-VeryDeep-16 deep learning model in 644ms on Samsung Galaxy S7, taking an important step towards continuous vision without imposing any privacy concerns nor networking cost.
Year
DOI
Venue
2017
10.1145/3081333.3081360
MobiSys
Keywords
Field
DocType
Mobile GPU,Mobile Sensing,Deep Learning,Continuous Vision
Bottleneck,Contextual information,Suite,Computer science,Latency (engineering),Real-time computing,Mobile device,Artificial intelligence,Deep learning,Power consumption,Inference system
Conference
Citations 
PageRank 
References 
56
1.59
33
Authors
3
Name
Order
Citations
PageRank
Huynh Nguyen Loc1593.00
Youngki Lee283270.33
Rajesh Krishna Balan3105680.30