Paper Info
Title
Frugal following: power thrifty object detection and tracking for mobile augmented reality
Abstract
Accurate tracking of objects in the real world is highly desirable in Augmented Reality (AR) to aid proper placement of virtual objects in a user's view. Deep neural networks (DNNs) yield high precision in detecting and tracking objects, but they are energy-heavy and can thus be prohibitive for deployment on mobile devices. Towards reducing energy drain while maintaining good object tracking precision, we develop a novel software framework called MARLIN. MARLIN only uses a DNN as needed, to detect new objects or recapture objects that significantly change in appearance. It employs lightweight methods in between DNN executions to track the detected objects with high fidelity. We experiment with several baseline DNN models optimized for mobile devices, and via both offline and live object tracking experiments on two different Android phones (one utilizing a mobile GPU), we show that MARLIN compares favorably in terms of accuracy while saving energy significantly. Specifically, we show that MARLIN reduces the energy consumption by up to 73.3% (compared to an approach that executes the best baseline DNN continuously), and improves accuracy by up to 19× (compared to an approach that infrequently executes the same best baseline DNN). Moreover, while in 75% or more cases, MARLIN incurs at most a 7.36% reduction in location accuracy (using the common IOU metric), in more than 46% of the cases, MARLIN even improves the IOU compared to the continuous, best DNN approach.
Year
DOI
Venue
2019
10.1145/3356250.3360044
Proceedings of the 17th Conference on Embedded Networked Sensor Systems
Keywords
Field
DocType
convolutional neural network, energy efficiency, mobile augmented reality, object detection and tracking
Object detection,Computer science,Augmented reality,Real-time computing,Human–computer interaction
Conference
ISBN
Citations 
PageRank 
978-1-4503-6950-3
4
0.40
References 
Authors
0
5
Name
Order
Citations
PageRank
Kittipat Apicharttrisorn140.74
Xukan Ran2683.94
Jiasi Chen318514.80
Srikanth Krishnamurthy41919124.08
Amit K. Roy Chowdhury5115373.96