Title
Distilling the Essence of Raw Video to Reduce Memory Usage and Energy at Edge Devices
Abstract
Video broadcast and streaming are among the most widely used applications for edge devices. Roughly 82% of the mobile internet traffic is made up of video data. This is likely to worsen with the advent of 5G that will open up new opportunities for high resolution videos, virtual and augmented reality-based applications. The raw video data produced and consumed by edge devices is considerably higher than what is transmitted out of them. This leads to huge memory bandwidth and energy requirements from such edge devices. Therefore, optimizing the memory bandwidth and energy consumption needs is imperative for further improvements in energy efficiency of such edge devices. In this paper, we propose two mechanisms for on-the-fly compression and approximation of raw video data that is generated by the image sensors. The first mechanism, MidVB, performs lossless compression of the video frames coming out of the sensors and stores the compressed format into the memory. The second mechanism, Distill, builds on top of MidVB and further reduces memory consumption by approximating the video frame data. On an average, across 20 raw videos, MidVB and Distill are able to reduce the memory bandwidth by 43% and 72%, respectively, over the raw representation. They outperform a well known memory saving mechanism by 7% and 36%, respectively. Furthermore, MidVB and Distill reduce the energy consumption by 40% and 67%, respectively, over the baseline.
Year
DOI
Venue
2019
10.1145/3352460.3358298
Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture
Keywords
Field
DocType
Edge Computing, Memory, SoC, Video Streaming
Edge computing,Memory bandwidth,Image sensor,Efficient energy use,Computer science,Augmented reality,Real-time computing,Edge device,Energy consumption,Lossless compression
Conference
ISBN
Citations 
PageRank 
978-1-4503-6938-1
1
0.35
References 
Authors
0
6
Name
Order
Citations
PageRank
Haibo Zhang1343.89
Zhao, S.2674.98
Ashutosh Pattnaik31134.70
Mahmut T. Kandemir47371568.54
Anand Sivasubramaniam5102.47
Chita R. Das6103859.34