Paper Info
Title
CARSS: Client-Aware Resource Sharing and Scheduling for Heterogeneous Applications
Abstract
Modern hardware accelerators such as GP-GPUs and DSPs are commonly being used in real-time settings such as high-performance multimedia systems and autonomous vehicles. In fact, the throughput of a wide variety of computationally demanding tasks from 3D graphics and rendering to image processing and deep learning can benefit from such specialized hardware. Such heterogeneity can affect the performance of applications running simultaneously on the same accelerator. Prior studies on resource sharing and scheduling on hardware accelerators have not attempted to account for this context. In this work, we provide a portable tagging-based cooperative scheduler and resource monitor for use by heterogeneous applications sharing a single hardware accelerator in a soft real-time environment. We also offer practical insight into how various types of applications use the hardware accelerators differently. We substantiate the feasibility of our approach and evaluate the improvement of various scheduling policies over a proprietary scheduler in several case-studies with real-world applications on 2 NVIDIA platforms: a GeForce GTX 1070 GPU and an Xavier embedded platform <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> . Although we focus on GPUs in this paper, our underlying observations and framework can also be used for sharing execution on other types of hardware accelerators. <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> The video demo has been uploaded to https://youtu.be/pziS1btsr9c
Year
DOI
Venue
2020
10.1109/RTAS48715.2020.00008
2020 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS)
Keywords
DocType
ISSN
resource sharing,gpu,heterogeneous,hardware accelerators,soft real-time
Conference
1545-3421
ISBN
Citations 
PageRank 
978-1-7281-5500-5
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Iljoo Baek1132.96
Matthew Harding201.01
Akshit Kanda300.68
Kyung Ryeol Choi400.34
Soheil Samii516516.67
Ragunathan Raj Rajkumar622.06