Title
A novel warp scheduling scheme considering long-latency operations for high-performance GPUs
Abstract
Graphics processing units (GPUs) have become one of the best platforms for exploiting the plentiful thread-level parallelism of applications. However, GPUs continue to underutilize their hardware resources for optimizing the performance of numerous general-purpose applications. One primary reason for this is the inefficiency of existing warp schedulers in hiding long-latency operations such as global loads and stores. This study proposes a long-latency operation-based warp scheduler to improve GPU performance. In the proposed warp scheduler, warps are partitioned into different pools based on the characteristics of instructions that are subsequently executed. Specifically, this warp scheduler uses warps that are likely waiting for long-latency operations for a guiding role. Meanwhile, other warps perform filling roles (i.e., to overlap the latencies caused by the guiding warps). Our experimental results demonstrate that the proposed warp scheduler improves GPU performance by 24.4% on average as compared to the conventional warp scheduler.
Year
DOI
Venue
2020
10.1007/s11227-019-03091-2
The Journal of Supercomputing
Keywords
DocType
Volume
GPGPU, Performance, Memory latency, Utilization, Warp scheduling
Journal
76
Issue
ISSN
Citations 
4
0920-8542
1
PageRank 
References 
Authors
0.37
0
4
Name
Order
Citations
PageRank
Cong Thuan Do110.71
Hong Jun Choi2305.74
Sung Woo Chung362.80
Cheol Hong Kim47324.39