Name
Abstract | ||
|---|---|---|
Caches are universally used in computing systems to hide long off-chip memory access latencies. Unlike CPUs, massive threads running simultaneously on GPUs bring a tremendous pressure on memory hierarchy. As a result, the limitation of cache resources becomes a bottleneck for a GPU to exploit thread-level parallelism (TLP) and memory-level parallelism (MLP) and achieve high performance. In this paper, we propose a mechanism to bypass L1D and L2 cache based on the availability of cache resources. Our proposed mechanism is based on the observation that a huge number of stalls coming from limited cache resources prohibit GPUs from providing a higher throughput. So we propose Resource Aware Cache Bypass (RACB) with minor hardware changes to eliminate such stalls to improve performance. We examine the effectiveness of this approach when applied to L1D and L2 cache separately as well as together. Evaluation results with NVIDIA Computing SDK show that RACB generally improves performance the most when applied to both L1D and L2 cache, which is up to 88.05% and on an average of 16.73%, additionally, energy is saved up to 22.35% and on an average of 5.88% with minor hardware overheads. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1109/SBAC-PADW.2014.14 | SBAC-PAD Workshops |
Keywords | Field | DocType |
memory-level parallelism,racb,l1d cache,gpu,tlp,cache storage,nvidia computing sdk,graphics processing units,l2 cache,multi-threading,software tools,gpu, tlp, cache resource limitation, bypass, hardware,cache resource limitation,memory hierarchy,hardware,long off-chip memory access latencies,resource aware cache bypass,thread-level parallelism,cpu,mlp,bypass,cache resources,computing systems,parallel processing,memory management,benchmark testing,instruction sets | Cache-oblivious algorithm,Cache invalidation,Cache pollution,Computer science,Cache,Parallel computing,Page cache,Real-time computing,Cache algorithms,Cache coloring,Smart Cache | Conference |
Citations | PageRank | References |
1 | 0.36 | 12 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Hongwen Dai | 1 | 28 | 3.14 |
| Christos Kartsaklis | 2 | 26 | 4.82 |
| Chao Li | 3 | 132 | 6.04 |
| Tomislav Janjusic | 4 | 23 | 3.84 |
| Huiyang Zhou | 5 | 994 | 63.26 |