Title
Detecting and Predicting Performance Degradation Caused by Impaired Cache Isolation
Abstract
As the shared last level cache (LLC) in multicore processors has been shown to be a critical resource for system performance, much work has been proposed for improving the quality of service (QoS) and throughput on LLC. Cache Allocation Technology (CAT) and Adaptive Cache Replacement Policies (ACRP) are two of the techniques that are featured in recent Intel processors. CAT implements way partitioning and provides the ability to control the cache space allocation among cores. ACRP works with multiple replacement policies and enables the cache to adapt to the cache replacement policy with less cache misses. In this paper, we first show an interesting finding that ACRP technique can violate the performance isolation provided by CAT. We find the cause for this problem is that the ACRP chooses the cache replacement policy upon the global information even although the cache space partitioning is being enabled by CAT. As the result, the cache/performance isolation can be impaired by the interference on cache replacement policy. To deal with this problem, we propose a low overhead method to predict the worst execution time degradation caused by the replacement policy adaptation. Thus, in the partitioned cache space, if the worst execution time estimated by our method is not beyond the response time required for this program, the QoS for this program can be quaranteed no matter how the cache replacement policies alternate.
Year
DOI
Venue
2019
10.1109/ICCD46524.2019.00099
2019 IEEE 37th International Conference on Computer Design (ICCD)
Keywords
Field
DocType
Adaptive cache replacement policy,Cache partitioning,Set dueling
Space partitioning,Computer science,Temporal isolation among virtual machines,Cache,Parallel computing,Global information,Response time,Computer network,Quality of service,Throughput,Multi-core processor
Conference
ISSN
ISBN
Citations 
1063-6404
978-1-7281-1215-2
0
PageRank 
References 
Authors
0.34
2
6
Name
Order
Citations
PageRank
Yi Zhang101.01
Zhanwei Ling200.34
Ran Cui300.34
Mingsong Lv415815.88
Nan Guan59521.53
Qingxu Deng636146.24