Title
CacheScouts: Fine-Grain Monitoring of Shared Caches in CMP Platforms
Abstract
As multi-core architectures flourish in the marketplace, multi-application workload scenarios (such as server consolidation) are growing rapidly. When running multiple applications simultaneously on a platform, it has been shown that contention for shared platform resources such as last-level cache can severely degrade performance and quality of service (QoS). But today's platforms do not have the capability to monitor shared cache usage accurately and disambiguate its effects on the performance behavior of each individual application. In this paper, we investigate low-overhead mechanisms for fine-grain monitoring of the use of shared cache resources along three vectors: (a) occupancy -- how much space is being used and by whom, (b) interference -- how much contention is present and who is being affected and (c) sharing -- how are threads cooperating. We propose the CacheScouts monitoring architecture consisting of novel tagging (software-guided monitoring IDs), and sampling mechanisms (set sampling) to achieve shared cache monitoring on per application basis at low overhead (\le 0.1%) and with very little loss of accuracy (\le 5%). We also present case studies to show how CacheScouts can be used by operating systems (OS) and virtual machine monitors (VMMs) for (a) characterizing execution profiles, (b) optimizing scheduling for performance management, (c) providing QoS and (d) metering for chargeback.
Year
DOI
Venue
2007
10.1109/PACT.2007.19
PACT
Keywords
Field
DocType
performance behavior,fine-grain monitoring,cache monitoring,last-level cache,shared caches,cmp platforms,cache usage,cachescouts monitoring architecture,shared cache resource,degrade performance,software-guided monitoring ids,shared platform resource,resource allocation,quality of service,virtual machine monitor,operating system,performance management
Virtual machine,Shared memory,Cache,Scheduling (computing),Computer science,Parallel computing,Quality of service,Thread (computing),Real-time computing,Resource allocation,Chargeback,Operating system
Conference
ISSN
ISBN
Citations 
1089-795X
0-7695-2944-5
47
PageRank 
References 
Authors
3.12
15
6
Name
Order
Citations
PageRank
Li Zhao160434.84
Ravishankar K. Iyer2111975.72
Ramesh Illikkal348133.98
Jaideep Moses414011.68
Srihari Makineni560037.89
Don Newell651232.67