Title
A testbed for managing dynamic mixed workloads
Abstract
Workload management for operational business intelligence (BI) databases is difficult. Queries vary widely in length and objectives. Resource contention is difficult to predict and to control as dynamically-arriving, long, analyst queries compete for resources with ongoing online-transaction processing (OLTP) queries and batch report queries. Currently, administrators struggle to choose workload management policies and set their thresholds manually. The goal of our project is a software framework to make the management of such mixed workloads easier. Our framework includes a policy controller that tunes workload management policies automatically to meet workload objectives. This demonstration of our system illustrates (1) the difficulty of managing a BI database workload and (2) the benefits of tuning policies automatically and individually for each service class of queries in a workload. In addition, our demonstrator is a useful research tool for understanding how policies and a policy controller adapt as the system state changes under a mixed workload. In our demo, the participant plays the administrator and tunes the policies for a variety of difficult-to-manage workloads as they execute. These policies include admission control, scheduling, and execution control policies. We visualize the policies, the user objectives, and the load on the system components (CPUs, memory, disks) during execution, which helps the participant see whether objectives are being met and make appropriate policy decisions. At the end of each workload, the participant is given the opportunity to compare how their policies met workload objectives versus policies determined by our automatic policy controller.
Year
DOI
Venue
2009
10.14778/1687553.1687591
PVLDB
Keywords
Field
DocType
transaction processing,business intelligence,software framework
Data mining,Control theory,Admission control,Workload,Scheduling (computing),Computer science,Online transaction processing,Testbed,Business intelligence,Database,Software framework
Journal
Volume
Issue
ISSN
2
2
2150-8097
Citations 
PageRank 
References 
5
0.45
4
Authors
6
Name
Order
Citations
PageRank
Stefan Krompass118413.15
Harumi A. Kuno240845.40
Janet L. Wiener33813600.46
Kevin Wilkinson426114.87
Umeshwar Dayal584522538.92
Alfons Kemper63519769.50