Title
Metrics for measuring the performance of the mixed workload CH-benCHmark
Abstract
Advances in hardware architecture have begun to enable database vendors to process analytical queries directly on operational database systems without impeding the performance of mission-critical transaction processing too much. In order to evaluate such systems, we recently devised the mixed workload CH-benCHmark, which combines transactional load based on TPC-C order processing with decision support load based on TPC-H-like query suite run in parallel on the same tables in a single database system. Just as the data volume of actual enterprises tends to increase over time, an inherent characteristic of this mixed workload benchmark is that data volume increases during benchmark runs, which in turn may increase response times of analytic queries. For purely transactional loads, response times typically do not depend that much on data volume, as the queries used within business transactions are less complex and often indexes are used to answer these queries with point-wise accesses only. But for mixed workloads, the insert throughput metric of the transactional component interferes with the response-time metric of the analytic component. In order to address the problem, in this paper we analyze the characteristics of CH-benCHmark queries and propose normalized metrics which account for data volume growth.
Year
DOI
Venue
2011
10.1007/978-3-642-32627-1_2
TPCTC
Keywords
Field
DocType
operational database system,mixed workload,response time,tpc-c order processing,data volume growth,mixed workload benchmark,mixed workloads,database vendor,data volume increase,data volume
Order processing,Transaction processing,Data mining,Operational database,Workload,Computer science,Decision support system,Real-time business intelligence,Throughput,Distributed computing,Hardware architecture
Conference
Citations 
PageRank 
References 
7
0.48
3
Authors
9
Name
Order
Citations
PageRank
Florian Funke1937.86
Alfons Kemper23519769.50
Stefan Krompass318413.15
Harumi Kuno429721.62
Raghunath Nambiar511118.92
Thomas Neumann62523156.50
Anisoara Nica728835.67
Meikel Poess869664.64
Michael Seibold91147.86