Title
LoadIQ: learning to identify workload phases from a live storage trace
Abstract
Storage infrastructure in large-scale cloud data center environments must support applications with diverse, time-varying data access patterns while observing the quality of service. Deeper storage hierarchies induced by solid state and rotating media are enabling new storage management tradeoffs that do not apply uniformly to all application phases at all times. To meet service level requirements in such heterogeneous application phases, storage management needs to be phase-aware and adaptive, i.e., to identify specific storage access patterns of applications as they occur and customize their handling accordingly. This paper presents LoadIQ, a novel, versatile, adaptive, application phase detector for networked (file and block) storage systems. In a live deployment, LoadIQ analyzes traces and emits phase labels learnt on the fly by using Support Vector Machines(SVM), a state of the art classifier. Such labels could be used to generate alerts or to trigger phase-specific system tuning. Our results show that LoadIQ is able to identify workload phases (such as in TPC-DS) with accuracy 93%.
Year
Venue
Keywords
2012
HotStorage
live storage trace,workload phase,storage system,loadiq analyzes trace,storage infrastructure,deeper storage,heterogeneous application phase,application phase,storage management,new storage management tradeoffs,application phase detector,specific storage access pattern
Field
DocType
Citations 
Software deployment,Converged storage,Workload,Computer science,Support vector machine,Quality of service,Real-time computing,Information repository,Service level requirement,Data access
Conference
2
PageRank 
References 
Authors
0.36
9
6
Name
Order
Citations
PageRank
Pankaj Pipada120.36
Achintya Kundu281.52
K. Gopinath3488.17
Chiranjib Bhattacharyya473559.64
Sai Susarla510211.46
P. C. Nagesh6494.38