Title
Analysis of and Optimization for Write-dominated Hybrid Storage Nodes in Cloud.
Abstract
Cloud providers like the Alibaba cloud routinely and widely employ hybrid storage nodes composed of solid-state drives (SSDs) and hard disk drives (HDDs), reaping their respective benefits: performance from SSD and capacity from HDD. These hybrid storage nodes generally write incoming data to its SSDs and then flush them to their HDD counterparts, referred to as the SSD Write Back (SWB) mode, thereby ensuring low write latency. When comprehensively analyzing real production workloads from Pangu, a large-scale storage platform underlying the Alibaba cloud, we find that (1) there exist many write dominated storage nodes (WSNs); however, (2) under the SWB mode, the SSDs of these WSNs suffer from severely high write intensity and long tail latency. To address these unique observed problems of WSNs, we present SSD Write Redirect (SWR), a runtime IO scheduling mechanism for WSNs. SWR judiciously and selectively forwards some or all SSD-writes to HDDs, adapting to runtime conditions. By effectively offloading the right amount of write IOs from overburdened SSDs to underutilized HDDs in WSNs, SWR is able to adequately alleviate the aforementioned problems suffered by WSNs. This significantly improves overall system performance and SSD endurance. Our trace-driven evaluation of SWR, through replaying production workload traces collected from the Alibaba cloud in our cloud testbed, shows that SWR decreases the average and 99til-percentile latencies of SSD-writes by up to 13% and 47% respectively, notably improving system performance. Meanwhile the amount of data written to SSDs is reduced by up to 70%, significantly improving SSD lifetime.
Year
DOI
Venue
2019
10.1145/3357223.3362705
SoCC '19: ACM Symposium on Cloud Computing Santa Cruz CA USA November, 2019
Keywords
Field
DocType
Hybrid Storage, Write-dominated Workload, SSD Queue Management, SSD Write Redirect
Computer science,Real-time computing,Hybrid storage,Distributed computing,Cloud computing
Conference
ISBN
Citations 
PageRank 
978-1-4503-6973-2
1
0.36
References 
Authors
0
8
Name
Order
Citations
PageRank
Shuyang Liu110.36
Shucheng Wang212.05
Qiang Cao3178.39
Ziyi Lu412.05
Hong Jiang52137157.96
Jie Yao610.36
Yuanyuan Dong764.49
Puyuan Yang842.43