Title
Exploring data reliability tradeoffs in replicated storage systems
Abstract
This paper explores the feasibility of a cost-efficient storage architecture that offers the reliability and access performance characteristics of a high-end system. This architecture exploits two opportunities: First, scavenging idle storage from LAN-connected desktops not only offers a low-cost storage space, but also high I/O throughput by aggregating the I/O channels of the participating nodes. Second, the two components of data reliability - durability and availability - can be decoupled to control overall system cost. To capitalize on these opportunities, we integrate two types of components: volatile, scavenged storage and dedicated, yet low-bandwidth durable storage. On the one hand, the durable storage forms a low-cost back-end that enables the system to restore the data the volatile nodes may lose. On the other hand, the volatile nodes provide a high-throughput front-end. While integrating these components has the potential to offer a unique combination of high throughput, low cost, and durability, a number of concerns need to be addressed to architect and correctly provision the system. To this end, we develop analytical- and simulation based tools to evaluate the impact of system characteristics (e.g., bandwidth limitations on the durable and the volatile nodes) and design choices (e.g., replica placement scheme) on data availability and the associated system costs (e.g., maintenance traffic). Further, we implement and evaluate a prototype of the proposed architecture: namely a GridFTP server that aggregates volatile resources. Our evaluation demonstrates an impressive, up to 800MBps transfer throughput for the new GridFTP service.
Year
DOI
Venue
2009
10.1145/1551609.1551643
HPDC
Keywords
Field
DocType
volatile node,low-bandwidth durable storage,low-cost storage space,high-end system,scavenged storage,overall system cost,storage system,reliability tradeoffs,idle storage,cost-efficient storage architecture,associated system cost,exploring data,durable storage,reliability,cost efficiency,high throughput,front end
Replica,Architecture,Computer data storage,Computer science,Communication channel,Real-time computing,Exploit,Bandwidth (signal processing),Throughput,GridFTP,Distributed computing,Embedded system
Conference
Citations 
PageRank 
References 
12
0.71
22
Authors
2
Name
Order
Citations
PageRank
Abdullah Gharaibeh124616.75
Matei Ripeanu22461233.84