Name
Abstract | ||
|---|---|---|
Data intensive applications constitute a large and increasing share of Grid computing. However there are relatively few results on how to improve the efficiency of the basic data transfer mechanisms used to move large data set in and out of Grid nodes. In this paper we describe a simple and general technique to improve the throughput of data transfer protocols and we demonstrate it on the SDSC Storage Resource Broker (SRB), a remote storage access middleware for supercomputer applications. We achieve a maximum performance improvement of 43%/52% for remote reads/writes larger than 1MB with a few changes to the original SRB protocol. The protocol was restructured by introducing a notion of pipelining that enables the overlapping of the various stages of the data processing, such as network transfer and disk access. We present a detailed analysis of the pipelined SRB implementation and of the pipeline cost model we used to drive our design. |
Year | DOI | Venue |
|---|---|---|
2002 | 10.1007/3-540-36133-2_28 | GRID |
Keywords | Field | DocType |
large data,grid computing,original srb protocol,pipelined srb implementation,data processing,data intensive application,network transfer,data transfer protocol,remote storage access,grid node,basic data transfer mechanism,data migration,middleware,indexing terms,data intensive computing,data transfer,storage resource broker | Middleware,Pipeline (computing),Grid computing,Supercomputer,Computer science,Application programming interface,Throughput,Storage Resource Broker,Grid,Distributed computing | Conference |
Volume | ISSN | ISBN |
2536 | 0302-9743 | 3-540-00133-6 |
Citations | PageRank | References |
10 | 1.06 | 10 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Elsie Nallipogu | 1 | 10 | 1.06 |
| Füsun Özgüner | 2 | 1443 | 107.84 |
| Mario Lauria | 3 | 628 | 95.12 |