Title
Agile Data Streaming for Grid Applications
Abstract
The grid is proposed to be the new computing infrastructure for cross-domain resource sharing and collaboration in virtual organizations. While most current work in grid computing community focus on adaptability of grid resource management, agility is proposed in this work as another essential requirement, aiming to provide mass customization and personalization on grid computing service provision. This work is focused on data streaming aspects of grid agility. Since volumes of data streams are usually extremely high but available bandwidth and storage are often very limit in a grid environment, an enabling environment for grid data streaming applications is implemented with supports of on-demand data transfers and just-in-time data cleanups in this work. The implementation includes performance sensors, predictors and a scheduler, with real-time measurements, prediction and scheduling capabilities. The GridFTP is utilized and data transfer schedules are performed using the on-the-fly adjustable GridFTP parallelism. Experimental results show that the data streaming environment is agile enough to meet dynamically changing application data processing requirements and scale well regarding to storage and bandwidth usage.
Year
DOI
Venue
2008
10.1109/GCC.2008.10
GCC
Keywords
Field
DocType
data streaming,grid computing,agile data streaming,agile,cross-domain resource sharing,virtual organizations,data transfer schedules,easier programming,important direction,grid computing service provision,bandwidth usage,data handling,mass customization,grid,grid applications,grid resource management,parallel computer architecture,single system image,ssi study,data transfer,resource manager,scheduling,data processing,sensors,resource sharing,bandwidth,real time,parallel processing,real time systems,fractals
Data stream mining,Grid computing,Scheduling (computing),Computer science,Data grid,Semantic grid,GridFTP,Shared resource,Grid,Distributed computing
Conference
ISBN
Citations 
PageRank 
978-0-7695-3449-7
0
0.34
References 
Authors
13
5
Name
Order
Citations
PageRank
Wen Zhang1171.83
Junwei Cao293570.95
Yisheng Zhong360439.87
Lianchen Liu4619.11
Cheng Wu5115493.20