Paper Info
Title
Experiences of On-Demand Execution for Large Scale Parameter Sweep Applications on OSG by Swift
Abstract
Large scale parameter sweep application (PSA) is one of the main grid applications, which may have different characteristics and demands. In this paper, we describe how to use swift to enable the on-demand execution of large scale PSA on open science grid (OSG). The basic on-demand concept means providing appropriate grid resources for the application, which is decided by the characteristics and demands of the application. So we can get high reliability, efficiency, and scalability for large scale independent PSA jobs on OSG. The main on-demand policies include: trust based site selection and pre-selection; scheduling policy on-demand configuration; clustering for small jobs; adaptive execution and automatic data staging; divide and conquer for the scalability. Some usage examples of swift for executing large scale PSA are presented, such as dock, blast. The experimental results for the performance of different policies are presented, with a benchmarking workload size of 10,000 jobs.
Year
DOI
Venue
2009
10.1109/HPCC.2009.43
HPCC
Keywords
Field
DocType
execution,large scale psa,open science grid,on-demand execution,large scale parameter sweep,pattern clustering,main grid application,large scale,psa,scheduling,appropriate grid resource,grid computing,main on-demand policy,grid resources,adaptive execution,osg,trust based site selection,small job clustering,basic on-demand concept,on-demand policies,independent psa job,policy on-demand configuration,large scale parameter sweep application,automatic data staging,on-demand,divide and conquer methods,scheduling policy ondemand configuration,swift,high performance computing,data mining,distributed computing,computer science,scalability,application software,divide and conquer,reliability
Grid computing,Supercomputer,Scheduling (computing),Computer science,Real-time computing,Divide and conquer algorithms,Cluster analysis,Application software,Grid,Distributed computing,Scalability
Conference
ISBN
Citations 
PageRank 
978-0-7695-3738-2
0
0.34
References 
Authors
11
6
Name
Order
Citations
PageRank
Zheng-xiong Hou1225.88
Mike Wilde235122.09
Mihael Hategan357332.86
Xingshe Zhou41621136.85
Foster Ian5229382663.24
Ben Clifford692353.26