Title
AMRZone: A Runtime AMR Data Sharing Framework for Scientific Applications
Abstract
Frameworks that facilitate runtime data sharingacross multiple applications are of great importance for scientificdata analytics. Although existing frameworks work well overuniform mesh data, they can not effectively handle adaptive meshrefinement (AMR) data. Among the challenges to construct anAMR-capable framework include: (1) designing an architecturethat facilitates online AMR data management, (2) achievinga load-balanced AMR data distribution for the data stagingspace at runtime, and (3) building an effective online indexto support the unique spatial data retrieval requirements forAMR data. Towards addressing these challenges to supportruntime AMR data sharing across scientific applications, wepresent the AMRZone framework. Experiments over real-worldAMR datasets demonstrate AMRZone's effectiveness at achievinga balanced workload distribution, reading/writing large-scaledatasets with thousands of parallel processes, and satisfyingqueries with spatial constraints. Moreover, AMRZone's performance and scalability are even comparable with existing state-of-the-art work when tested over uniform mesh data with up to16384 cores, in the best case, our framework achieves a 46% performance improvement.
Year
DOI
Venue
2016
10.1109/CCGrid.2016.62
2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid)
Keywords
Field
DocType
AMRZone framework,runtime AMR data sharing framework,scientific data analytics,adaptive mesh refinement data,AMR-capable framework,online AMR data management,,load-balanced AMR data distribution,online index,spatial data retrieval requirements,scientific applications,balanced workload distribution,large-scale dataset reading,parallel processes,spatial constraints,large-scale dataset writing
Spatial analysis,Computer science,Workload,Data sharing,Analytics,Data management,Performance improvement,Scalability,Distributed computing
Conference
ISSN
ISBN
Citations 
2376-4414
978-1-5090-2454-4
1
PageRank 
References 
Authors
0.36
16
11
Name
Order
Citations
PageRank
Wenzhao Zhang141.07
Houjun Tang25315.97
Steve Harenberg3175.11
Surendra Byna455139.65
Xiaocheng Zou5645.90
Dharshi Devendran6121.67
Daniel Martin7409.59
Kesheng Wu81231108.30
Bin Dong910813.56
Scott Klasky10154799.00
Nagiza F. Samatova1186174.04