Abstract | ||
---|---|---|
Frameworks that facilitate runtime data sharingacross multiple applications are of great importance for scientificdata analytics. Although existing frameworks work well overuniform mesh data, they can not effectively handle adaptive meshrefinement (AMR) data. Among the challenges to construct anAMR-capable framework include: (1) designing an architecturethat facilitates online AMR data management, (2) achievinga load-balanced AMR data distribution for the data stagingspace at runtime, and (3) building an effective online indexto support the unique spatial data retrieval requirements forAMR data. Towards addressing these challenges to supportruntime AMR data sharing across scientific applications, wepresent the AMRZone framework. Experiments over real-worldAMR datasets demonstrate AMRZone's effectiveness at achievinga balanced workload distribution, reading/writing large-scaledatasets with thousands of parallel processes, and satisfyingqueries with spatial constraints. Moreover, AMRZone's performance and scalability are even comparable with existing state-of-the-art work when tested over uniform mesh data with up to16384 cores, in the best case, our framework achieves a 46% performance improvement. |
Year | DOI | Venue |
---|---|---|
2016 | 10.1109/CCGrid.2016.62 | 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid) |
Keywords | Field | DocType |
AMRZone framework,runtime AMR data sharing framework,scientific data analytics,adaptive mesh refinement data,AMR-capable framework,online AMR data management,,load-balanced AMR data distribution,online index,spatial data retrieval requirements,scientific applications,balanced workload distribution,large-scale dataset reading,parallel processes,spatial constraints,large-scale dataset writing | Spatial analysis,Computer science,Workload,Data sharing,Analytics,Data management,Performance improvement,Scalability,Distributed computing | Conference |
ISSN | ISBN | Citations |
2376-4414 | 978-1-5090-2454-4 | 1 |
PageRank | References | Authors |
0.36 | 16 | 11 |
Name | Order | Citations | PageRank |
---|---|---|---|
Wenzhao Zhang | 1 | 4 | 1.07 |
Houjun Tang | 2 | 53 | 15.97 |
Steve Harenberg | 3 | 17 | 5.11 |
Surendra Byna | 4 | 551 | 39.65 |
Xiaocheng Zou | 5 | 64 | 5.90 |
Dharshi Devendran | 6 | 12 | 1.67 |
Daniel Martin | 7 | 40 | 9.59 |
Kesheng Wu | 8 | 1231 | 108.30 |
Bin Dong | 9 | 108 | 13.56 |
Scott Klasky | 10 | 1547 | 99.00 |
Nagiza F. Samatova | 11 | 861 | 74.04 |