Abstract | ||
---|---|---|
Collaborative science demands global sharing of scientific data. But it cannot leverage universally accessible cloud-based infrastructures like Drop Box, as those offer limited interfaces and inadequate levels of access bandwidth. We present the Scibox cloud facility for online sharing scientific data. It uses standard cloud storage solutions, but offers a usage model in which high end codes can write/read data to/from the cloud via the APIs they already use for their I/O actions. With Scibox, data upload/download volumes are controlled via Data Reduction-functions stated by end users and applied at the data source, before data is moved, with further gains in efficiency obtained by combining DR-functions to move exactly what is needed by current data consumers. We evaluate Scibox with science applications and their representative data analytics - the GTS fusion and the combustion image processing - demonstrating the potential for ubiquitous data access with substantial reductions in network traffic. |
Year | DOI | Venue |
---|---|---|
2014 | 10.1109/IPDPS.2014.26 | IPDPS |
Keywords | Field | DocType |
scibox,cloud storage,application program interfaces,network traffic,data source,data download volumes,scientific data,i-o actions,combustion image processing,standard cloud storage solutions,data analysis,gts fusion,cloud storage, data sharing, scientific data,end users,ubiquitous computing,scibox cloud facility,data upload volumes,data consumers,dropbox,representative data analytics,api,ubiquitous data access,cloud computing,collaborative science,online sharing,dr-functions,data sharing,bandwidth,data models,distributed databases | Data analysis,End user,Computer science,Upload,Data sharing,Computer network,Data virtualization,Data access,Cloud storage,Database,Cloud computing,Distributed computing | Conference |
ISSN | Citations | PageRank |
1530-2075 | 4 | 0.44 |
References | Authors | |
10 | 7 |
Name | Order | Citations | PageRank |
---|---|---|---|
J. Huang | 1 | 44 | 12.63 |
Xuechen Zhang | 2 | 292 | 21.94 |
Greg Eisenhauer | 3 | 866 | 67.45 |
Karsten Schwan | 4 | 1013 | 74.53 |
Matthew Wolf | 5 | 575 | 39.27 |
Stephane Ethier | 6 | 291 | 31.10 |
Scott Klasky | 7 | 1547 | 99.00 |