Title
A topical evaluation and discussion of data movement technologies for data-intensive scientific applications
Abstract
Transferring large volumes of information from one location to potentially many others that are geographically distributed and across varying networks is still prevalent in modern scientific data systems. This is despite the movement to push computation to the data and to reduce data movement needed to compute answers to challenging scientific problems, to disseminate information to the scientific community, and to acquire data for curation and enrichment. Because of this, it is imperative that decisions made regarding data movement systems and architectures be backed by both analytical rigor, and also by empirical evidence and measurement. The purpose of this study is to expand on the work performed by our research team over the last decade and to take a fresh look at the evaluation of multiple topical data transfer technologies in use cases derived from data-intensive scientific systems and applications in the areas of Earth science. We report on the evaluation of a set of data movement technologies against a set of empirically derived comparison dimensions. Based on this evaluation, we make recommendations towards the selection of appropriate data movement technologies in scientific applications and scenarios.
Year
DOI
Venue
2016
10.1007/s12145-015-0243-1
Earth Science Informatics
Keywords
Field
DocType
Data movement, Globus online, Amazon, Cloud computing
Data science,Data mining,Use case,Empirical evidence,Computer science,Data system,Dissemination,Cloud computing
Journal
Volume
Issue
ISSN
9
2
1865-0481
Citations 
PageRank 
References 
1
0.40
9
Authors
5
Name
Order
Citations
PageRank
Chris A. Mattmann120025.39
Luca Cinquini210.74
Paul Zimdars392.44
Michael J. Joyce441.24
Shakeh E. Khudikyan510.74