Title
Could Blobs Fuel Storage-Based Convergence Between HPC and Big Data?
Abstract
The increasingly growing data sets processed on HPC platforms raise major challenges for the underlying storage layer. A promising alternative to POSIX-IO-compliant file systems are simpler blobs (binary large objects), or object storage systems. They offer lower overhead and better performance at the cost of largely unused features such as file hierarchies or permissions. Similarly, blobs are increasingly considered for replacing distributed file systems for big data analytics or as a base for storage abstractions like key-value stores or time-series databases. This growing interest in such object storage on HPC and big data platforms raises the question: Are blobs the right level of abstraction to enable storage-based convergence between HPC and Big Data? In this paper we take a first step towards answering the question by analyzing the applicability of blobs for both platforms.
Year
DOI
Venue
2017
10.1109/CLUSTER.2017.63
2017 IEEE International Conference on Cluster Computing (CLUSTER)
Keywords
Field
DocType
binary large objects,file hierarchies,big data analytics,storage abstractions,key-value stores,time-series databases,blobs,storage layer,distributed file systems,object storage systems,file permissions,Big Data,storage-based convergence,POSIX-IO-compliant file systems,HPC platforms
Convergence (routing),Object storage,Data set,Computer science,Parallel computing,Fuel storage,Hierarchy,Big data,Semantics,Database,Cloud computing,Distributed computing
Conference
ISSN
ISBN
Citations 
1552-5244
978-1-5386-2327-5
1
PageRank 
References 
Authors
0.36
31
6
Name
Order
Citations
PageRank
Pierre Matri182.14
Yevhen Alforov221.05
Alvaro Brandon361.85
Michael Kuhn44211.42
Philip H. Carns596462.51
Thomas Ludwig, II64512.12