Title
H3: An Application-Level, Low-Overhead Object Store
Abstract
H3 is an embedded object store, backed by a high-performance key-value store. H3 provides a user-friendly object API, similar to Amazon's S3, but is especially tailored for use in "converged" Cloud-HPC environments, where HPC applications expect from the underlying storage services to meet strict latency requirements even for high-level object operations. By embedding the object store in the application, thus avoiding the REST layer, we show that data operations gain significant performance benefits, especially for smaller sized objects. Additionally, H3's pluggable back-end architecture allows adapting the object store's scale and performance to a variety of deployment requirements. H3 supports several key-value stores, ranging from in-memory services to distributed, RDMA-based implementations. The core of H3 is H3lib, a C library with Python and Java bindings. The H3 ecosystem also includes numerous utilities and compatibility layers: The H3 FUSE filesystem allows object access using file semantics, the CSI H3 implementation uses H3 FUSE for attaching H3-backed persistent volumes in Docker and Kubernetes, while an S3proxy plug-in offers an S3 protocol-compatible endpoint for legacy applications.
Year
DOI
Venue
2021
10.1007/978-3-030-90539-2_11
HIGH PERFORMANCE COMPUTING - ISC HIGH PERFORMANCE DIGITAL 2021 INTERNATIONAL WORKSHOPS
DocType
Volume
ISSN
Conference
12761
0302-9743
Citations 
PageRank 
References 
0
0.34
0
Authors
5
Name
Order
Citations
PageRank
Antony Chazapis100.34
Efstratios Politis200.34
Giorgos Kalaentzis300.34
Christos Kozanitis400.34
Angelos Bilas500.34