Abstract | ||
---|---|---|
H3 is an embedded object store, backed by a high-performance key-value store. H3 provides a user-friendly object API, similar to Amazon's S3, but is especially tailored for use in "converged" Cloud-HPC environments, where HPC applications expect from the underlying storage services to meet strict latency requirements even for high-level object operations. By embedding the object store in the application, thus avoiding the REST layer, we show that data operations gain significant performance benefits, especially for smaller sized objects. Additionally, H3's pluggable back-end architecture allows adapting the object store's scale and performance to a variety of deployment requirements. H3 supports several key-value stores, ranging from in-memory services to distributed, RDMA-based implementations. The core of H3 is H3lib, a C library with Python and Java bindings. The H3 ecosystem also includes numerous utilities and compatibility layers: The H3 FUSE filesystem allows object access using file semantics, the CSI H3 implementation uses H3 FUSE for attaching H3-backed persistent volumes in Docker and Kubernetes, while an S3proxy plug-in offers an S3 protocol-compatible endpoint for legacy applications. |
Year | DOI | Venue |
---|---|---|
2021 | 10.1007/978-3-030-90539-2_11 | HIGH PERFORMANCE COMPUTING - ISC HIGH PERFORMANCE DIGITAL 2021 INTERNATIONAL WORKSHOPS |
DocType | Volume | ISSN |
Conference | 12761 | 0302-9743 |
Citations | PageRank | References |
0 | 0.34 | 0 |
Authors | ||
5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Antony Chazapis | 1 | 0 | 0.34 |
Efstratios Politis | 2 | 0 | 0.34 |
Giorgos Kalaentzis | 3 | 0 | 0.34 |
Christos Kozanitis | 4 | 0 | 0.34 |
Angelos Bilas | 5 | 0 | 0.34 |