Paper Info
Title
Wharf: Sharing Docker Images in a Distributed File System.
Abstract
Container management frameworks, such as Docker, package diverse applications and their complex dependencies in self-contained images, which facilitates application deployment, distribution, and sharing. Currently, Docker employs a shared-nothing storage architecture, i.e. every Docker-enabled host requires its own copy of an image on local storage to create and run containers. This greatly inflates storage utilization, network load, and job completion times in the cluster. In this paper, we investigate the option of storing container images in and serving them from a distributed file system. By sharing images in a distributed storage layer, storage utilization can be reduced and redundant image retrievals from a Docker registry become unnecessary. We introduce Wharf, a middleware to transparently add distributed storage support to Docker. Wharf partitions Docker's runtime state into local and global parts and efficiently synchronizes accesses to the global state. By exploiting the layered structure of Docker images, Wharf minimizes the synchronization overhead. Our experiments show that compared to Docker on local storage, Wharf can speed up image retrievals by up to 12x, has more stable performance, and introduces only a minor overhead when accessing data on distributed storage.
Year
DOI
Venue
2018
10.1145/3267809.3267836
SoCC '18: ACM Symposium on Cloud Computing Carlsbad CA USA October, 2018
Keywords
Field
DocType
Container, Docker, Distributed File System
Distributed File System,Middleware,Architecture,Synchronization,Software deployment,Computer science,Distributed data store,Real-time computing,Operating system,Speedup,Wharf
Conference
ISBN
Citations 
PageRank 
978-1-4503-6011-1
3
0.45
References 
Authors
18
8
Name
Order
Citations
PageRank
Chao Zheng1166.74
Lukas Rupprecht26010.88
Vasily Tarasov319918.98
Douglas Thain41530127.00
Mohamed Mohamed510211.49
Dimitrios Skourtis672.30
Amit Warke783.00
Dean Hildebrand814614.96