Name
Abstract | ||
|---|---|---|
Migrating resources is a useful tool for balancing load in a distributed system, but it is difficult to determine when to move resources, where to move resources, and how much of them to move. We look at resource migration for file system metadata and show how CephFS's dynamic subtree partitioning approach can exploit varying degrees of locality and balance because it can partition the namespace into variable sized units. Unfortunately, the current metadata balancer is complicated and difficult to control because it struggles to address many of the general resource migration challenges inherent to the metadata management problem. To help decouple policy from mechanism, we introduce a programmable storage system that lets the designer inject custom balancing logic. We show the flexibility and transparency of this approach by replicating the strategy of a state-of-the-art metadata balancer and conclude by comparing this strategy to other custom balancers on the same system. |
Year | DOI | Venue |
|---|---|---|
2015 | 10.1145/2807591.2807607 | International Conference for High Performance Computing, Networking, Storage, and Analysis |
Keywords | Field | DocType |
Distributed file systems, file system metadata, inode caching, namespace locality | Metadata repository,Metadata,File system,Global Namespace,Computer science,Load balancing (computing),Parallel computing,Journaling file system,Metadata management,Operating system,Storage Resource Broker,Distributed computing | Conference |
ISBN | Citations | PageRank |
978-1-5090-0273-3 | 8 | 0.47 |
References | Authors | |
20 | 8 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Michael A. Sevilla | 1 | 13 | 2.31 |
| Noah Watkins | 2 | 106 | 8.09 |
| Carlos Maltzahn | 3 | 1201 | 87.49 |
| Ike Nassi | 4 | 179 | 48.46 |
| Scott A. Brandt | 5 | 1663 | 94.81 |
| Sage A. Weil | 6 | 736 | 35.96 |
| Greg Farnum | 7 | 8 | 0.47 |
| Sam Fineberg | 8 | 8 | 0.47 |