Paper Info
Title
Toward Millions of File System IOPS on Low-Cost, Commodity Hardware.
Abstract
We describe a storage system that removes I/O bottlenecks to achieve more than one million IOPS based on a user-space file abstraction for arrays of commodity SSDs. The file abstraction refactors I/O scheduling and placement for extreme parallelism and non-uniform memory and I/O. The system includes a set-associative, parallel page cache in the user space. We redesign page caching to eliminate CPU overhead and lock-contention in non-uniform memory architecture machines. We evaluate our design on a 32 core NUMA machine with four, eight-core processors. Experiments show that our design delivers 1.23 million 512-byte read IOPS. The page cache realizes the scalable IOPS of Linux asynchronous I/O (AIO) and increases user-perceived I/O performance linearly with cache hit rates. The parallel, set-associative cache matches the cache hit rates of the global Linux page cache under real workloads.
Year
DOI
Venue
2013
10.1145/2503210.2503225
SC
Keywords
Field
DocType
o scheduling,user-space file abstraction,commodity hardware,file abstraction,page cache,cache storage,file system iops,aio,o bottleneck,io scheduling,32 core numa machine,o performance linearly,lock-contention,low-cost commodity hardware,global linux page cache,millions of iops,page cache optimization,input-output programs,user space,data-intensive computing,cpu overhead,cache hit rates,extreme parallelism,nonuniform memory architecture machines,io bottlenecks,set-associative cache,design,parallel page cache,linux,cache hit rate,storage system,scalable iops,commodity ssd,linux asynchronous io,solid-state storage devices,performance,low cost,user-perceived io performance,million iops,biomedical research,bioinformatics,data intensive computing
Cache invalidation,Cache pollution,Computer science,Cache,Parallel computing,Page cache,Cache algorithms,Cache coloring,Smart Cache,Memory-mapped file,Operating system,Distributed computing
Conference
ISSN
ISBN
Citations 
2167-4329
978-1-4503-2378-9
19
PageRank 
References 
Authors
0.78
22
3
Name
Order
Citations
PageRank
Da Zheng1958.61
Randal Burns21955115.15
Alexander S. Szalay3959105.36