Abstract | ||
---|---|---|
In-memory big-data processing is rapidly emerging as a promising solution for large-scale data analytics with high-performance and/or real-time requirements. In-memory big-data workloads are often hosted on servers that consist of a few multi-core CPUs and large physical memory, exhibiting the non-uniform memory access (NUMA) characteristics. While large pages are commonly known as an effective technique to reduce the performance overheads of virtual memory and widely supported across the modern hardware and system software stacks, relatively little work has been done to investigate their performance impact on in-memory big-data workloads hosted on NUMA systems. To bridge this gap, this work quantifies the performance impact of large pages on in-memory big-data workloads running on a large-scale NUMA system. Our experimental results show that large pages provide no or little performance gains over the 4KB pages when the in-memory big-data workloads process sufficiently large datasets. In addition, our experimental results show that large pages achieve higher performance gains as the dataset size of the in-memory big-data workloads decreases and the NUMA system scale increases. We also discuss the possible performance optimizations for large pages and estimate the potential performance improvements. |
Year | DOI | Venue |
---|---|---|
2016 | 10.1109/IISWC.2016.7581281 | 2016 IEEE International Symposium on Workload Characterization (IISWC) |
Keywords | Field | DocType |
NUMA systems,virtual memory,NUMA characteristics,nonuniform memory access,physical memory,multicore CPU,large-scale data analytics,in-memory Big data processing,in-memory big-data workloads,large pages | System software,Data analysis,Computer science,Virtual memory,Server,Parallel computing,Cache-only memory architecture,Real-time computing,Non-uniform memory access,Big data,Benchmark (computing),Operating system | Conference |
ISBN | Citations | PageRank |
978-1-5090-3897-8 | 4 | 0.41 |
References | Authors | |
14 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Jinsu Park | 1 | 36 | 7.43 |
Myeonggyun Han | 2 | 9 | 3.85 |
Woongki Baek | 3 | 402 | 25.85 |