Name
Title | ||
|---|---|---|
ADAPT-T: An Adaptive Algorithm for Auto-Tuning Worker Thread Pool Size in Application Servers |
Abstract | ||
|---|---|---|
Modern application servers run on multi-core hardware and these servers use multi-threading to achieve high performance. Performance of such servers is highly dependent on the number of processing threads in the worker thread pool. The optimal thread pool size (that would result in the best performance) depends on workload properties (both the application and the incoming arrival pattern). In this paper, we propose ADAPT-T, a lightweight, adaptive algorithm that can auto-adjust the thread pool size to optimize the latency. ADAPT-T exploits the concave upward property of system performance and optimizes the latency on-line by periodically monitoring the server's behaviour and then adjusts the thread pool size based on monitored statistics. It has a special locking mechanism to minimize the frequent fluctuations that may occur in latency while tuning the thread pool size. We perform extensive experiments under different workload patterns and show that ADAPT-T performs well under a wide range of workload scenarios compared to other policies. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/ISCC47284.2019.8969737 | 2019 IEEE Symposium on Computers and Communications (ISCC) |
Keywords | Field | DocType |
Self-adaptive,auto-tuning,adaptive thread-pool control,latency optimization | Thread pool,Workload,Computer science,Latency (engineering),Server,Exploit,Thread (computing),Adaptive algorithm,Application server,Distributed computing | Conference |
ISSN | ISBN | Citations |
1530-1346 | 978-1-7281-3000-2 | 0 |
PageRank | References | Authors |
0.34 | 6 | 6 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Nilushan Costa | 1 | 0 | 0.34 |
| Malith Jayasinghe | 2 | 2 | 1.70 |
| Ajantha S. Atukoralez | 3 | 0 | 0.34 |
| Supun Abeysinghe | 4 | 0 | 0.34 |
| Srinath Perera | 5 | 332 | 32.23 |
| Isuru Perera | 6 | 0 | 0.34 |