Paper Info
Title
Automated Configuration Of Nosql Performance And Scalability Tactics For Data-Intensive Applications
Abstract
This paper presents the architecture, implementation and evaluation of a middleware support layer for NoSQL storage systems. Our middleware automatically selects performance and scalability tactics in terms of application specific workloads. Enterprises are turning to NoSQL storage technologies for their data-intensive computing and analytics applications. Comprehensive benchmarks of different Big Data platforms can help drive decisions which solutions to adopt. However, selecting the best performing technology, configuring the deployment for scalability and tuning parameters at runtime for an optimal service delivery remain challenging tasks, especially when application workloads evolve over time. Our middleware solves this problem at runtime by monitoring the data growth, changes in the read-write-query mix at run-time, as well as other system metrics that are indicative of sub-optimal performance. Our middleware employs supervised machine learning on historic and current monitoring information and corresponding configurations to select the best combinations of high-level tactics and adapt NoSQL systems to evolving workloads. This work has been driven by two real world case studies with different QoS requirements. The evaluation demonstrates that our middleware can adapt to unseen workloads of data-intensive applications, and automate the configuration of different families of NoSQL systems at runtime to optimize the performance and scalability of such applications.
Year
DOI
Venue
2020
10.3390/informatics7030029
INFORMATICS-BASEL
Keywords
DocType
Volume
resource optimization, hyperparameter tuning, machine learning, smart environments
Journal
7
Issue
Citations 
PageRank 
3
0
0.34
References 
Authors
0
2
Name
Order
Citations
PageRank
Davy Preuveneers170565.56
Wouter Joosen22898287.70