Name
Title | ||
|---|---|---|
Profile-Based, Load-Independent Anomaly Detection and Analysis in Performance Regression Testing of Software Systems |
Abstract | ||
|---|---|---|
Performance evaluation through regression testing is an important step in the software production process. It aims to make sure that the performance of new releases do not regress under a field-like load. The main outputs of regression tests are the metrics that represent the response time of various transactions as well as the resource utilization (CPU, disk I/Oand Network). In this paper, we propose to use a concept known as Transaction Profile, which can provide a detailed representation for the transaction in a load independent manner, to detect anomalies through performance test runs. The approach uses data readily available in performance regression tests and a queueing network model of the system under test to infer the Transactions Profiles. Our initial results show that the Transactions Profiles calculated from load regression test data uncover the performance impact of any update to the software. Therefore we conclude that using Transactions Profiles is an effective approach to allow testing teams to easily assure each new software release does not suffer performance regression. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1109/CSMR.2013.54 | Software Maintenance and Reengineering |
Keywords | Field | DocType |
program testing,queueing theory,regression analysis,security of data,transaction processing,load regression test data,load-independent anomaly detection,performance regression testing,profile-based anomaly detection,queueing network model,resource utilization,software production process,software systems,transaction profile,application change,performance models,regression testing,transactions | System under test,Data mining,Risk-based testing,Computer science,White-box testing,Non-regression testing,Regression testing,Software performance testing,Software reliability testing,Reliability engineering,Software regression | Conference |
ISSN | ISBN | Citations |
1534-5351 | 978-1-4673-5833-0 | 17 |
PageRank | References | Authors |
0.82 | 9 | 4 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Shadi Ghaith | 1 | 38 | 3.55 |
| Miao Wang | 2 | 107 | 18.49 |
| Philip Perry | 3 | 353 | 29.95 |
| John Murphy | 4 | 597 | 52.43 |