Paper Info
Title
Automatic, load-independent detection of performance regressions by transaction profiles
Abstract
Performance regression testing is an important step in the production process of enterprise applications. Yet, analysing this type of testing data is mainly conducted manually and depends on the load applied during the test. To ease such a manual task we present an automated, load-independent technique to detect performance regression anomalies based on the analysis of performance testing data using a concept known as Transaction Profile. The approach can be automated and it utilises data already available to the performance testing along with the queueing network model of the testing system. The presented ``Transaction Profile Run Report'' was able to automatically catch performance regression anomalies ca-used by software changes and isolate them from those caused by load variations with a precision of 80% in a case study conducted against an open source application. Hence, by deploying our system, the testing teams are able to detect performance regression anomalies by avoiding the manual approach and eliminating the need to do extra runs with varying load.
Year
DOI
Venue
2013
10.1145/2489280.2489286
Proceedings of the 2013 International Workshop on Joining AcadeMiA and Industry Contributions to testing Automation
Keywords
DocType
Citations 
load-independent detection,varying load,transaction profile run report,performance testing data,performance regression testing,testing system,transaction profile,testing team,performance regression anomaly,performance regression,load variation,regression testing
Conference
3
PageRank 
References 
Authors
0.43
11
4
Name
Order
Citations
PageRank
Shadi Ghaith1383.55
Miao Wang210718.49
Philip Perry335329.95
John Murphy47510.07