Title
Understand system's relative effectiveness using adapted confusion matrix
Abstract
The effectiveness of a system refers to the accuracy and completeness with which users achieve specified goals. These two aspects are interpreted as errors and completion in the context of usability testing. However, a holistic view of effectiveness is not straight forward to establish in a comparative test because the two measures focus on different aspects of user outputs. In this paper, we propose a predictive method to measure a system's relative effectiveness based on its own performance prediction. We achieve it by using an adapted confusion matrix to establish a correlation model between the two measures. A real-world use case is provided to demonstrate the usefulness of our method in a comparative study of the two websites.
Year
DOI
Venue
2013
10.1007/978-3-642-39229-0_32
HCI (9)
Keywords
Field
DocType
different aspect,comparative study,own performance prediction,confusion matrix,correlation model,comparative test,relative effectiveness,holistic view,real-world use case,predictive method
Data mining,Confusion matrix,Computer science,Usability,Performance prediction,Completeness (statistics)
Conference
Citations 
PageRank 
References 
0
0.34
4
Authors
2
Name
Order
Citations
PageRank
Nan Jiang1176.01
Haibin Liu200.34