Title
"How Do I Evaluate THAT?" Experiences from a Systems-Level Evaluation Effort
Abstract
In this paper we describe our experience deriving evaluation metrics for a systems-level framework called Ripple that connects software engineering and usability engineering life cycles. This evaluation was conducted with eight teams of graduate students (falling under four types of development models) competing in a joint software engineering and usability engineering course to create a software solution for a real world client. We describe the challenges of evaluating systems-level frameworks and the approach we used to derive metrics given our evaluation context. We conclude with the outcome of this evaluation and the effectiveness of the metrics we employed.
Year
DOI
Venue
2009
10.1007/978-3-642-02806-9_34
HCI
Keywords
Field
DocType
evaluation metrics,usability engineering life cycle,systems-level framework,evaluation context,joint software engineering,graduate student,development model,usability engineering course,software engineering,systems-level evaluation effort,software solution,goal question metric,life cycle,usability engineering
GQM,Software engineering,Systems engineering,Usability engineering,Heuristic evaluation,Computer science,Usability,Usability goals,Component-based usability testing,System usability scale,Social software engineering
Conference
Volume
ISSN
Citations 
5619
0302-9743
0
PageRank 
References 
Authors
0.34
6
6
Name
Order
Citations
PageRank
Pardha S. Pyla11239.22
H. Rex Hartson2873553.53
perez quinones365187.57
James D. Arthur424228.49
Tonya L. Smith-jackson5759.22
Deborah Hix61028136.87