Paper Info
Title
An Improved Usability Measure Based On Novice And Expert Performance
Abstract
The novice-expert ratio method (NEM) pinpoints user interface design problems by identifying the steps in a task that have a high ratio of novice to expert completion time. This study tested the construct validity of NEM's ratio measure against common alternatives. Data were collected from 337 participants who separately performed 10 word-completion tasks on a cellular phone interface. The logarithm, ratio, Cohen's d, and Hedges's g measures had similar construct validity, but Hedges's g provided the most accurate measure of effect size. All these measures correlated more strongly with self-reported interface usability and interface knowledge when applied to the number of actions required to complete a task than when applied to task completion time. A weighted average of both measures had the highest correlation. The relatively high correlation between self-reported interface usability and a weighted Hedges's g measure as compared to the correlations found in the literature indicates the usefulness of the weighted Hedges's g measure in identifying usability problems.
Year
DOI
Venue
2011
10.1080/10447318.2011.540472
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
DocType
Volume
Issue
Journal
27
3
ISSN
Citations 
PageRank 
1044-7318
8
0.66
References 
Authors
28
4
Name
Order
Citations
PageRank
Karl F. MacDorman180554.92
Timothy J. Whalen280.66
Chin-Chang Ho331720.37
Himalaya Patel4526.43