Title
Usage of Subjective Scales in Accessibility Research
Abstract
Accessibility research studies often gather subjective responses to technology using Likert-type items, where participants respond to a prompt statement by selecting a position on a labeled response scale. We analyzed recent ASSETS papers, and found that participants in non-anonymous accessibility research studies gave more positive average ratings than those in typical usability studies, especially when responding to questions about a proposed innovation. We further explored potential positive response bias in an experimental study of two telephone information systems, one more usable than the other. We found that participants with visual impairment were less sensitive to usability problems than participants in a typical student sample, and that their subjective ratings didn't correlate as strongly with objective measures of performance. A deeper understanding of the mechanism behind this effect would help researchers to design better accessibility studies, and to interpret subjective ratings with more accuracy.
Year
DOI
Venue
2015
10.1145/2700648.2809867
ACM Conference on Supporting Group Work
Keywords
Field
DocType
Likert,accessibility,response bias
Visual impairment,USable,Information system,Response bias,Computer science,Usability,Human–computer interaction,Likert scale,Multimedia
Conference
Citations 
PageRank 
References 
6
0.45
14
Authors
3
Name
Order
Citations
PageRank
Shari Trewin164777.36
Diogo Marques2366.33
Tiago Guerreiro336645.90