Paper Info
Title
Users' viewpoint of usability and user experience testing procedure - gaining methodological insights in a case of an interactive HbbTV application.
Abstract
We present a novel meta-methodological approach for the user experience and usability methodology procedure evaluation, shown in an example of the user experience and usability study of an interactive HbbTV application. The idea behind this research is not only to evaluate and improve the TV-WEB service but also to gain insights how the participants perceived the whole Ux evaluation procedure itself. The research questions focused mainly on the time complexity (temporal demand) and the frustration level of the TV-WEB evaluation procedure. Additionally the appropriateness of the selected content used, interface and interaction design, and the service impressions and satisfaction/payment related questions was sought. A special questionnaire based on the NASA TLX standard test is presented. The concept has been successfully implemented in several live field trials in three countries (BiH, Serbia and Montenegro). In the user experience and usability study of the service itself more than 150 participants were involved, of those 35 took part in the meta-methodology study. The feedback was quantitatively evaluated on a 7-point Likert scale, with \"1\" indicating the best positive feedback, \"4\" neutral/undecided feedback and \"7\" the most negative feedback. The quantitative average summary results obtained in the three evaluation studies were 1.30 for both the BiH and Serbia test study cases and the score of 1.22 for the test study case in Montenegro. These results show that a great majority of the participants found the whole evaluation procedure time-wise and frustration-wise undemanding, with appropriate content, presentation style and overall attitude towards them. By using this approach it was possible to improve the user experience and usability methodology used, producing more reliable results and providing better user experience in the final version of the product as well as providing a pleasant experience during the testing of the product.
Year
DOI
Venue
2017
10.1007/s11042-016-3898-9
Multimedia Tools Appl.
Keywords
Field
DocType
TV and Internet,User study,User experience,User centered design,Human-computer interaction,Meta-methodology,SEE TV-WEB project
User experience design,Computer science,Heuristic evaluation,Usability engineering,Usability,Usability goals,Human–computer interaction,Usability inspection,Computer user satisfaction,Multimedia,Interactive systems engineering
Journal
Volume
Issue
ISSN
76
15
1380-7501
Citations 
PageRank 
References 
2
0.37
3
Authors
3
Name
Order
Citations
PageRank
Jože Guna1357.91
Emilija Stojmenova Duh272.51
Matevž Pogačnik3122.30