Paper Info
Title
Users - The Hidden Software Product Quality Experts?: A Study on How App Users Report Quality Aspects in Online Reviews.
Abstract
[Context and motivation] Research on eliciting requirements from a large number of online reviews using automated means has focused on functional aspects. Assuring the quality of an app is vital for its success. This is why user feedback concerning quality issues should be considered as well [Question/problem] But to what extent do online reviews of apps address quality characteristics? And how much potential is there to extract such knowledge through automation? [Principal ideas/results] By tagging online reviews, we found that users mainly write about usability and reliability, but the majority of statements are on a subcharacteristic level, most notably regarding operability, adaptability, fault tolerance, and interoperability. A set of 16 language patterns regarding usability correctly identified 1,528 statements from a large dataset far more efficiently than our manual analysis of a small subset. [Contribution] We found that statements can especially be derived from online reviews about qualities by which users are directly affected, although with some ambiguity. Language patterns can identify statements about qualities with high precision, though the recall is modest at this time. Nevertheless, our results have shown that online reviews are an unused Big Data source for quality requirements.
Year
Venue
Field
2017
RE
World Wide Web,Interoperability,Computer science,Usability,Requirements engineering,Pattern language,Product design,Big data,Ambiguity,Non-functional requirement
DocType
Citations 
PageRank 
Conference
4
0.37
References 
Authors
14
5
Name
Order
Citations
PageRank
Eduard C. Groen1536.56
Sylwia Kopczynska2194.61
Marc P. Hauer340.71
Tobias D. Krafft441.39
Jörg Dörr59725.88