Title
Challenges in crowd-based video quality assessment
Abstract
Video quality evaluation with subjective testing is both time consuming and expensive. A promising new approach to traditional testing is the so-called crowdsourcing, moving the testing effort into the Internet. The advantages of this approach are not only the access to a larger and more diverse pool of test subjects, but also the significant reduction of the financial burden. Recent contributions have also shown that crowd-based video quality assessment can deliver results comparable to traditional testing in some cases. In general, however, new problems arise, as no longer every test detail can be controlled, resulting in less reliable results. Therefore we will discuss in this contribution the conceptual, technical, motivational and reliability challenges that need to be addressed, before this promising approach to subjective testing can become a valid alternative to the testing in standardized environments.
Year
DOI
Venue
2012
10.1109/QoMEX.2012.6263866
Quality of Multimedia Experience
Keywords
Field
DocType
outsourcing,quality management,video signal processing,Internet,conceptual reliability challenges,crowd-based video quality assessment,crowdsourcing,financial burden reduction,motivational reliability challenges,standardized environments,technical reliability challenges,Crowdsourcing,cloud applications,subjective testing,video quality assessment
Computer science,Visualization,Crowdsourcing,Outsourcing,Multimedia,Video quality,Quality management,The Internet,Cloud computing
Conference
ISSN
ISBN
Citations 
2372-7179
978-1-4673-0725-3
12
PageRank 
References 
Authors
0.72
16
3
Name
Order
Citations
PageRank
Christian Keimel115012.00
Julian Habigt2796.90
Klaus Diepold343756.47