Title
Performance Comparisons Of Subjective Quality Assessment Methods For Video
Abstract
Many subjective assessment methods for video quality are provided by ITU-T and ITU-R recommendations, but the differences among these methods have not been sufficiently studied. We compare five subjective assessment methods using four quantitative performance indices for both HD and QVGA resolution video. We compare the Double-Stimulus Continuous Quality-Scale (DSCQS), Double-Stimulus Impairment Scale (DSIS), Absolute Category Rating method (ACR), and ACR with Hidden Reference (ACR-HR) as common subjective assessment methods for HD and QVGA resolution videos. Furthermore, we added ACR with an 11-grade scale (ACR11) for the HD test and Subjective Assessment of Multimedia Video Quality (SAMVIQ) for the QVGA test for quality scale variations The performance indices are correlation coefficients, rank correlation coefficients, statistical reliability, and assessment time. For statistical reliability, we propose a performance index for comparing different quality scale tests. The results of the performance comparison showed that the correlation coefficients and rank correlation coefficients of the mean opinion scores between pairs of methods were high for both HD and QVGA tests. As for statistical reliability provided by the proposed index, DSIS of HD and ACR of QVGA outperformed the other methods. Moreover, ACR, ACR-HR, and ACR11 were the most efficient subjective quality assessment methods from the viewpoint of assessment time.
Year
DOI
Venue
2014
10.1587/transcom.E97.B.66
IEICE TRANSACTIONS ON COMMUNICATIONS
Keywords
Field
DocType
video quality, subjective assessment method, performance comparison, HD, QVGA, H.264
Computer science,Computer network,Subjective video quality,Video quality,Multimedia
Journal
Volume
Issue
ISSN
E97B
1
0916-8516
Citations 
PageRank 
References 
4
0.61
4
Authors
5
Name
Order
Citations
PageRank
Toshiko Tominaga161.03
Masataka Masuda282.76
Jun Okamoto3122.87
Akira Takahashi4337.98
Takanori Hayashi514921.87