Title
On the accuracy of video quality measurement techniques
Abstract
With the massive growth of Internet video streaming, it is critical to accurately measure video quality subjectively and objectively, especially HD and UHD video which is bandwidth intensive. We summarize the creation of a database of 200 clips, with 20 unique sources tested across a variety of devices. By classifying the test videos into 2 distinct quality regions SD and HD, we show that the high correlation claimed by objective video quality metrics is led mostly by videos in the SD quality region. We perform detailed correlation analysis and statistical hypothesis testing of the HD subjective quality scores, and establish that the commonly used ACR methodology of subjective testing is unable to capture significant quality differences, leading to poor measurement accuracy for both subjective and objective metrics even on large-screen display devices.
Year
DOI
Venue
2019
10.1109/MMSP.2019.8901796
2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP)
Keywords
Field
DocType
video quality,subjective testing methodology,objective video quality metrics,video streaming
Computer vision,Internet video,Computer science,Display device,Bandwidth (signal processing),Correlation,Artificial intelligence,Accuracy and precision,Video quality,Statistical hypothesis testing,CLIPS
Conference
ISSN
ISBN
Citations 
2163-3517
978-1-7281-1818-5
1
PageRank 
References 
Authors
0.35
9
4
Name
Order
Citations
PageRank
Deepthi Nandakumar120.72
Yongjun Wu211.70
Hai Wei311.70
Avisar Ten-Ami410.35