Abstract | ||
---|---|---|
With the massive growth of Internet video streaming, it is critical to accurately measure video quality subjectively and objectively, especially HD and UHD video which is bandwidth intensive. We summarize the creation of a database of 200 clips, with 20 unique sources tested across a variety of devices. By classifying the test videos into 2 distinct quality regions SD and HD, we show that the high correlation claimed by objective video quality metrics is led mostly by videos in the SD quality region. We perform detailed correlation analysis and statistical hypothesis testing of the HD subjective quality scores, and establish that the commonly used ACR methodology of subjective testing is unable to capture significant quality differences, leading to poor measurement accuracy for both subjective and objective metrics even on large-screen display devices. |
Year | DOI | Venue |
---|---|---|
2019 | 10.1109/MMSP.2019.8901796 | 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP) |
Keywords | Field | DocType |
video quality,subjective testing methodology,objective video quality metrics,video streaming | Computer vision,Internet video,Computer science,Display device,Bandwidth (signal processing),Correlation,Artificial intelligence,Accuracy and precision,Video quality,Statistical hypothesis testing,CLIPS | Conference |
ISSN | ISBN | Citations |
2163-3517 | 978-1-7281-1818-5 | 1 |
PageRank | References | Authors |
0.35 | 9 | 4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Deepthi Nandakumar | 1 | 2 | 0.72 |
Yongjun Wu | 2 | 1 | 1.70 |
Hai Wei | 3 | 1 | 1.70 |
Avisar Ten-Ami | 4 | 1 | 0.35 |