Title
Evaluating image quality measures to assess the impact of lossy data compression applied to climate simulation data.
Abstract
Applying lossy data compression to climate model output is an attractive means of reducing the enormous volumes of data generated by climate models. However, because lossy data compression does not exactly preserve the original data, its application to scientific data must be done judiciously. To this end, a collection of measures is being developed to evaluate various aspects of lossy compression quality on climate model output. Given the importance of data visualization to climate scientists interacting with model output, any suite of measures must include a means of assessing whether images generated from the compressed model data are noticeably different from images based on the original model data. Therefore, in this work we conduct a forced-choice visual evaluation study with climate model data that surveyed more than one hundred participants with domain relevant expertise. In addition to the images created from unaltered climate model data, study images are generated from model data that is subjected to two different types of lossy compression approaches and multiple levels (amounts) of compression. Study participants indicate whether a visual difference can be seen, with respect to the reference image, due to lossy compression effects. We assess the relationship between the perceptual scores from the user study to a number of common (full reference) image quality assessment (IQA) measures, and use statistical models to suggest appropriate measures and thresholds for evaluating lossily compressed climate data. We find the structural similarity index (SSIM) to perform the best, and our findings indicate that the threshold required for climate model data is much higher than previous findings in the literature.
Year
DOI
Venue
2019
10.1111/cgf.13707
COMPUTER GRAPHICS FORUM
Field
DocType
Volume
Computer vision,Data mining,Climate simulation,Lossy compression,Computer science,Image quality,Feature evaluation,Artificial intelligence
Journal
38.0
Issue
ISSN
Citations 
3.0
0167-7055
2
PageRank 
References 
Authors
0.38
0
3
Name
Order
Citations
PageRank
Allison H. Baker122215.49
d m hammerling293.88
Terece L. Turton320.38