Title
Toward a Multi-method Approach: Lossy Data Compression for Climate Simulation Data.
Abstract
Earth System Model (ESM) simulations are increasingly constrained by the amount of data that they generate rather than by computational resources. The use of lossy data compression on model output can reduce storage costs and data transmission overheads, but care must be taken to ensure that science results are not impacted. Choosing appropriate compression algorithms and parameters is not trivial given the diversity of data produced by ESMs and requires an understanding of both the attributes of the data and the properties of the chosen compression methods. Here we discuss the properties of two distinct approaches for lossy compression in the context of a well-known ESM, demonstrating the different strengths of each, to motivate the development of an automated multi-method approach for compression of climate model output.
Year
Venue
Field
2017
ISC Workshops
Compression (physics),Climate model,Climate simulation,Lossy compression,Data transmission,Computer science,Earth system model,Data compression,Overhead (business),Distributed computing
DocType
Citations 
PageRank 
Conference
0
0.34
References 
Authors
17
5
Name
Order
Citations
PageRank
Allison H. Baker122215.49
Haiying Xu2272.45
d m hammerling393.88
Shaomeng Li4261.10
John Clyne5707.57