Title
Byte-precision level of detail processing for variable precision analytics
Abstract
I/O bottlenecks in HPC applications are becoming a more pressing problem as compute capabilities continue to outpace I/O capabilities. While double-precision simulation data often must be stored losslessly, the loss of some of the fractional component may introduce acceptably small errors to many types of scientific analyses. Given this observation, we develop a precision level of detail (APLOD) library, which partitions double-precision datasets along user-defined byte boundaries. APLOD parameterizes the analysis accuracy-I/O performance tradeoff, bounds maximum relative error, maintains I/O access patterns compared to full precision, and operates with low overhead. Using ADIOS as an I/O use-case, we show proportional reduction in disk access time to the degree of precision. Finally, we show the effects of partial precision analysis on accuracy for operations such as k-means and Fourier analysis, finding a strong applicability for the use of varying degrees of precision to reduce the cost of analyzing extreme-scale data.
Year
DOI
Venue
2012
10.1109/SC.2012.26
SC
Keywords
Field
DocType
detail processing,o capability,parallel processing,fourier analysis,hpc applications,aplod,i/o access patterns,double-precision simulation data,o access pattern,precision level of detail library,o bottleneck,byte-precision level,byte-precision level of detail processing,disk access time,input-output programs,partial precision analysis,full precision,bounds maximum relative error,i/o bottlenecks,precision level,o performance tradeoff,software libraries,variable precision analytics,i/o performance tradeoff,o use-case,analysis accuracy-i,lattice qcd,simd
Byte,Fourier analysis,Access time,Computer science,Level of detail,Parallel computing,SIMD,Analytics,Approximation error,Distributed computing,Extended precision
Conference
ISSN
ISBN
Citations 
2167-4329
978-1-4673-0805-2
12
PageRank 
References 
Authors
0.66
16
9
Name
Order
Citations
PageRank
John Jenkins1566.72
Eric R. Schendel2615.02
Sriram Lakshminarasimhan318710.01
David A. Boyuka II4825.52
Terry Rogers5181.46
Stephane Ethier629131.10
Robert Ross72717173.13
Scott Klasky8154799.00
Nagiza F. Samatova986174.04