Abstract | ||
---|---|---|
I/O bottlenecks in HPC applications are becoming a more pressing problem as compute capabilities continue to outpace I/O capabilities. While double-precision simulation data often must be stored losslessly, the loss of some of the fractional component may introduce acceptably small errors to many types of scientific analyses. Given this observation, we develop a precision level of detail (APLOD) library, which partitions double-precision datasets along user-defined byte boundaries. APLOD parameterizes the analysis accuracy-I/O performance tradeoff, bounds maximum relative error, maintains I/O access patterns compared to full precision, and operates with low overhead. Using ADIOS as an I/O use-case, we show proportional reduction in disk access time to the degree of precision. Finally, we show the effects of partial precision analysis on accuracy for operations such as k-means and Fourier analysis, finding a strong applicability for the use of varying degrees of precision to reduce the cost of analyzing extreme-scale data. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1109/SC.2012.26 | SC |
Keywords | Field | DocType |
detail processing,o capability,parallel processing,fourier analysis,hpc applications,aplod,i/o access patterns,double-precision simulation data,o access pattern,precision level of detail library,o bottleneck,byte-precision level,byte-precision level of detail processing,disk access time,input-output programs,partial precision analysis,full precision,bounds maximum relative error,i/o bottlenecks,precision level,o performance tradeoff,software libraries,variable precision analytics,i/o performance tradeoff,o use-case,analysis accuracy-i,lattice qcd,simd | Byte,Fourier analysis,Access time,Computer science,Level of detail,Parallel computing,SIMD,Analytics,Approximation error,Distributed computing,Extended precision | Conference |
ISSN | ISBN | Citations |
2167-4329 | 978-1-4673-0805-2 | 12 |
PageRank | References | Authors |
0.66 | 16 | 9 |
Name | Order | Citations | PageRank |
---|---|---|---|
John Jenkins | 1 | 56 | 6.72 |
Eric R. Schendel | 2 | 61 | 5.02 |
Sriram Lakshminarasimhan | 3 | 187 | 10.01 |
David A. Boyuka II | 4 | 82 | 5.52 |
Terry Rogers | 5 | 18 | 1.46 |
Stephane Ethier | 6 | 291 | 31.10 |
Robert Ross | 7 | 2717 | 173.13 |
Scott Klasky | 8 | 1547 | 99.00 |
Nagiza F. Samatova | 9 | 861 | 74.04 |