Title | ||
---|---|---|
Cypress: combining static and dynamic analysis for top-down communication trace compression |
Abstract | ||
---|---|---|
Communication traces are increasingly important, both for parallel applications' performance analysis/optimization, and for designing next-generation HPC systems. Meanwhile, the problem size and the execution scale on supercomputers keep growing, producing prohibitive volume of communication traces. To reduce the size of communication traces, existing dynamic compression methods introduce large compression overhead with the job scale. We propose a hybrid static-dynamic method that leverages information acquired from static analysis to facilitate more effective and efficient dynamic trace compression. Our proposed scheme, Cypress, extracts a program communication structure tree at compile time using inter-procedural analysis. This tree naturally contains crucial iterative computing features such as the loop structure, allowing subsequent runtime compression to \"fill in\", in a \"top-down\" manner, event details into the known communication template. Results show that Cypress reduces intra-process and inter-process compression overhead up to 5× and 9× respectively over state-of-the-art dynamic methods, while only introducing very low compiling overhead. |
Year | DOI | Venue |
---|---|---|
2014 | 10.1109/SC.2014.17 | SC |
Keywords | Field | DocType |
dynamic analysis,supercomputers,parallel application performance optimization,interprocedural analysis,top-down communication trace compression,trees (mathematics),intraprocess compression overhead,interprocess compression overhead,next-generation hpc systems,parallel application performance analysis,software performance evaluation,high performance computing,communication template,loop structure,static analysis,compile time,dynamic trace compression,cypress,execution scale,program diagnostics,hybrid static-dynamic method,message passing,dynamic compression methods,performance analysis,parallel machines,iterative computing features,trace compression,program communication structure | Cypress,Supercomputer,Trace compression,Computer science,Compile time,Top-down and bottom-up design,Parallel computing,Static analysis,Dynamic range compression,Message passing,Distributed computing | Conference |
ISSN | Citations | PageRank |
2167-4329 | 8 | 0.48 |
References | Authors | |
25 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Jidong Zhai | 1 | 340 | 36.27 |
Jianfei Hu | 2 | 8 | 0.48 |
Xiongchao Tang | 3 | 56 | 6.06 |
Xiaosong Ma | 4 | 1117 | 68.36 |
Wenguang Chen | 5 | 1014 | 70.57 |