Title
Support and optimization for parallel sparse programs with array intrinsics of Fortran 90
Abstract
Fortran 90 provides a rich set of array intrinsic functions that are useful for representing array expressions and data parallel programming. However, the application of these intrinsic functions to sparse data sets in distributed memory environments, is currently not supported by vendors of Fortran 90 and HPF compilers. Our recent research work has been aimed at, providing parallel processing supports for sparse array intrinsics of Fortran 90. Our supporting library uses the following two-level design: (1) in our low-level routines, a sparse input matrix needs to be specified with compression/distribution schemes by programmers, and (2) in the high-level representation, sparse array functions are overloaded for array intrinsic interfaces so that programmers need not be concerned about low-level details. This raises a very interesting optimization problem in the strategies used to transform high-level representations to low-level routines by the automatic selection of distribution and compression schemes for sparse data sets. In this paper, we propose solutions to address this optimization problem, which is shown to be NP-hard. We develop a heuristic algorithm based on annotated program graphs. To the best of our knowledge, our selection scheme, is the first to automatically select compression and distribution schemes for sparse data arrays with the array intrinsics of Fortran 90 in a distributed memory environment. Experimental results show that our selection algorithms are consistent with our cost model, and effective in selecting appropriate compression and distribution schemes for improving the performance of application programs that operate on sparse data sets. Our experiments were performed on an IBM SP-2 machine using our parallel sparse array intrinsics for Fortran 90.
Year
DOI
Venue
2004
10.1016/j.parco.2004.02.004
Parallel Computing
Keywords
Field
DocType
sparse array function,fortran 90 array intrinsics,sparse computations,parallel sparse program,sparse array intrinsics,low-level routine,sparse input matrix,parallel sparse array intrinsics,sparse data set,distributed environments,parallel sparse compiler,high-level representation,sparse data array,memory environment,distribution scheme,optimizing compilers,data parallel programming,distributed environment,sparse data,optimizing compiler,parallel processing,optimization problem,distributed memory,heuristic algorithm,algorithms,data acquisition
Sparse array,Computer science,Parallel computing,Sparse approximation,Distributed memory,Fortran,Compiler,Theoretical computer science,Optimization problem,Intrinsics,Sparse matrix
Journal
Volume
Issue
ISSN
30
4
Parallel Computing
Citations 
PageRank 
References 
2
0.37
21
Authors
3
Name
Order
Citations
PageRank
Rong-Guey Chang19914.70
Tyng-Ruey Chuang219828.00
Jenq Kuen Lee345948.71