Paper Info
Title
Computing Programs Containing Band Linear Recurrences on Vector Supercomputers
Abstract
Many large-scale scientific and engineering computations, e.g., some of the Grand Challenge problems [1], spend a major portion of execution time in their core loops computing band linear recurrences (BLRs). Conventional compiler parallelization techniques[4] cannot generate scalable parallel code for this type of computation because they respect loop-carried dependences (LCDs) in programs, and there is a limited amount of parallelism in a BLR with respect to LCDs. For many applications, using library routines to replace the core BLR requires the separation of BLR from its dependent computation, which usually incurs significant overhead. In this paper, we present a new scalable algorithm, called the Regular Schedule, for parallel evaluation of BLRs. We describe our implementation of the Regular Schedule and discuss how to obtain maximum memory throughput in implementing the schedule on vector supercomputers. We also illustrate our approach, based on our Regular Schedule, to parallelizing programs containing BLR and other kinds of code. Significant improvements in CPU performance for a range of programs containing BLR implemented using the Regular Schedule in C over the same programs implemented using highly optimized coded-in-assembly BLAS routines [11] are demonstrated on Convex C240. Our approach can be used both at the user level in parallel programming code containing BLRs, and in compiler parallelization of such programs combined with recurrence recognition techniques for vector supercomputers.
Year
DOI
Venue
1996
10.1109/71.532109
IEEE Trans. Parallel Distrib. Syst.
Keywords
DocType
Volume
vector supercomputers,core loop,parallel evaluation,regular schedule,dependent computation,parallel programming code,linear recurrences,conventional compiler parallelization technique,core blr,compiler parallelization,computing programs containing band,scalable parallel code,scheduling algorithm,throughput,cpu performance,vectors,parallel programming,parallel processing,concurrent computing
Journal
7
Issue
ISSN
Citations 
8
1045-9219
7
PageRank 
References 
Authors
0.56
22
4
Name
Order
Citations
PageRank
Haigeng Wang1687.39
Alexandru Nicolau22265307.74
Stephen Keung3292.29
Kai-Yeung Sunny Siu4996110.51