Paper Info
Title
Supermatrix out-of-order scheduling of matrix operations for SMP and multi-core architectures
Abstract
We discuss the high-performance parallel implementation and execution of dense linear algebra matrix operations on SMP architectures, with an eye towards multi-core processors with many cores. We argue that traditional implementations, as those incorporated in LAPACK, cannot be easily modified to render high performance as well as scalability on these architectures. The solution we propose is to arrange the data structures and algorithms so that matrix blocks become the fundamental units of data, and operations on these blocks become the fundamental units of computation, resulting in algorithms-by-blocks as opposed to the more traditional blocked algorithms. We show that this facilitates the adoption of techniques akin to dynamic scheduling and out-of-order execution usual in superscalar processors, which we name SuperMatrix Out-of-Order scheduling. Performance results on a 16 CPU Itanium2-based server are used to highlight opportunities and issues related to this new approach.
Year
DOI
Venue
2007
10.1145/1248377.1248397
SPAA
Keywords
Field
DocType
supermatrix out-of-order scheduling,dynamic scheduling,traditional implementation,performance result,matrix block,matrix operation,fundamental unit,dense linear algebra matrix,multi-core architecture,high performance,data structure,out-of-order execution,out of order,data flow,multi core processor,out of order execution
Linear algebra,Data structure,Computer science,Scheduling (computing),Parallel computing,Dynamic priority scheduling,Multi-core processor,Matrix multiplication,Out-of-order execution,Scalability,Distributed computing
Conference
Citations 
PageRank 
References 
80
4.88
18
Authors
4
Name
Order
Citations
PageRank
Ernie Chan139321.90
Enrique S. Quintana-Orti240532.27
Gregorio Quintana-Orti320915.23
Robert A. van de Geijn42047203.08