Title
Incremental Parallelization with Migration
Abstract
We present a new methodology for developing parallel distributed programs in a series of incremental steps. The methodology takes advantage of threads that are able to migrate through the network and thus are able to follow distributed data. This allows the data to be partitioned and distributed first, which guarantees that elements that are used together in a computation are collocated on the same node. Next, the loops in the code are tiled to minimize migration among nodes. After deciding on the location at which each loop is to execute, the necessary migration and remote access statements are inserted to make the code executable. This process is repeated based on feedback obtained from the execution, which may improve the overall performance by suggesting a different data distribution or a different coarseness of tiling. We illustrate the trade-offs and the performance using a well-known application with two different data distributions.
Year
DOI
Venue
2012
10.1109/ISPA.2012.37
ISPA
Keywords
Field
DocType
incremental step,executable code,pivot-computes,data partitioning,different coarseness,parallel distributed programs,well-known application,remote access statements,multi-threading,tiling,performance improvement,software performance evaluation,new methodology,different data distribution,code executable,feedback,migration minimization,overall performance,necessary migration,data handling,remote access statement,data distribution,incremental parallelization,migration,program compilers,parallel and distributed programming,multi threading,computer science,distributed databases,synchronization,instruction sets
Multithreading,Synchronization,Instruction set,Computer science,Parallel computing,Thread (computing),Distributed database,Group method of data handling,Computation,Distributed computing,Executable
Conference
ISBN
Citations 
PageRank 
978-1-4673-1631-6
0
0.34
References 
Authors
17
5
Name
Order
Citations
PageRank
Wenhui Zhang186.05
Lei Pan2299.49
Qinghong Shang310.97
Lubomir F. Bic414719.23
Michael B. Dillencourt549857.58