Name
Abstract | ||
|---|---|---|
This paper surveys and demonstrates the power of non-strict evaluation in applications executed on distributed architectures. We present the design, implementation, and experimental evaluation of single assignment, incomplete data structures in a distributed memory architecture and Abstract Network Machine (ANM). Incremental Structures (IS), Incremental Structure Software Cache (ISSC), and Dynamic Incremental Structures (DIS) provide nonstrict data access and fully asynchronous operations that make them highly suited for the exploitation of fine-grain parallelism in distributed memory systems. We focus on split-phase memory operations and non-strict information processing under a distributed address space to improve the overall system performance. A novel technique of optimization at the communication level is proposed and described. We use partial evaluation of local and remote memory accesses not only to remove much of the excess overhead of message passing, but also to reduce the number of messages when some information about the input or part of the input is known. We show that split-phase transactions of IS, together with the ability of deferring reads, allow partial evaluation of distributed programs without losing determinacy. Our experimental evaluation indicates that commodity PC clusters with both IS and a caching mechanism, ISSC, are more robust. The system can deliver speedup for both regular and irregular applications. We also show that partial evaluation of memory accesses decreases the traffic in the interconnection network and improves the performance of MPI IS and MPI ISSC applications. |
Year | DOI | Venue |
|---|---|---|
2003 | 10.1023/A:1022664724413 | International Journal of Parallel Programming |
Keywords | Field | DocType |
split-phase memory operation,memory system,incremental structure software cache,experimental evaluation,memory architecture,non-strict execution,remote memory,dynamic incremental structures,memory access,non-strict evaluation,partial evaluation,information processing,distributed architecture,system performance,distributed memory,data access,message passing | Address space,Data structure,Asynchronous communication,Information processing,Partial evaluation,Computer science,Parallel computing,Data access,Message passing,Distributed computing,Speedup | Journal |
Volume | Issue | ISSN |
31 | 2 | 1573-7640 |
Citations | PageRank | References |
3 | 0.39 | 31 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Alfredo Cristobal-Salas | 1 | 3 | 0.39 |
| Andrei Tchernykh | 2 | 427 | 50.05 |
| Jean-Luc Gaudiot | 3 | 938 | 121.51 |
| Wen-Yen Lin | 4 | 58 | 11.47 |