Title
Reducing synchronization overhead in parallel simulation
Abstract
Synchronization is often the dominant cost in conservative parallel simulation, particularly in simulations of parallel computers, in which low-latency simulated communication requires frequent synchronization. We present and evaluate LOCAL BARRIERS and PREDICTIVE BARRIER SCHEDULING, two techniques for reducing synchronization overhead in the simulation of message-passing multicomputers. Local barriers use nearest-neighbor synchronization to reduce waiting time at synchronization points. Predictive barrier scheduling, a novel technique that schedules synchronizations using both compile-time and runtime analysis, reduces the frequency of synchronization operations. In contrast to other work in this area, both techniques reduce synchronization overhead without decreasing the accuracy of network simulation. These techniques were evaluated by comparing their performance to that of periodic global synchronization. Experiments show that local barriers improve performance by up to 24% for communication-bound applications, while predictive barrier scheduling improves performance by up to 65% for applications with long local computation phases. Because the two techniques are complementary, we advocate a combined approach. This work was done in the context of PARALLEL PROTEUS, a new parallel simulator of message-passing multicomputers.
Year
DOI
Venue
1996
10.1145/238788.238822
PADS '96 Proceedings of the tenth workshop on Parallel and distributed simulation
Keywords
Field
DocType
predictive barrier scheduling,message-passing multicomputers,synchronization overhead,synchronization,frequent synchronization,local barrier,parallel simulation,synchronization operation,periodic global synchronization,nearest-neighbor synchronization,synchronization point,network simulation,conservative parallel simulation,long local computation phase,parallel computer,network simulator,low latency,context modeling,application software,message passing,nearest neighbor,predictive models,computer simulation,parallel processing,computational modeling
Computer science,Scheduling (computing),Network simulation,Real-time computing,Context model,Application software,Computation,Distributed computing,Synchronization,Simulation,Parallel computing,Schedule,Periodic graph (geometry)
Conference
Volume
Issue
ISSN
26
1
0163-6103
ISBN
Citations 
PageRank 
0-8186-7539-X
23
1.67
References 
Authors
17
2
Name
Order
Citations
PageRank
Ulana Legedza19912.14
William E. Weihl22614903.11