Title
The peering problem in tree-based master/worker overlays
Abstract
Master-worker applications often demand high throughput. A master-worker application consists of master and worker processes. The master processes generate tasks, while the worker processes compute the tasks. A peer can solely implement the master process, the worker process, or both. A scalable implementation of master-worker applications is to form an overlay network in which masters deliver their tasks to workers through their interconnect links, and workers either compute received tasks or forward some of the tasks to other workers. Different overlay construction could result in various system throughputs. In this work, we study the fundamental issue. That is, how the overlay is structured to maximize the system throughput. We first propose a basic, simple overlay formation algorithm to form an overlay. Then, we develop a number of peering strategies. The simple overlay formation algorithm is flexible to integrate these peering strategies, generating types of the overlay. Our performance studies show that the overlays based on the exploitation of network locality can perform better.
Year
DOI
Venue
2006
10.1007/11745693_9
Lecture Notes in Computer Science
Keywords
Field
DocType
tree-based master,simple overlay formation algorithm,worker overlay,network locality,different overlay construction,high throughput,overlay network,master-worker application,various system throughput,system throughput,worker process,master process
Virtual network,Locality,Computer science,Computer network,Throughput,Overlay,Overlay network,Grid,Peering,Scalability,Distributed computing
Conference
Volume
ISSN
ISBN
3947
0302-9743
3-540-33809-8
Citations 
PageRank 
References 
0
0.34
6
Authors
2
Name
Order
Citations
PageRank
Hung-Chang Hsiao125632.34
Hao Liao2515.37