Paper Info
Title
A Weighted Fat-Tree Routing Algorithm for Efficient Load-Balancing in Infini Band Enterprise Clusters
Abstract
Infini Band (IB) has become a popular network interconnect for high performance computing (HPC) systems. Many of the large IB-based HPC systems use some variant of the fat-tree topology to take advantage of the useful properties fat-trees offer. The fat-tree routing algorithm is one of the most efficient deterministic routing algorithms for fat-tree topologies. The algorithm ensures that the number of routes assigned to each link are balanced across the fabric. However, one problem with its load-balancing technique is that it assumes uniform traffic distribution in the network. When routes towards nodes that mainly consume large amount of data are assigned to share links in the fabric while alternative links are underutilized, sub-optimal network throughput is obtained. Also, as the fat tree algorithm routes nodes according to the indexing order, the performance may differ for two systems cabled in the exact same way. In this paper, we propose wFatTree, a novel fat-tree routing algorithm, which considers node traffic characteristics to balance load across the network links more evenly, and with predictable network performance. Our experiments and simulations show an improvement of up to 60% in total network throughput on large fat-tree installations when using wFatTree routing. Furthermore, wFatTree can also be used to prioritize traffic flowing towards the critical nodes in the network.
Year
DOI
Venue
2015
10.1109/PDP.2015.111
PDP
Keywords
Field
DocType
parallel processing,routing,topology,network topology,business communication,load balancing,resource allocation,routing algorithms,fat tree topology,indexing
Deterministic routing,Link-state routing protocol,Multipath routing,Static routing,Hierarchical routing,Computer science,Parallel computing,Computer network,Routing domain,Routing table,Distributed computing,Routing protocol
Conference
ISSN
Citations 
PageRank 
1066-6192
4
0.40
References 
Authors
19
5
Name
Order
Citations
PageRank
Feroz Zahid1144.60
Ernst Gunnar Gran2979.60
Bartosz Bogdanski3414.53
Bjorn Dag Johnsen4295.92
Tor Skeie5110374.67