Abstract | ||
---|---|---|
It is a well known fact that multiple virtual lanes can improve performance in interconnection networks, but this knowledge has had little impact on real clusters. Currently, a large number of clusters using InfiniBand is based on fat-tree topologies that can be routed deadlock-free using only one virtual lane. Consequently, all the remaining virtual lanes are left unused. In this paper we suggest an enhancement to the fat-tree algorithm that utilizes virtual lanes to improve performance when hot-spots are present. Even though the bisection bandwidth in a fat-tree is constant, hot-spots are still possible and they will degrade performance for flows not contributing to them due to head-of-line blocking. Such a situation may be alleviated through adaptive routing or congestion control, however, these methods are not yet readily available in InfiniBand technology. To remedy this problem, we have implemented an enhanced fat-tree algorithm in OpenSM that distributes traffic across all available virtual lanes without any configuration needed. We evaluated the performance of the algorithm on a small cluster and did a large-scale evaluation through simulations. In a congested environment, results show that we are able to achieve throughput increases up to 38% on a small cluster and from 221% to 757% depending on the hot-spot scenario for a 648-port simulated cluster. |
Year | DOI | Venue |
---|---|---|
2011 | 10.1109/IPDPS.2011.28 | IPDPS |
Keywords | Field | DocType |
congestion control,enhanced fat-tree algorithm,opensm,multiprocessor interconnection networks,virtual lanes,vftree,alleviate congestion,real cluster,fat-tree routing algorithm,virtual lane,congestion alleviation,remaining virtual lane,telecommunication congestion control,multiple virtual lane,interconnection networks,adaptive routing,648-port simulated cluster,fat-tree algorithm,available virtual lane,small cluster,workstation clusters,fat-tree topology,telecommunication network routing,infiniband,network topology,routing,topology,hardware,bandwidth,hot spot | InfiniBand,Computer science,Computer network,Network topology,Bisection bandwidth,Bandwidth (signal processing),Network congestion,Throughput,Fat tree,Interconnection,Distributed computing | Conference |
ISSN | ISBN | Citations |
1530-2075 E-ISBN : 978-0-7695-4385-7 | 978-0-7695-4385-7 | 22 |
PageRank | References | Authors |
0.79 | 15 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Wei Lin Guay | 1 | 32 | 2.35 |
Bartosz Bogdanski | 2 | 41 | 4.53 |
Sven-Arne Reinemo | 3 | 184 | 12.64 |
Olav Lysne | 4 | 797 | 54.53 |
Tor Skeie | 5 | 1103 | 74.67 |