Paper Info
Title
Republic: Data Multicast Meets Hybrid Rack-Level Interconnections in Data Center
Abstract
Data multicast is a crucial data transfer pattern in distributed big-data processing. However, due to the lack of network and system level support, data processing relies on unicast-based application layer multicast. In recent years, there has been a surge in interest in using various emerging circuit switching technologies to build data centers having hybrid packet-circuit switched rack-level interconnections, i.e., hybrid data centers. These physical layer innovations fundamentally change the inter-rack communication capability, especially the capability of multicast communication. We propose Republic, a complete system that addresses the challenging issues in achieving high-performance data multicast in hybrid data centers. Republic abstracts the underlying network complexity as a data multicast service and provides a unified Republic API for data center applications requesting data multicast. Republic is implemented and deployed in a hybrid data center testbed. Testbed evaluation shows that Republic can improve data multicast in Apache Spark machine learning applications by as much as 4.0x.
Year
DOI
Venue
2018
10.1109/ICNP.2018.00018
2018 IEEE 26th International Conference on Network Protocols (ICNP)
Keywords
Field
DocType
data center networks, multicast, circuit switch
Application layer,Network complexity,Data transmission,Computer science,Computer network,Testbed,Physical layer,Multicast,Unicast,Data center,Distributed computing
Conference
ISSN
ISBN
Citations 
1092-1648
978-1-5386-6044-7
2
PageRank 
References 
Authors
0.37
18
6
Name
Order
Citations
PageRank
Xiaoye Sun1374.39
Yiting Xia2575.98
Simbarashe Dzinamarira3162.67
Xin Sunny Huang4242.81
dingming wu5285.47
T. S. Eugene Ng62491274.31