Paper Info
Title
A CCG virtual system for big data application communication costs analysis
Abstract
Network topology and routing are two important factors in determining the communication costs of big data applications at large scale. As for a given Cluster, Cloud, or Grid system, the network topology is fixed and static or dynamic routing protocols are preinstalled to direct the network traffic. Users cannot change them once the system is deployed. Hence, it is hard for application developers to identify the optimal network topology and routing algorithm for their applications with distinct communication patterns. In this study, we design a CCG virtual system (CCGVS), which first uses container-based virtualization to allow users to create a farm of lightweight virtual machines on a single host. Then, it uses software-defined networking (SDN) technique to control the network traffic among these virtual machines. Users can change the network topology and control the network traffic programmingly, thereby enabling application developers to evaluate their applications on the same system with different network topologies and routing algorithms. The preliminary experimental results through both synthetic big data programs and NPB benchmarks have shown that CCGVS can represent application performance variations caused by network topology and routing algorithm.
Year
DOI
Venue
2014
10.1109/BigData.2014.7004413
BigData Conference
Keywords
Field
DocType
software-defined networking,virtualization,sdn,network routing,grid computing,network traffic control,cluster cloud and grid computing,data analysis,virtual machines,software defined networking,telecommunication congestion control,network topology,telecommunication network topology,virtualisation,container-based virtualization,ccg virtual system,workstation clusters,routing,big data application communication cost analysis,big data,telecommunication network routing,cloud computing
Logical topology,Computer science,Hierarchical routing,Static routing,Routing domain,Computer network,Network architecture,Network simulation,Network topology,Routing table,Distributed computing
Conference
Citations 
PageRank 
References 
0
0.34
20
Authors
4
Name
Order
Citations
PageRank
Yongen Yu1804.55
Wei Tang215210.65
Hongbo Zou3342.59
Liwei Liu47711.86