Abstract | ||
---|---|---|
Application performance monitoring in large data centers relies on either deploying expensive and specialized hardware at fixed locations or heavily customizing applications and collecting logs spread across thousands of servers. Such an endeavor makes performance diagnosis a time-consuming task for cloud providers and a problem beyond the control of cloud customers. We address this problem using emerging software defined paradigms such as Software Defined Networking and Network Function Virtualization as well as big data technologies. In this paper, we propose NetAlytics: a non-intrusive distributed performance monitoring system for cloud data centers. NetAlytics deploys customized monitors in the middle of the network which are transparent to end host applications, and leverages a real-time big data framework to analyze application behavior in a timely manner. NetAlytics can scale to packet rates of 40Gbps using only four monitoring cores and fifteen processing cores. Its placement algorithm can be tuned to minimize network bandwidth cost or server resources, and can reduce monitoring traffic overheads by a factor of 4.5. We present experiments that demonstrates how NetAlytics can be used to troubleshoot performance problems in load balancers, present comprehensive performance analysis, and provide metrics that drive automation tools, all while providing both low overhead monitors and scalable analytics. |
Year | DOI | Venue |
---|---|---|
2016 | 10.1145/2988336.2988344 | Middleware |
Keywords | Field | DocType |
Network Function Virtualization, Software Defined Network | Load balancing (computing),Computer science,Network packet,Server,Software-defined networking,Analytics,Big data,Scalability,Cloud computing,Distributed computing | Conference |
Citations | PageRank | References |
8 | 0.55 | 32 |
Authors | ||
4 |
Name | Order | Citations | PageRank |
---|---|---|---|
Guyue Liu | 1 | 83 | 7.44 |
Michael Trotter | 2 | 8 | 0.89 |
Yuxin Ren | 3 | 29 | 4.49 |
Timothy Wood | 4 | 349 | 27.52 |