Paper Info
Title
A Distributed Architecture for the Monitoring of Clouds and CDNs: Applications to Amazon AWS
Abstract
Clouds and CDNs are systems that tend to separate the content being requested by users from the physical servers capable of serving it. From the network point of view, monitoring and optimizing performance for the traffic they generate are challenging tasks, given that the same resource can be located in multiple places, which can, in turn, change at any time. The first step in understanding cloud and CDN systems is thus the engineering of a monitoring platform. In this paper, we propose a novel solution that combines passive and active measurements and whose workflow has been tailored to specifically characterize the traffic generated by cloud and CDN infrastructures. We validate our platform by performing a longitudinal characterization of the very well known cloud and CDN infrastructure provider Amazon Web Services (AWS). By observing the traffic generated by more than 50 000 Internet users of an Italian Internet Service Provider, we explore the EC2, S3, and CloudFront AWS services, unveiling their infrastructure, the pervasiveness of web services they host, and their traffic allocation policies as seen from our vantage points. Most importantly, we observe their evolution over a two-year-long period. The solution provided in this paper can be of interest for the following: 1) developers aiming at building measurement tools for cloud infrastructure providers; 2) developers interested in failure and anomaly detection systems; and 3) third-party service-level agreement certificators who can design systems to independently monitor performance. Finally, we believe that the results about AWS presented in this paper are interesting as they are among the first to unveil properties of AWS as seen from the operator point of view.
Year
DOI
Venue
2014
10.1109/TNSM.2014.2362357
IEEE Transactions on Network and Service Management
Keywords
Field
DocType
Web services,cloud computing,optimisation,Amazon AWS,Amazon Web services,CDN monitoring,CloudFront AWS services,EC2,Italian Internet service provider,anomaly detection system,cloud infrastructure,cloud monitoring,content delivery networks,distributed architecture,longitudinal characterization,traffic allocation policies,Amazon web services,Network monitoring,cloud computing,content delivery networks
Anomaly detection,Computer science,Server,Computer network,Design systems,Amazon web services,Web service,Workflow,Cloud computing,Distributed computing,The Internet
Journal
Volume
Issue
ISSN
11
4
1932-4537
Citations 
PageRank 
References 
4
0.49
18
Authors
4
Name
Order
Citations
PageRank
Ignacio Bermudez1403.88
Stefano Traverso224118.97
Maurizio M. Munafò346429.47
Marco Mellia42748204.65