Abstract | ||
---|---|---|
Internet traffic has continued to grow at a spectacular rate over the past ten years. Understanding and managing network traffic have become an important issue for network operators to meet service-level agreements with their customers. In addition, the emergence of high-speed networks, such as 20 Gbps, 40Gbps Ethernet and beyond, requires fast analysis of a large volume of network traffic and this is beyond the capabilities of a single machine. Distributed parallel processing schemes have recently been developed to analyze high quantities of traffic data. However, scalable Internet traffic analysis in real-time is difficult because of a large dataset requires high processing intensity. In this paper, we describe a real-time Deep Packet Inspection (DPI) system based on the MapReduce programming model. We combine a stand-alone classification engine (L7-filter) with the distributed programming MapReduce model. Our experimental results show that the MapReduce programming paradigm is a useful approach for building highly scalable real-time network traffic processing systems. We generate 20 Gbps network traffic to validate the real-time analysis ability of the proposed system. |
Year | DOI | Venue |
---|---|---|
2013 | 10.1109/UCC.2013.88 | Utility and Cloud Computing |
Keywords | Field | DocType |
real-time deep packet inspection,internet traffic,high-speed network,scalable internet traffic analysis,real-time analysis ability,network operator,traffic data,network traffic,scalable real-time network traffic,gbps network traffic,inspection,distributed programming,data analysis,internet | Deep packet inspection,Traffic generation model,Programming paradigm,Computer science,Internet traffic engineering,Computer network,Traffic shaping,Network traffic control,Internet traffic,The Internet,Distributed computing | Conference |
Citations | PageRank | References |
2 | 0.40 | 11 |
Authors | ||
3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Le Quoc, D. | 1 | 55 | 8.21 |
André Martin | 2 | 2 | 0.40 |
Christof Fetzer | 3 | 2429 | 172.89 |