Name
Abstract | ||
|---|---|---|
Internet measurement and analysis is increasingly challenging as the Internet evolves, primarily due to changing-trends, speed increments or new protocols and ciphers. As such, ad-hoc monitoring equipment comes in handy, albeit cost-effectiveness impedes deployment at a very large scale. As an alternative, big data-based distributed architectures are being proposed for network monitoring and analysis. However, in light of the high throughput currently offered by 100 Gbit/s links, it turns out that state-of-the-art big data solutions fall short of capacity, unless a huge amount of computers are used. In order to effectively tackle that issue, we have created Wormhole: a streaming engine that circumvents existing limitations by distributing the input messages/packets coherently among different off-the-shelf analysis equipment, thus reducing costs and equipment. Should the incoming data rate be larger than the system throughput, a distributed file system can be used for temporary data storage, for subsequent filtering and in-depth analysis. The proposed solution provides on-line real-time monitoring metrics with the ability to gain further insights when required. The prototyped architecture is able to deal with 100 Gbit/s networks and can be easily scaled up to higher rates by just adding more computing nodes and/or by trimming encrypted packet payloads. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1109/ICIN.2019.8685877 | 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN) |
Keywords | Field | DocType |
Wormhole,big data platform,network monitoring,speed increments,protocols,ciphers,ad-hoc monitoring equipment,cost-effectiveness,big data-based distributed architectures,input messages/packets,off-the-shelf analysis equipment,incoming data rate,system throughput,distributed file system,temporary data storage,in-depth analysis,on-line real-time monitoring metrics,big data solutions | Distributed File System,Computer data storage,Computer science,Network packet,Computer network,Encryption,Throughput,Network monitoring,Big data,The Internet | Conference |
ISSN | ISBN | Citations |
2162-3414 | 978-1-5386-8337-8 | 0 |
PageRank | References | Authors |
0.34 | 0 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Rafael Leira | 1 | 5 | 2.49 |
| Lluis Gifre | 2 | 9 | 6.00 |
| Ivan Gonzalez | 3 | 0 | 0.68 |
| Jorge E. López de Vergara | 4 | 187 | 26.98 |
| Javier Aracil | 5 | 213 | 42.23 |