Paper Info
Title
On the feasibility of 40 gbps network data capture and retention with general purpose hardware.
Abstract
New Ethernet standards, such as 40 GbE or 100 GbE, are already being deployed commercially along with their corresponding Network Interface Cards (NICs) for the servers. However, network measurement solutions are lagging behind: while there are several tools available for monitoring 10 or 20 Gbps networks, higher speeds pose a harder challenge that requires more new ideas, different from those applied previously, and so there are less applications available. In this paper, we show a system capable of capturing, timestamping and storing 40 Gbps network traffic using a tailored network driver together with Non-Volatile Memory express (NVMe) technology and the Storage Performance Development Kit (SPDK) framework. Also, we expose core ideas that can be extended for the capture at higher rates: a multicore architecture capable of synchronization with minimal overhead that reduces disordering of the received frames, methods to filter the traffic discarding unwanted frames without being computationally expensive, and the use of an intermediate buffer that allows simultaneous access from several applications to the same data and efficient disk writes. Finally, we show a testbed for a reliable benchmarking of our solution using custom DPDK traffic generators and replayers, which have been made freely available for the network measurement community.
Year
DOI
Venue
2018
10.1145/3167132.3167238
SAC 2018: Symposium on Applied Computing Pau France April, 2018
Keywords
Field
DocType
Network monitoring, traffic storage, multicore architecture, packet storage, off-the-shelf systems, DPDK, SPDK, NVMe
Synchronization,Timestamping,Computer science,Server,Testbed,NVM Express,Ethernet,Network monitoring,Computer hardware,Network interface
Conference
ISBN
Citations 
PageRank 
978-1-4503-5191-1
0
0.34
References 
Authors
10
5
Name
Order
Citations
PageRank
Guillermo Julián-Moreno130.72
Rafael Leira252.49
Jorge E. López de Vergara318726.98
Francisco J. Gomez-arribas4618.36
Ivan Gonzalez511016.67