Title
An Efficient <italic>K</italic>-Persistent Spread Estimator for Traffic Measurement in High-Speed Networks
Abstract
Traffic measurement in high-speed networks has many important functions in improving network performance, assisting resource allocation, and detecting anomalies. In this paper, we study a generalized problem called k-persistent spread estimation, which measures the volume of persist traffic elements in each flow that appear during at least k out of t measurement periods, where k and t are two positive integers that can be arbitrarily set in user queries, with k ≤ t. Solutions to this problem have interesting applications in network attack detection, popular content identification, user access profiling, etc. There is very limited prior art for this problem, only addressing the special case of k = t under a flawed assumption. Removing this assumption, we propose an efficient and accurate estimator for generalized k-persistent traffic measurement, with k ≤ t. Our method relies on bitwise SUM, instead of bitwise AND in the prior art, to combine the information collected from different periods. This change has fundamental impact on the probabilistic analysis that derives the estimator, particular over space-saving virtual bitmaps. Based on real network traces, we demonstrate experimentally the effectiveness of our new method in estimating the k-persistent spreads of all network flows. Our estimator performs much better than the prior art on its case of k = t. We also incorporate a sampling module to the estimator for improved flexibility, and give a use study on how to detect and find DDoS attackers using the proposed estimator.
Year
DOI
Venue
2020
10.1109/TNET.2020.2982003
IEEE/ACM Transactions on Networking
Keywords
DocType
Volume
Traffic measurement,persistent traffic,spread estimation
Journal
28
Issue
ISSN
Citations 
4
1063-6692
1
PageRank 
References 
Authors
0.35
0
9
Name
Order
Citations
PageRank
He Huang182965.14
Yu-e Sun2337.07
Chaoyi Ma3164.26
Shiping Chen419025.84
You Zhou561.77
Wenjian Yang612.04
Tang Shaojie72224157.73
Hongli Xu850285.92
Yan Qiao9764.29