Title
The Variable-Increment Counting Bloom Filter
Abstract
Counting Bloom Filters (CBFs) arewidely used in networking device algorithms. They implement fast set representations to support membership queries with limited error and support element deletions unlike Bloom Filters. However, they consume significant amounts of memory. In this paper, we introduce a new general method based on variable increments to improve the efficiency of CBFs and their variants. Unlike CBFs, at each element insertion, the hashed counters are incremented by a hashed variable increment instead of a unit increment. Then, to query an element, the exact value of a counter is considered and not just its positiveness. We present two simple schemes based on this method. We demonstrate that this method can always achieve a lower false positive rate and a lower overflow probability bound than CBF in practical systems. We also show how it can be easily implemented in hardware, with limited added complexity and memory overhead. We further explain how this method can extend many variants of CBF that have been published in the literature. We then suggest possible improvements of the presented schemes and provide lower bounds on their memory consumption. Lastly, using simulations with real-life traces and hash functions, we show how it can significantly improve the false positive rate of CBFs given the same amount of memory.
Year
DOI
Venue
2014
10.1109/INFCOM.2012.6195563
IEEE/ACM Trans. Netw.
Keywords
Field
DocType
hash functions,memory overhead,element deletions,hashed variable increment,cbfs,hashed variable,real-life traces,counting circuits,memory consumption,variable-increment counting bloom filter,overflow probability bound,data structures,fast set representations,variable increments,unit increment,digital filters,lower bounds,membership queries,file organisation,counting bloom filter,hashed counters,networking device algorithms,element insertion,query processing,probability,false positive rate
False positive rate,Bloom filter,Computer science,Algorithm,Hash function
Journal
Volume
Issue
ISSN
22
4
0743-166X
ISBN
Citations 
PageRank 
978-1-4673-0773-4
37
1.08
References 
Authors
15
3
Name
Order
Citations
PageRank
Rottenstreich, O.1371.08
Yossi Kanizo21638.10
Isaac Keslassy398672.83