Title
SECOMPAX: A bitmap index compression algorithm
Abstract
Archiving of Internet traffic is essential for analyzing network events in the field of network security. Currently, bitmap indexing is used to accelerate the indexing and search queries for archival traffic data. However, the generation of bitmap index needs large storage space, which makes bitmap index compression is a must-have function. In this paper, we propose a new bitmap index encoding algorithm named SECOMPAX (Scope-Extended COMPressed Adaptive indeX), which performs better compression ratio and fast encoding speed compared with the state-of-art bitmap index compression algorithm WAH (Word-Aligned-Hybrid), PLWAH(Position list word aligned hybrid) and COMPAX (COMPressed Adaptive indeX). The comparison among WAH, PLWAH, COMPAX and SECOMPAX shows that SECOMAX accomplishes the smallest bitmap index in size and the comparable encoding time with other three methods. We also use real Internet trace from CAIDA to prove the validity of SECOMPAX. SECOMPAX has the best compression ratio in compared with other bitmap index encoding algorithms in our experiments. The encoding time is measured, and statistics of the distribution of codeword used in SECOMPAX is also investigated in experiments. It shows that SECOMPAX's extra time consumption is acceptable as the new designed codebook work effectively in encoding bit sequence which cannot be compressed in other bitmap encoding schemes.
Year
DOI
Venue
2014
10.1109/ICCCN.2014.6911838
ICCCN
Keywords
Field
DocType
index compression,compression ratio,fast encoding speed,compax,bitmap index,plwah,bit sequence,bitmap index compression algorithm,data compression,computer network security,word-aligned-hybrid,secompax,network security,search queries,internet,wah,network forensic,real internet trace,position list word aligned hybrid,internet traffic,telecommunication traffic,big data,archival traffic data,scope-extended compressed adaptive index,index encoding
Bitmap index,Computer science,Computer network,Search engine indexing,Compression ratio,Code word,Bitmap,Data compression,Encoding (memory),Codebook
Conference
Citations 
PageRank 
References 
7
0.62
11
Authors
8
Name
Order
Citations
PageRank
Yuhao Wen1121.75
Zhen Chen221836.23
Ge Ma370.62
Junwei Cao493570.95
Wenxun Zheng5142.17
Guodong Peng670.95
Shiwei Li770.62
Wen-Liang Huang870.95