Title
Redundant Network Traffic Elimination with GPU Accelerated Rabin Fingerprinting.
Abstract
Recently, redundant network traffic elimination has attracted a lot of attention from both the academia and the industry. A core challenge and enabling technique in implementing redundancy elimination is to perform content-based chunking, which typically involves the computationally heavy Rabin fingerprinting algorithm. In this paper, we propose a GPU-based implementation of Rabin fingerprinting to address this issue. To maximize performance gains, a diverse set of optimization strategies, such as efficient buffer management, GPU memory hierarchy optimization, and balanced load distribution, is proposed by either exploiting the intrinsic hardware features or addressing domain-specific challenges. Extensive evaluations on both the overall and microscopic performance reveal the effectiveness of the GPU-accelerated Rabin fingerprinting algorithm, and we can achieve up to 40 Gpbs throughput on a GTX 780 card. The throughput shows 1.87$\\times$ speedup against the state-of-the-art using comparable hardware. In addition, although some optimization designs are specific for the problem, techniques proposed in this work including the indexed compact buffer scheme and approximate sorting would also be beneficial and applicable to other network applications leveraging GPU acceleration.
Year
DOI
Venue
2016
10.1109/TPDS.2015.2473166
IEEE Trans. Parallel Distrib. Syst.
Keywords
Field
DocType
Graphics processing units,Instruction sets,Optimization,Indexes,Arrays,Sorting,Bandwidth
Data deduplication,Memory hierarchy,Instruction set,Computer science,Parallel computing,Sorting,Real-time computing,Bandwidth (signal processing),Redundancy (engineering),Throughput,Speedup,Distributed computing
Journal
Volume
Issue
ISSN
27
7
1045-9219
Citations 
PageRank 
References 
2
0.38
13
Authors
4
Name
Order
Citations
PageRank
Jianhua Sun119225.27
Hao Chen221137.88
Ligang He354256.73
Huailiang Tan4313.97