Title
Accelerating breadth-first graph search on a single server by dynamic edge trimming.
Abstract
Breadth-first graph search (a.k.a., BFS) is one of the typical in-memory computing models with complicated and frequent memory accesses. Existing single-server graph computing systems fail to take advantage of access pattern of BFS for performance optimization, hence suffering from a lot of extra memory latencies due to accessing no longer useful data elements of a big graph as well as wasting plenty of computing resources for processing them. In this article, we propose FastBFS, a new approach that accelerates breadth-first graph search on a single server by leverage of the access pattern during iterating over a big graph. First, FastBFS uses an edge-centric graph processing model to obtain the high bandwidth of sequential memory and/or disk access without expensive data preprocessing. Second, with a dynamic and asynchronous trimming mechanism, FastBFS can efficiently reduce the size of a big graph by eliminating useless edges in parallel with the computation. Third, FastBFS schedules I/O streams efficiently and can attain greater parallelism if an additional disk is available. We implement FastBFS by modifying the X-Stream system developed by EPFL. Our experimental results show that FastBFS can attain speedups of up to 7.9× and 10.4× in the computing speed compared with X-stream and GraphChi respectively. With an additional disk, the performance can be further improved.
Year
DOI
Venue
2018
10.1016/j.jpdc.2017.09.007
Journal of Parallel and Distributed Computing
Keywords
Field
DocType
Graph computing,In-memory computing,I/O optimization,BFS
Graph,Asynchronous communication,Computer science,Breadth-first search,Parallel computing,Data pre-processing,Schedule,Trimming,Computation,Sequential access memory,Distributed computing
Journal
Volume
ISSN
Citations 
120
0743-7315
0
PageRank 
References 
Authors
0.34
25
5
Name
Order
Citations
PageRank
Guangyan Zhang117116.20
Shu-han Cheng231.05
Jiwu Shu370972.71
Qingda Hu4223.78
Weimin Zheng51889182.48