Title
The More the Merrier: Efficient Multi-Source Graph Traversal.
Abstract
Graph analytics on social networks, Web data, and communication networks has been widely used in a plethora of applications. Many graph analytics algorithms are based on breadth-first search (BFS) graph traversal, which is not only time-consuming for large datasets but also involves much redundant computation when executed multiple times from different start vertices. In this paper, we propose Multi-Source BFS (MS-BFS), an algorithm that is designed to run multiple concurrent BFSs over the same graph on a single CPU core while scaling up as the number of cores increases. MS-BFS leverages the properties of small-world networks, which apply to many real-world graphs, and enables efficient graph traversal that: (i) shares common computation across concurrent BFSs; (ii) greatly reduces the number of random memory accesses; and (iii) does not incur synchronization costs. We demonstrate how a real graph analytics application---all-vertices closeness centrality---can be efficiently solved with MS-BFS. Furthermore, we present an extensive experimental evaluation with both synthetic and real datasets, including Twitter and Wikipedia, showing that MS-BFS provides almost linear scalability with respect to the number of cores and excellent scalability for increasing graph sizes, outperforming state-of-the-art BFS algorithms by more than one order of magnitude when running a large number of BFSs.
Year
DOI
Venue
2014
10.14778/2735496.2735507
VLDB
Field
DocType
Volume
Data mining,Graph database,Synchronization,Graph traversal,Computer science,Theoretical computer science,Graph bandwidth,Multi-core processor,Multi-source,Database,Scalability,Computation
Journal
8
Issue
ISSN
Citations 
4
2150-8097
20
PageRank 
References 
Authors
0.79
23
8
Name
Order
Citations
PageRank
Manuel Then1434.73
Moritz Kaufmann2232.53
Fernando Seabra Chirigati320516.38
Tuan-Anh Hoang-Vu4261.19
Kien Pham5201.12
Alfons Kemper63519769.50
Thomas Neumann72523156.50
Huy T. Vo8103561.10