Name
Abstract | ||
|---|---|---|
Existing graph partition methods are designed for round-robin synchronous distributed frameworks. They balance workload without discrimination of vertex importance and fail to consider the characteristics of priority-based scheduling, which may limit the benefit of prioritized graph computation. To accelerate prioritized iterative graph computations, we propose Hotness Balanced Partition (HBP) and a stream-based partition algorithm Pb-HBP. Pb-HBP partitions graph by distributing vertices with discrimination according to their hotness rather than blindly distributing vertices with equal weights, which aims to evenly distribute the hot vertices among workers. Our results show that our proposed partition method outperforms the state-of-the-art partition methods, Fennel and HotGraph. Specifically, Ph-HBP can reduce 40-90% runtime of that by hash partition, 5-75% runtime of that by Fennel, and 22-50% runtime of that by HotGraph. |
Year | DOI | Venue |
|---|---|---|
2020 | 10.1109/ICDE48307.2020.00209 | 2020 IEEE 36TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2020) |
Keywords | DocType | ISSN |
Hotness balance partition, Graph partition, Distributed computing, Prioritized Computation | Conference | 1084-4627 |
Citations | PageRank | References |
0 | 0.34 | 8 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Shufeng Gong | 1 | 4 | 0.73 |
| Yanfeng Zhang | 2 | 3 | 2.76 |
| Ge YU | 3 | 1313 | 175.88 |