Abstract | ||
---|---|---|
The MapReduce framework is increasingly being used to process and analyze large-scale datasets over large clusters. Join operation using MapReduce is an attractive point to which researchers have been paying attention in recent years. The distributed join based on the bloom filter has been proved to be a successful technique to improve the efficiency. However, the full potential of the bloom filter has not been fully exploited, especially in the MapReduce environment. In this paper, we present several strategies to build the bloom filter for the large dataset using MapReduce, compare some bloom-join algorithms and point out how to improve the performance of two-way and multi-way joins. The experiments we conduct show that our method is feasible and effective. |
Year | DOI | Venue |
---|---|---|
2012 | 10.1007/978-3-642-35600-1_13 | Communications in Computer and Information Science |
Keywords | Field | DocType |
Bloom Filter,MapReduce,Query Optimization | Query optimization,Bloom filter,Joins,Computer science,Parallel computing,Distributed computing | Conference |
Volume | ISSN | Citations |
351 | 1865-0929 | 3 |
PageRank | References | Authors |
0.37 | 10 | 3 |
Name | Order | Citations | PageRank |
---|---|---|---|
Changchun Zhang | 1 | 24 | 8.42 |
Lei Wu | 2 | 3 | 0.71 |
Jing Li | 3 | 22 | 6.73 |