Title
Optimizing Distributed Joins with Bloom Filters Using MapReduce.
Abstract
The MapReduce framework is increasingly being used to process and analyze large-scale datasets over large clusters. Join operation using MapReduce is an attractive point to which researchers have been paying attention in recent years. The distributed join based on the bloom filter has been proved to be a successful technique to improve the efficiency. However, the full potential of the bloom filter has not been fully exploited, especially in the MapReduce environment. In this paper, we present several strategies to build the bloom filter for the large dataset using MapReduce, compare some bloom-join algorithms and point out how to improve the performance of two-way and multi-way joins. The experiments we conduct show that our method is feasible and effective.
Year
DOI
Venue
2012
10.1007/978-3-642-35600-1_13
Communications in Computer and Information Science
Keywords
Field
DocType
Bloom Filter,MapReduce,Query Optimization
Query optimization,Bloom filter,Joins,Computer science,Parallel computing,Distributed computing
Conference
Volume
ISSN
Citations 
351
1865-0929
3
PageRank 
References 
Authors
0.37
10
3
Name
Order
Citations
PageRank
Changchun Zhang1248.42
Lei Wu230.71
Jing Li3226.73