Title
An Effective High-Performance Multiway Spatial Join Algorithm with Spark.
Abstract
Multiway spatial join plays an important role in GIS (Geographic Information Systems) and their applications. With the increase in spatial data volumes, the performance of multiway spatial join has encountered a computation bottleneck in the context of big data. Parallel or distributed computing platforms, such as MapReduce and Spark, are promising for resolving the intensive computing issue. Previous approaches have focused on developing single-threaded join algorithms as an optimizing and partition strategy for parallel computing. In this paper, we present an effective high-performance multiway spatial join algorithm with Spark (MSJS) to overcome the multiway spatial join bottleneck. MSJS handles the problem through cascaded pairwise join. Using the power of Spark, the formerly inefficient cascaded pairwise spatial join is transformed into a high-performance approach. Experiments using massive real-world data sets prove that MSJS outperforms existing parallel approaches of multiway spatial join that have been described in the literature.
Year
DOI
Venue
2017
10.3390/ijgi6040096
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION
Keywords
Field
DocType
multiway spatial join,parallel computing,spark,geocomputation performance
Spatial analysis,Bottleneck,Pairwise comparison,Geographic information system,Data set,Spark (mathematics),Computer science,Parallel computing,Algorithm,Theoretical computer science,Big data,Computation
Journal
Volume
Issue
ISSN
6
4
2220-9964
Citations 
PageRank 
References 
3
0.64
19
Authors
6
Name
Order
Citations
PageRank
Zhenhong Du13116.98
Xianwei Zhao230.64
X. Ye315834.16
Jingwei Zhou430.64
Feng Zhang5127.66
Liu Renyi61513.13