Paper Info
Title
S2RDF: RDF Querying with SPARQL on Spark.
Abstract
RDF has become very popular for semantic data publishing due to its flexible and universal graph-like data model. Thus, the ever-increasing size of RDF data collections raises the need for scalable distributed approaches. We endorse the usage of existing infrastructures for Big Data processing like Hadoop for this purpose. Yet, SPARQL query performance is a major challenge as Hadoop is not intentionally designed for RDF processing. Existing approaches often favor certain query pattern shapes while performance drops significantly for other shapes. In this paper, we introduce a novel relational partitioning schema for RDF data called ExtVP that uses a semi-join based preprocessing, akin to the concept of Join Indices in relational databases, to efficiently minimize query input size regardless of its pattern shape and diameter. Our prototype system S2RDF is built on top of Spark and uses SQL to execute SPARQL queries over ExtVP. We demonstrate its superior performance in comparison to state of the art SPARQL-on-Hadoop approaches.
Year
DOI
Venue
2015
10.14778/2977797.2977806
PROCEEDINGS OF THE VLDB ENDOWMENT
Field
DocType
Volume
SQL,Data mining,RDF query language,Relational database,Information retrieval,Computer science,Cwm,SPARQL,RDF/XML,RDF Schema,Database,RDF
Journal
9
Issue
ISSN
Citations 
10
2150-8097
29
PageRank 
References 
Authors
0.87
33
4
Name
Order
Citations
PageRank
Alexander Schätzle11579.59
Martin Przyjaciel-Zablocki21619.98
simon skilevic3291.20
Georg Lausen43687526.29