Title
RODI: Benchmarking relational-to-ontology mapping generation quality.
Abstract
Accessing and utilizing enterprise or Web data that is scattered across multiple data sources is an important task for both applications and users. Ontology-based data integration, where an ontology mediates between the raw data and its consumers, is a promising approach to facilitate such scenarios. This approach crucially relies on useful mappings to relate the ontology and the data, the latter being typically stored in relational databases. A number of systems to support the construction of such mappings have recently been developed. A generic and effective benchmark for reliable and comparable evaluation of the practical utility of such systems would make an important contribution to the development of ontology-based data integration systems and their application in practice. We have proposed such a benchmark, called RODI. In this paper, we present a new version of RODI, which significantly extends our previous benchmark, and we evaluate various systems with it. RODI includes test scenarios from the domains of scientific conferences, geographical data, and oil and gas exploration. Scenarios are constituted of databases, ontologies, and queries to test expected results. Systems that compute relational-to-ontology mappings can be evaluated using RODI by checking how well they can handle various features of relational schemas and ontologies, and how well the computed mappings work for query answering. Using RODI, we conducted a comprehensive evaluation of seven systems.
Year
Venue
Keywords
2018
SEMANTIC WEB
Mappings,Relational databases,RDB2RDF,R2RML,Benchmarking,Bootstrapping
Field
DocType
Volume
Semantic integration,Information retrieval,Philosophy,Linguistics,Benchmarking
Journal
9
Issue
ISSN
Citations 
SP1
1570-0844
3
PageRank 
References 
Authors
0.37
37
12
Name
Order
Citations
PageRank
Christoph Pinkel145828.53
Carsten Binnig261961.38
Ernesto Jiménez-Ruiz3112084.14
Evgeny Kharlamov479168.18
Wolfgang May518237.19
Andriy Nikolov676953.09
Ana Sasa Bastinos770.90
Martin G. Skjæveland819114.54
Alessandro Solimando9495.61
Mohsen Taheriyan1021314.05
Christian Heupel1130.37
Ian Horrocks12117311086.65