Title
The Mannheim Search Join Engine
Abstract
A Search Join is a join operation which extends a user-provided table with additional attributes based on a large corpus of heterogeneous data originating from the Web or corporate intranets. Search Joins are useful within a wide range of application scenarios: Imagine you are an analyst having a local table describing companies and you want to extend this table with attributes containing the headquarters, turnover, and revenue of each company. Or imagine you are a film enthusiast and want to extend a table describing films with attributes like director, genre, and release date of each film. This article presents the Mannheim Search Join Engine which automatically performs such table extension operations based on a large corpus of Web data. Given a local table, the Mannheim Search Join Engine searches the corpus for additional data describing the entities contained in the input table. The discovered data are joined with the local table and are consolidated using schema matching and data fusion techniques. As a result, the user is presented with an extended table and given the opportunity to examine the provenance of the added data. We evaluate the Mannheim Search Join Engine using heterogeneous data originating from over one million different websites. The data corpus consists of HTML tables, as well as Linked Data and Microdata annotations which are converted into tabular form. Our experiments show that the Mannheim Search Join Engine achieves a coverage close to 100% and a precision of around 90% for the tasks of extending tables describing cities, companies, countries, drugs, books, films, and songs.
Year
DOI
Venue
2015
10.1016/j.websem.2015.05.001
Journal of Web Semantics
Keywords
Field
DocType
Table extension,Data search,Search Joins,Web tables,Microdata,Linked data
Revenue,Data mining,Joins,Information retrieval,Recursive join,Computer science,Linked data,Sort-merge join,Sensor fusion,Microdata (HTML),Schema matching,Database
Journal
Volume
Issue
ISSN
35
P3
1570-8268
Citations 
PageRank 
References 
23
0.90
30
Authors
6
Name
Order
Citations
PageRank
Oliver Lehmberg11799.59
Dominique Ritze227418.58
petar ristoski325621.36
Robert Meusel423416.62
Heiko Paulheim5109584.19
Christian Bizer68448524.93