Title
Time-completeness trade-offs in record linkage using adaptive query processing
Abstract
Applications that involve data integration among multiple sources often require a preliminary step of data reconciliation in order to ensure that tuples match correctly across the sources. In dynamic settings such as data mashups, however, traditional offline data reconciliation techniques that require prior availability of the data may not be applicable. The alternative, performing similarity joins at query time, is computationally expensive, while ignoring the mismatch problem altogether leads to an incomplete integration. In this paper we make the assumption that, in some dynamic integration scenarios, users may agree to trade the completeness of a join result in return for a faster computation. We explore the consequences of this assumption by proposing a novel, hybrid join algorithm that involves a combination of exact and approximate join operators, managed using adaptive query processing techniques. The algorithm is optimistic: it can switch between physical join operators multiple times throughout query processing, but it only resorts to approximate join operators when there is statistical evidence that result completeness is compromised. Our experiments show that sensible savings in join execution time can be achieved in practice, at the expense of a modest reduction in result completeness.
Year
DOI
Venue
2009
10.1145/1516360.1516458
EDBT
Keywords
Field
DocType
data reconciliation,dynamic integration scenario,record linkage,incomplete integration,time-completeness trade-offs,data integration,operators multiple time,data mashups,query processing,traditional offline data reconciliation,result completeness,adaptive query processing technique,data integrity,operations management,metric space
Query optimization,Web search query,Data mining,Query language,Joins,Query expansion,Recursive join,Computer science,Sargable,Web query classification,Theoretical computer science,Database
Conference
Citations 
PageRank 
References 
5
0.48
25
Authors
5
Name
Order
Citations
PageRank
Roald Lengu150.82
Paolo Missier21287100.48
Alvaro A. A. Fernandes390477.71
Giovanna Guerrini470597.44
Marco Mesiti583072.53