Title
Effectiveness Bounds for Non-Exhaustive Schema Matching Systems
Abstract
Semantic validation of the effectiveness of a schema matching system is traditionally performed by comparing system-generated mappings with those of human evaluators. The human effort required for validation quickly becomes huge in large scale environments. The performance of a matching system, however, is not solely determined by the quality of the mappings, but also by the efficiency with which it can produce them. Improving efficiency quickly leads to a trade-off between efficiency and effectiveness. Establishing or obtaining a large test collection for measuring this trade-off is often a severe obstacle. In this paper, we present a technique for determining lower and upper bounds for effectiveness measures for a certain class of schema matching system improvements in order to lower the required validation effort. Effectiveness bounds for a matching system improvement are solely derived from a comparison of answer sets of the improved and original matching system. The technique was developed in the context of improving efficiency in XML schema matching, but we believe it to be more generically applicable in other retrieval systems facing scalability problems.
Year
DOI
Venue
2006
10.1109/ICDEW.2006.51
ICDE Workshops
Keywords
Field
DocType
matching system improvement,schema matching system,non-exhaustive schema matching systems,effectiveness bound,retrieval system,original matching system,xml schema matching,effectiveness measure,effectiveness bounds,schema matching system improvement,matching system,improving efficiency,scalability,data engineering,system testing,xml,upper bound,availability,information security,xml schema
Data mining,XML,Information retrieval,Upper and lower bounds,System testing,Computer science,Information security,XML schema,Information engineering,Schema matching,Database,Scalability
Conference
ISBN
Citations 
PageRank 
0-7695-2571-7
0
0.34
References 
Authors
15
3
Name
Order
Citations
PageRank
Marko Smiljanic1241.53
Maurice van Keulen269954.67
Willem Jonker364055.71