Title
Schema mapping generation in the wild
Abstract
Schema mappings enable declarative and executable specification of transformations between different schematic representations of application concepts. Most work on mapping generation has assumed that the source and target schemas are well defined, e.g., with declared keys and foreign keys, and that the mapping generation processes exist to support the data engineer in the labour-intensive process of producing a high-quality integration. However, organizations increasingly have access to numerous independently produced datasets, e.g., in a data lake, with a requirement to produce rapid, best-effort integrations, without extensive manual effort. As a result, there is a need to generate mappings in settings without declared relationships, and thus on the basis of inferred profiling data, and over large numbers of sources. Our contributions include a dynamic programming algorithm for exploring the space of potential mappings, and techniques for propagating profiling data through mappings, so that the fitness of candidate mappings can be estimated. The paper also describes how the resulting mappings can be used to populate single and multi-relation target schemas. Experimental results show the effectiveness and scalability of the approach in a variety of synthetic and real-world scenarios.
Year
DOI
Venue
2022
10.1016/j.is.2021.101904
Information Systems
Keywords
DocType
Volume
0000,1111
Journal
104
ISSN
Citations 
PageRank 
0306-4379
0
0.34
References 
Authors
0
4
Name
Order
Citations
PageRank
Lacramioara Mazilu142.78
Norman W. Paton200.34
Alvaro A. A. Fernandes300.34
Martin Koehler400.34