Paper Info
Title
A visual language-based system for extraction-transformation-loading development
Abstract
AbstractData warehouse loading and refreshment is typically performed by means of complex software processes called extraction-transformation-loading ETL. In this paper, we propose a system based on a suite of visual languages for mastering several aspects of the ETL development process, turning it into a visual programming task. The approach can be easily generalized and applied to other data integration contexts beyond data warehouses. It introduces two new visual languages that are used to specify the ETL process, which can also be represented by means of UML activity diagrams. In particular, the first visual language supports data manipulation activities, whereas the second one provides traceability information of attributes to highlight the impact of potential transformations on integrated schemas depending on them. Once the whole ETL process has been visually specified, the designer might invoke the automatic generation of an activity diagram representing a possible orchestration of it based on its dependencies. The designer can edit such a diagram to modify the proposed orchestration provided that changes do not alter data dependencies. The final specification can be translated into code that is executable on the data sources. Finally, the effectiveness of the proposed approach has been validated through a user study in which we have compared the effort needed to design an ETL process in our approach with respect to the one required with main visual approaches described in the literature.Copyright © 2013 John Wiley & Sons, Ltd.
Year
DOI
Venue
2014
10.1002/spe.2201
Periodicals
Keywords
DocType
Volume
data integration,visual languages,ETL processes
Journal
44
Issue
ISSN
Citations 
12
0038-0644
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Vincenzo Deufemia144940.96
Massimiliano Giordano2295.42
Giuseppe Polese326338.68
Genoveffa Tortora41477151.59