Abstract
ETL conceptual modeling is a very important activity in any data warehousing system project implementation. Owning a high-level system representation allowing for a clear identification of the main parts of a data warehousing system is clearly a great advantage, especially in early stages of design and development. However, the effort to model conceptually an ETL system rarely is properly rewarded. Translating ETL conceptual models directly into something that saves work and time on the concrete implementation of the system process it would be, in fact, a great help. In this paper we present and discuss a hybrid approach to this problem, combining the simplicity of interpretation and power of expression of BPMN on ETL systems conceptualization with the use of ETL patterns to produce automatically an ETL skeleton, a first prototype system, which has the ability to be executed in a commercial ETL tool like Kettle.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
El Akkaoui, Z., Zimanyi, E.: Defining ETL worfklows using BPMN and BPEL. In: DOLAP 2009 Proceedings of the ACM Twelfth International Workshop on Data warehousing and OLAP, pp. 41–48 (2009)
El Akkaoui, Z., Zimà nyi, E., Mazón, J.-N., Trujillo, J.: A model-driven framework for ETL process development. In: Proceedings of the ACM 14th International Workshop on Data Warehousing and OLAP, DOLAP 2011, pp. 45–52 (2011)
El Akkaoui, Z., Zimányi, E., Mazón, J.-N., Trujillo, J.: A BPMN-based design and maintenance framework for ETL processes. Int. J. Data Warehouse. Min. 9, 46–72 (2013)
Golfarelli, M.: The DFM: a conceptual model for data warehouse. In: Wang, J. (ed.) Encyclopedia of Data Warehousing and Mining, 2nd edn, pp. 638–645. IGI Global, Hershey (2008)
Kimball, R., Caserta, J.: The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning, Conforming, and Delivering Data. Wiley, New York (2004)
Köppen, V., Brüggemann, B., Berendt, B.: Designing data integration: the ETL pattern approach. Eur. J. Inform. Prof. XII(3), 49–55 (2011)
Oliveira, B., Belo, O.: BPMN patterns for ETL conceptual modelling and validation. In: Proceedings of the 20th International Symposium on Methodologies for Intelligent Systems (ISMIS 2012), Macau, 4–7 December 2012
Oliveira, B., Belo, O.: ETL standard processes modelling - a novel BPMN approach. In: Proceedings of 5th International Conference on Enterprise Information Systems (ICEIS 2013), Angers, France, 4–7 July 2013
OMG: Documents Associated With Business Process Model and Notation (BPMN) Version 2.0 (2011)
Pentaho: Pentaho data integration. http://www.pentaho.com/product/data-integration. Accessed 16 March 2015
Simitsis, A.: Mapping conceptual to logical models for ETL processes. In: Proceedings of the 8th ACM international workshop on Data warehousing and OLAP, Bremen, Germany, pp. 67–76 (2005)
Simitsis, A., Vassiliadis, P., Sellis, T.: Logical optimization of ETL workflows. In: Proceedings of the 4th Hellenic Data Management Symposium, Athens, Greece, pp. 55–65 (2005)
Simitsis, A., Vassiliadis, P., Sellis, T.: State-space optimization of ETL workflows. IEEE Trans. Knowl. Data Eng. 17, 1404–1419 (2005)
Trujillo, J., Luján-Mora, S.: A UML based approach for modeling ETL processes in data warehouses. In: Song, I.-Y., Liddle, S.W., Ling, T.-W., Scheuermann, P. (eds.) ER 2003. LNCS, vol. 2813, pp. 307–320. Springer, Heidelberg (2003)
Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: Modeling ETL activities as graphs. In: Proceedings of the 4th International Workshop on Design and Management of Data Warehouses 2002, DMDW’2002, Toronto, Canada, pp. 52–61 (2002)
Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: On the logical modeling of ETL processes. In: Pidduck, A.B., Mylopoulos, J., Woo, C.C., Ozsu, M.T. (eds.) CAiSE 2002. LNCS, vol. 2348, pp. 782–786. Springer, Heidelberg (2002)
Vassiliadis, P.: A survey of extract–transform–load technology. Int. J. Data Warehouse. Min. 5(3), 1–27 (2009)
Wohed, P., van der Aalst, W.M.P., Dumas, M., ter Hofstede, A.H.M., Russell, N.: On the suitability of BPMN for business process modelling. In: Dustdar, S., Fiadeiro, J.L., Sheth, A.P. (eds.) BPM 2006. LNCS, vol. 4102, pp. 161–176. Springer, Heidelberg (2006)
Acknowledgment
This work was developed under the project RAID B2K - RAID Enterprise Platform/NUP: FCOMP-01-0202-FEDER-038584, a project financed by the Incentive System for Research and Technological Development from the Thematic Operational Program Competitiveness Factors.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Belo, O., Gomes, C., Oliveira, B., Marques, R., Santos, V. (2015). Automatic Generation of ETL Physical Systems from BPMN Conceptual Models. In: Bellatreche, L., Manolopoulos, Y. (eds) Model and Data Engineering. Lecture Notes in Computer Science(), vol 9344. Springer, Cham. https://doi.org/10.1007/978-3-319-23781-7_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-23781-7_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23780-0
Online ISBN: 978-3-319-23781-7
eBook Packages: Computer ScienceComputer Science (R0)