Modern Software Engineering Methodologies Meet Data Warehouse Design: 4WD

Data warehouse systems are characterized by a long and expensive development process that hardly meets the ambitious requirements of today's market. This suggests that some further investigation on the methodological issues related to data warehouse design is necessary, aimed at improving the development process from different points of view. In this paper we analyze the potential advantages arising from the application of modern software engineering methodologies to a data warehouse project and we propose 4WD, a design methodology that couples the main principles emerging from these methodologies to the peculiarities of data warehouse projects. The principles underlying 4WD are risk-based iteration, evolutionary and incremental prototyping, user involvement, component reuse, formal and light documentation, and automated schema transformation.

[1]  George T. Heineman,et al.  Component-Based Software Engineering: Putting the Pieces Together , 2001 .

[2]  Matteo Golfarelli,et al.  WAND: A CASE Tool for Data Warehouse Design , 2001, ICDE Demo Sessions.

[3]  Gustav Pomberger,et al.  Prototyping-Oriented Software Development - Concepts and Tools , 1991, Struct. Program..

[4]  Ian Sommerville,et al.  Software Engineering (7th Edition) , 2004 .

[5]  Philippe Kruchten,et al.  The 4+1 View Model of Architecture , 1995, IEEE Softw..

[6]  W. W. Royce,et al.  Managing the development of large software systems: concepts and techniques , 1987, ICSE '87.

[7]  Matteo Golfarelli,et al.  QBX: A CASE Tool for Data Mart Design , 2011, ER Workshops.

[8]  James Martin,et al.  Rapid Application Development , 1991 .

[9]  Jeff Sutherland,et al.  Manifesto for Agile Software Development , 2013 .

[10]  Jose-Norberto Mazón,et al.  An MDA approach for the development of data warehouses , 2008, Decis. Support Syst..

[11]  Boris Vrdoljak,et al.  Data warehouse design from XML sources , 2001, DOLAP '01.

[12]  Daniel L. Moody,et al.  From enterprise models to dimensional models: a methodology for data warehouse and data mart design , 2000, DMDW.

[13]  Ralph Hughes.  Agile Data Warehousing: Delivering World-Class Business Intelligence Systems Using Scrum and XP , 2008 .

[14]  Panos Vassiliadis,et al.  A method for the mapping of conceptual designs to logical blueprints for ETL processes , 2008, Decis. Support Syst..

[15]  Atish P. Sinha,et al.  An empirical investigation of the key determinants of data warehouse adoption , 2008, Decis. Support Syst..

[16]  Matteo Golfarelli,et al.  A methodological framework for data warehouse design , 1998, DOLAP '98.

[17]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[18]  Paolo Giorgini,et al.  GRAnD: A goal-oriented approach to requirement analysis in data warehouses , 2008, Decis. Support Syst..

[19]  Matteo Golfarelli,et al.  A comprehensive approach to data warehouse testing , 2009, DOLAP.

[20]  James M. Bieman,et al.  Rapid Prototyping: Lessons Learned , 1995, IEEE Softw..

[21]  Sergio Luján-Mora,et al.  A Comprehensive Method for Data Warehouse Design , 2003, DMDW.

[22]  Atish P. Sinha,et al.  A comparison of data warehousing methodologies , 2005, CACM.

[23]  Isabelle Comyn-Wattiau,et al.  A UML-based data warehouse design method , 2006, Decis. Support Syst..

[24]  Matteo Golfarelli,et al.  Data Warehouse Design: Modern Principles and Methodologies , 2009 .