Design and Implementation of Active Stream Data Warehouses

In the era of Big Data, more and more stream data is available. In the same way, Decision Support Systems (DSS) tools, such as data warehouses and alert systems, become more and more sophisticated, and conceptual modeling tools are consequently mandatory for successfully DSS projects. Formalisms such as UML and ER have been widely used in the context of classical information and data warehouse systems, but they have not been investigated yet for stream data warehouses to deal with alert systems. Therefore, in this article, the authors introduce the notion of Active Stream Data Warehouse (ASDW) and this article proposes a UML profile for designing Active Stream Data Warehouses. Indeed, this article extends the ICSOLAP profile to take into account continuous and window OLAP queries. Moreover, this article studies the duality of the stream and OLAP decision-making process and the authors propose a set of ECA rules to automatically trigger OLAP operators. The UML profile is implemented in a new OLAP architecture, and it is validated using an environmental case study concerning the wind monitoring.

[1]  David Taniar,et al.  XML data update management in XML-enabled database , 2008, J. Comput. Syst. Sci..

[2]  David Taniar,et al.  On Building XML Data Warehouses , 2004, IDEAL.

[3]  Norman W. Paton,et al.  Active Rules in Database Systems , 1998, Monographs in Computer Science.

[4]  Theodore Johnson,et al.  Stream warehousing with DataDepot , 2009, SIGMOD Conference.

[5]  Qing Li,et al.  Unified Modeling Language , 2009 .

[6]  Matteo Golfarelli,et al.  A Survey on Temporal Data Warehousing , 2009, Int. J. Data Warehous. Min..

[7]  Panos Vassiliadis,et al.  Supporting Streaming Updates in an Active Data Warehouse , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[8]  Daniela Ioana Sandu.  Operational and real-time Business Intelligence , 2008 .

[9]  Theodore Johnson,et al.  Scalable Scheduling of Updates in Streaming Data Warehouses , 2012, IEEE Transactions on Knowledge and Data Engineering.

[10]  Sharma Chakravarthy,et al.  Event-based lossy compression for effective and efficient OLAP over data streams , 2010, Data Knowl. Eng..

[11]  Jayant D. Bokefode,et al.  A Novel Approach For Updates In Streaming Data Warehouses By Scalable Scheduling , 2013 .

[12]  Ion Lungu,et al.  Real-Time Business Intelligence for the Utilities Industry , 2012 .

[13]  A Min Tjoa,et al.  Zero-latency data warehousing (ZLDWH): the state-of-the-art and experimental implementation approaches , 2006, 2006 International Conference onResearch, Innovation and Vision for the Future.

[14]  Michael Schrefl,et al.  Active data warehouses: complementing OLAP with analysis rules , 2001, Data Knowl. Eng..

[15]  Sandro Bimonte,et al.  Conceptual model for spatial data cubes: A UML profile and its automatic implementation , 2015, Comput. Stand. Interfaces.

[16]  Pat Hanrahan,et al.  Polaris: A System for Query, Analysis, and Visualization of Multidimensional Relational Databases , 2002, IEEE Trans. Vis. Comput. Graph..

[17]  David Taniar,et al.  A Methodology for Building XML Data Warehouses , 2005, Int. J. Data Warehous. Min..

[18]  B. Saikiran,et al.  An Efficient Algorithm for Update Scheduling in Streaming Data Warehouses , 2014 .

[19]  S AnishaS,et al.  Data Updates on Streaming Data Warehouses Using XOR Based Key Expansion Algorithm , 2014 .

[20]  Riccardo Torlone.  Conceptual Multidimensional Models , 2003, Multidimensional Databases.

[21]  Michael Schrefl,et al.  Realizing active data warehouses with off‐the‐shelf database technology , 2002, Softw. Pract. Exp..

[22]  Omar Boussaïd,et al.  Business Intelligence Indicators: Types, Models and Implementation , 2016, Int. J. Data Warehous. Min..

[23]  Magdalena Balazinska,et al.  Moirae: History-Enhanced Monitoring , 2007, CIDR.

[24]  Theodore Johnson,et al.  Data stream warehousing , 2013, 2014 IEEE 30th International Conference on Data Engineering.

[25]  Lukasz Golab,et al.  Issues in data stream management , 2003, SGMD.