Aggregating and Disaggregating Flexibility Objects

Flexibility objects, objects with flexibilities in time and amount dimensions (e.g., energy or product amount), occur in many scientific and commercial domains. Managing such objects with existing DBMSs is infeasible due to the complexity, data volume, and complex functionality needed, so a new kind of flexibility database is needed. This paper is the first to consider flexibility databases. It formally defines the concept of flexibility objects (flex-objects), and provide a novel and efficient solution for aggregating and disaggregating flex-objects. This is important for a range of applications, including smart grid energy management. The paper considers the grouping of flex-objects, alternatives for computing aggregates, the disaggregation process, their associated requirements, as well as efficient incremental computation. Extensive experiments based on data from a real-world energy domain project show that the proposed solution provides good performance while still satisfying the strict requirements.

[1]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[2]  Bongki Moon,et al.  Efficient Algorithms for Large-Scale Temporal Aggregation , 2003, IEEE Trans. Knowl. Data Eng..

[3]  Yin Yang,et al.  Continuous k-Means Monitoring over Moving Objects , 2008, IEEE Transactions on Knowledge and Data Engineering.

[4]  Esteban Zimányi,et al.  Advanced Data Warehouse Design: From Conventional to Spatial and Temporal Applications , 2010 .

[5]  Walid G. Aref,et al.  Similarity Group-By , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[6]  Torben Bach Pedersen,et al.  Data management in the MIRABEL smart grid system , 2012, EDBT-ICDT '12.

[7]  Won Suk Lee,et al.  Statistical grid-based clustering over data streams , 2004, SGMD.

[8]  Christian S. Jensen,et al.  A foundation for capturing and querying complex multidimensional data , 2001, Inf. Syst..

[9]  Christian S. Jensen,et al.  Multi-dimensional Aggregation for Temporal Data , 2006, EDBT.

[10]  Richard T. Snodgrass,et al.  Main Memory-Based Algorithms for Efficient Parallel Aggregation for Temporal Databases , 2004, Distributed and Parallel Databases.

[11]  Jaime G. Carbonell,et al.  Incremental Aggregation on Multiple Continuous Queries , 2006, ISMIS.

[12]  Robin Sibson,et al.  SLINK: An Optimally Efficient Algorithm for the Single-Link Cluster Method , 1973, Comput. J..

[13]  Chi-Yin Chow,et al.  Aggregate Location Monitoring for Wireless Sensor Networks: A Histogram-Based Approach , 2009, 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware.

[14]  Jiadong Ren,et al.  A Clustering Algorithm Based on Matrix over High Dimensional Data Stream , 2010, WISM.

[15]  Michael H. Böhlen,et al.  Parsimonious temporal aggregation , 2009, EDBT.

[16]  Tian Zhang,et al.  BIRCH: an efficient data clustering method for very large databases , 1996, SIGMOD '96.

[17]  Beng Chin Ooi,et al.  Continuous Clustering of Moving Objects , 2007, IEEE Transactions on Knowledge and Data Engineering.

[18]  Walid G. Aref,et al.  SimDB: a similarity-aware database system , 2010, SIGMOD Conference.

[19]  Donghui Zhang,et al.  Aggregation computation over complex objects , 2002 .

[20]  Jennifer Widom,et al.  Resource Sharing in Continuous Sliding-Window Aggregates , 2004, VLDB.

[21]  Jordi Cabot,et al.  Specifying Aggregation Functions in Multidimensional Models with OCL , 2010, ER.

[22]  Xiang Yu,et al.  An incremental clustering algorithm based on grid , 2011, 2011 Eighth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[23]  Christian S. Jensen,et al.  How Would You Like to Aggregate Your Temporal Data? , 2006, Thirteenth International Symposium on Temporal Representation and Reasoning (TIME'06).

[24]  Jennifer Widom,et al.  Incremental computation and maintenance of temporal aggregates , 2003, The VLDB Journal.