Gradual Data Aggregation in Multi-granular Fact Tables on Resource-Constrained Systems

Multi-granular fact tables are used to store and query data at different levels of granularity. In order to collect data in multi-granular fact tables on a resource-constrained system and to keep it for a long time, we gradually aggregate data to save space, however, still allowing analysis queries, for example, for maintenance purposes etc. to work and generate valid results even after aggregation. However, ineffective means of data aggregation is one of the main factors that can not only reduce performance of the queries but also leads to erroneous reporting. This paper presents effective methods for data reduction that are developed to perform gradual data aggregation in multi-granular fact tables on resource-constrained systems. With the gradual data aggregation mechanism, older data can be made coarse-grained while keeping the newest data fine-grained. This paper also evaluates the proposed methods based on a real world farming case study.

[1]  Torben Bach Pedersen,et al.  Specification-based data reduction in dimensional data warehouses , 2008, Inf. Syst..

[2]  Nadeem Iftikhar Integration, aggregation and exchange of farming device data: A high level perspective , 2009, 2009 Second International Conference on the Applications of Digital Information and Web Technologies.

[3]  Wei Hong,et al.  TinyDB: an acquisitional query processing system for sensor networks , 2005, TODS.

[4]  Young-Koo Lee,et al.  Towards using data aggregation techniques in ubiquitous computing environments , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOMW'06).

[5]  Moon Jeung Joe,et al.  LGeDBMS: a small DBMS for embedded system with flash memory , 2006, VLDB.

[6]  Aliou Boly,et al.  Forgetting data intelligently in data warehouses , 2007, 2007 IEEE International Conference on Research, Innovation and Vision for the Future.

[7]  Wolfgang Lehner,et al.  Data modeling for Precision Dairy Farming within the competitive field of operational and analytical tasks , 2007 .

[8]  Dimitrios Gunopulos,et al.  Temporal and spatio-temporal aggregations over data streams using multiple time granularities , 2003, Inf. Syst..

[9]  Jaideep Srivastava,et al.  Efficient Aggregation Algorithms for Compressed Data Warehouses , 2002, IEEE Trans. Knowl. Data Eng..

[10]  Richard T. Snodgrass,et al.  Spatiotemporal aggregate computation: a survey , 2005, IEEE Transactions on Knowledge and Data Engineering.