Efficient Continuous Skyline Query Processing Scheme over Large Dynamic Data Sets

Performing continuous skyline queries of dynamic data sets is now more challenging as the sizes of data sets increase and as they become more volatile due to the increase in dynamic updates. Although previous work proposed support for such queries, their efficiency was restricted to small data sets or uniformly distributed data sets. In a production database with many concurrent queries, the execution of continuous skyline queries impacts query performance due to update requirements to acquire exclusive locks, possibly blocking other query threads. Thus, the computational costs increase. In order to minimize computational requirements, we propose a method based on a multi-layer grid structure. First, relational data object, elements of an initial data set, are processed to obtain the corresponding multi-layer grid structure and the skyline influence regions over the data. Then, the dynamic data are processed only when they are identified within the skyline influence regions. Therefore, a large amount of computation can be pruned by adopting the proposed multi-layer grid structure. Using a variety of datasets, the performance evaluation confirms the efficiency of the proposed method.

[1]  Hongjun Lu,et al.  Stabbing the sky: efficient skyline computation over sliding windows , 2005, 21st International Conference on Data Engineering (ICDE'05).

[2]  Anthony K. H. Tung,et al.  Continuous Skyline Queries for Moving Objects , 2006, IEEE Transactions on Knowledge and Data Engineering.

[3]  Bernhard Seeger,et al.  Progressive skyline computation in database systems , 2005, TODS.

[4]  Roger Zimmermann,et al.  SkyEngine: Efficient Skyline search engine for Continuous Skyline computations , 2011, 2011 IEEE 27th International Conference on Data Engineering.

[5]  Yufei Tao,et al.  Maintaining sliding window skylines on data streams , 2006, IEEE Transactions on Knowledge and Data Engineering.

[6]  He Li,et al.  A continuous reverse skyline query processing method in moving objects environments , 2016, Data Knowl. Eng..

[7]  Bernhard Seeger,et al.  An optimal and progressive algorithm for skyline queries , 2003, SIGMOD '03.

[8]  Myoung-Ho Kim,et al.  Efficient processing of multiple continuous skyline queries over a data stream , 2013, Inf. Sci..

[9]  Yan Jia,et al.  Grid Index Based Algorithm for Continuous Skyline Computation: Grid Index Based Algorithm for Continuous Skyline Computation , 2009 .

[10]  Xiaowei Wang,et al.  Grid-Based Probabilistic Skyline Retrieval on Distributed Uncertain Data , 2011, DASFAA Workshops.

[11]  Lili Wei,et al.  Efficient Processing of Continuous Skyline Query over Smarter Traffic Data Stream for Cloud Computing , 2013 .

[12]  Javier Nogueras-Iso,et al.  An automatic method for reporting the quality of thesauri , 2016, Data Knowl. Eng..

[13]  He Li,et al.  An Efficient Grid Method for Continuous Skyline Computation over Dynamic Data Set , 2010 .

[14]  Anthony K. H. Tung,et al.  Finding k-dominant skylines in high dimensional space , 2006, SIGMOD Conference.

[15]  Donald Kossmann,et al.  Shooting Stars in the Sky: An Online Algorithm for Skyline Queries , 2002, VLDB.

[16]  Seung-won Hwang,et al.  QSkycube: Efficient Skycube Computation using Point-Based Space Partitioning , 2010, Proc. VLDB Endow..

[17]  Jan Chomicki,et al.  Skyline with presorting , 2003, Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405).

[18]  Seung-won Hwang,et al.  Toward efficient multidimensional subspace skyline computation , 2013, The VLDB Journal.

[19]  Seung-won Hwang,et al.  Continuous Skylining on Volatile Moving Data , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[20]  Li Ai Grid Index Based Algorithm for Continuous Skyline Computation , 2008 .

[21]  Li Tian,et al.  Continuous monitoring of skyline query over highly dynamic moving objects , 2007, MobiDE '07.

[22]  Jignesh M. Patel,et al.  Efficient Continuous Skyline Computation , 2006, 22nd International Conference on Data Engineering (ICDE'06).