Materialised view selection using differential evolution

A data warehouse is designed for answering analytical queries. These queries are usually long, complex and ad hoc in nature and their response time is high when processed against an exponentially growing data warehouse. Materialising views has been found to be an effective tool for reducing this response time. All views cannot be materialised on account of resource constraints. Further, optimal view selection is shown to be an NP-complete problem. This necessitates selection of an appropriate set of views, from amongst all possible views that reduce the query response time. Most of the view selection algorithms are greedy or evolutionary. In this paper, a differential evolution view selection algorithm (DEVSA) that selects the Top-K views from a multi-dimensional lattice is proposed. Further, it is shown that DEVSA when compared to the greedy, genetic and memetic-based view selection algorithms selects comparatively better quality views for higher dimensional datasets.

[1]  Toby J. Teorey,et al.  A progressive view materialization algorithm , 1999, DOLAP '99.

[2]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Memetic Algorithm , 2013, MIKE.

[3]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Simulated Annealing , 2012, BDA.

[4]  T. V. Vijay Kumar,et al.  An Architectural Framework for Constructing Materialized Views in a Data Warehouse , 2013 .

[5]  W. H. Inmon,et al.  Building the Data Warehouse,3rd Edition , 2002 .

[6]  Elena Baralis,et al.  Materialized Views Selection in a Multidimensional Database , 1997, VLDB.

[7]  T. V. Vijay Kumar,et al.  Materialised view construction in data warehouse for decision making , 2012, Int. J. Bus. Inf. Syst..

[8]  Jeffrey F. Naughton,et al.  Materialized View Selection for Multidimensional Datasets , 1998, VLDB.

[9]  Surajit Chaudhuri,et al.  Automated Selection of Materialized Views and Indexes in SQL Databases , 2000, VLDB.

[10]  Lingjuan Hou,et al.  A novel discrete differential evolution algorithm , 2013 .

[11]  Wolfgang Lehner,et al.  Improving query response time in scientific databases using data aggregation -a case study , 1996, Proceedings of 7th International Conference and Workshop on Database and Expert Systems Applications: DEXA 96.

[12]  T. V. Vijay Kumar,et al.  A Reduced Lattice Greedy Algorithm for Selecting Materialized Views , 2009, ICISTM.

[13]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[14]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Genetic Algorithm , 2012, IC3.

[15]  T. V. Vijay Kumar,et al.  Proposing Candidate Views for Materialization , 2010, ICISTM.

[16]  T. V. Vijay Kumar,et al.  Selection of Views for Materialization Using Size and Query Frequency , 2011 .

[17]  Gang Luo,et al.  Partial Materialized Views , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[18]  Ville Tirronen,et al.  Two algorithmic enhancements for the parallel differential evolution , 2011 .

[19]  Minsoo Lee,et al.  Speeding Up Materialized View Selection in Data Warehouses Using a Randomized Algorithm , 2001, Int. J. Cooperative Inf. Syst..

[20]  Daniel Lichtblau.  Differential Evolution in Discrete Optimization. , 2012 .

[21]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[22]  T. V. Vijay Kumar,et al.  Materialized Views Selection for Answering Queries , 2010, ICDEM.

[23]  Cheng-Yan Kao,et al.  Materialized view selection using genetic algorithms in a data warehouse system , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[24]  Jennifer Widom,et al.  Research problems in data warehousing , 1995, CIKM '95.

[25]  Nagwa M. El-Makky,et al.  Algorithms for selecting materialized views in a data warehouse , 2005, The 3rd ACS/IEEE International Conference onComputer Systems and Applications, 2005..

[26]  M. T. Serna-Encinas,et al.  Algorithm for selection of materialized views: based on a costs model , 2007 .

[27]  Rada Chirkova,et al.  A formal perspective on the view selection problem , 2002, The VLDB Journal.

[28]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Iterative Improvement , 2012, ACITY.

[29]  Xin Yao,et al.  Evolving materialized views in data warehouse , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[30]  Kang Li,et al.  An Improved Approach for Materialized View Selection Based on Genetic Algorithm , 2012, J. Comput..

[31]  Ziyu Lin,et al.  User-Oriented Materialized View Selection , 2007, 7th IEEE International Conference on Computer and Information Technology (CIT 2007).

[32]  T. V. Vijay Kumar,et al.  Materialised views selection using size and query frequency , 2011 .

[33]  Neeraj Jain,et al.  Mining information for constructing materialised views , 2010, Int. J. Inf. Commun. Technol..

[34]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[35]  Andries Petrus Engelbrecht,et al.  Binary Differential Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[36]  Jian Yang,et al.  Algorithms for Materialized View Design in Data Warehousing Environment , 1997, VLDB.

[37]  Panos Kalnis,et al.  View selection using randomized search , 2002, Data Knowl. Eng..

[38]  T. V. Vijay Kumar,et al.  Answering query-based selection of materialised views , 2013, Int. J. Inf. Decis. Sci..

[39]  Michael Lawrence,et al.  Multiobjective genetic algorithms for materialized view selection in OLAP data warehouses , 2006, GECCO '06.

[40]  Xin Yao,et al.  Materialized view selection as constrained evolutionary optimization , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[41]  Jeffrey D. Ullman,et al.  Implementing data cubes efficiently , 1996, SIGMOD '96.

[42]  Wen-Yang Lin,et al.  A Genetic Selection Algorithm for OLAP Data Cubes , 2003, Knowledge and Information Systems.

[43]  Jérôme Darmont,et al.  Data mining-based materialized view and index selection in data warehouses , 2007, Journal of Intelligent Information Systems.

[44]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[45]  Karthik Ramachandran,et al.  A Hybrid Approach for Data Warehouse View Selection , 2006, Int. J. Data Warehous. Min..

[46]  Jérôme Darmont,et al.  Clustering-Based Materialized View Selection in Data Warehouses , 2006, ADBIS.

[47]  Dimitri Theodoratos,et al.  A Randomized Approach for the Incremental Design of an Evolving Data Warehouse , 2001, ER.

[48]  Kamalakar Karlapalem,et al.  View Relevance Driven Materialized View Selection in Data Warehousing Environment , 2002, Australasian Database Conference.

[49]  Mehmet Fatih Tasgetiren,et al.  An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem , 2010, Appl. Math. Comput..

[50]  T. V. Vijay Kumar,et al.  Greedy Views Selection Using Size and Query Frequency , 2011 .

[51]  T. V. Vijay Kumar,et al.  A View Recommendation Greedy Algorithm for Materialized Views Selection , 2011, ICISTM.

[52]  Jeffrey D. Ullman,et al.  Index selection for OLAP , 1997, Proceedings 13th International Conference on Data Engineering.

[53]  Nick Roussopoulos,et al.  Materialized views and data warehouses , 1998, SGMD.

[54]  T. V. Vijay Kumar,et al.  A Query Answering Greedy Algorithm for Selecting Materialized Views , 2010, ICCCI.

[55]  Matteo Golfarelli,et al.  View materialization for nested GPSJ queries , 2000, DMDW.

[56]  Timos K. Sellis,et al.  Data Warehouse Configuration , 1997, VLDB.

[57]  Lawrence Davis,et al.  Applying Adaptive Algorithms to Epistatic Domains , 1985, IJCAI.

[58]  Antonin Ponsich,et al.  Differential Evolution performances for the solution of mixed-integer constrained process engineering problems , 2011, Appl. Soft Comput..

[59]  Xin Yao,et al.  An evolutionary approach to materialized views selection in a data warehouse environment , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[60]  Viktor Vegh,et al.  A variant of differential evolution for discrete optimization problems requiring mutually distinct parameters , 2011 .

[61]  Inderpal Singh Mumick,et al.  Selection of Views to Materialize in a Data Warehouse , 2005, IEEE Trans. Knowl. Data Eng..

[62]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[63]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.