Multi-Objective Materialized View Selection Using Improved Strength Pareto Evolutionary Algorithm

A data warehouse system uses materialized views extensively in order to speedily tackle analytical queries. Considering that all possible views cannot be materialized due to maintenance cost and storage constraints, the selection of an appropriate set of views to materialize that achieve an optimal trade-off among query response time, maintenance cost, and the storage constraint becomes an essential necessity. The selection of such an appropriate set of views for materialization is referred to as the materialized views selection problem, which is an NP-Complete problem. In the last two decades, several new selection approaches, based on heuristics, have been proposed. Most of these have used a single objective or weighted sum approach to address the various constraints. In this article, an attempt has been made to address the bi-objective materialized view selection problem, where the objective is to minimize the view evaluation cost of materialized views and the view evaluation cost of the non-materialized views, using the Improved Strength Pareto Evolutionary Algorithm. The experimental results show that the proposed multi-objective view selection algorithm is able to select the Top-K views that achieves a reasonable trade-off between the two objectives. Materializing these selected views would reduce the query response times for analytical queries and thereby facilitates the decision-making process.

[1]  T. V. Vijay Kumar,et al.  Materialized Views Selection for Answering Queries , 2010, ICDEM.

[2]  T. V. Vijay Kumar,et al.  Query Frequency based View Selection , 2017 .

[3]  Timos K. Sellis,et al.  Data Warehouse Configuration , 1997, VLDB.

[4]  María-Trinidad Serna-Encinas,et al.  Algorithm for selection of materialized views: based on a costs model , 2007, Eighth Mexican International Conference on Current Trends in Computer Science (ENC 2007).

[5]  Santosh Kumar,et al.  A novel quantum-inspired evolutionary view selection algorithm , 2018, Sādhanā.

[6]  Jeffrey F. Naughton,et al.  Materialized View Selection for Multidimensional Datasets , 1998, VLDB.

[7]  Nagwa M. El-Makky,et al.  Algorithms for selecting materialized views in a data warehouse , 2005, The 3rd ACS/IEEE International Conference onComputer Systems and Applications, 2005..

[8]  Inderpal Singh Mumick,et al.  The Stanford Data Warehousing Project , 1995 .

[9]  Minsoo Lee,et al.  Speeding Up Materialized View Selection in Data Warehouses Using a Randomized Algorithm , 2001, Int. J. Cooperative Inf. Syst..

[10]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Simulated Annealing , 2012, BDA.

[11]  T. V. Vijay Kumar,et al.  Answering query-based selection of materialised views , 2013, Int. J. Inf. Decis. Sci..

[12]  Inderpal Singh Mumick,et al.  Selection of Views to Materialize Under a Maintenance Cost Constraint , 1999, ICDT.

[13]  Yongluan Zhou,et al.  Materialized view selection in feed following systems , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[14]  Panos Kalnis,et al.  View selection using randomized search , 2002, Data Knowl. Eng..

[15]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Memetic Algorithm , 2013, MIKE.

[16]  Cheng-Yan Kao,et al.  Materialized view selection using genetic algorithms in a data warehouse system , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[17]  T. V. Vijay Kumar,et al.  A View Recommendation Greedy Algorithm for Materialized Views Selection , 2011, ICISTM.

[18]  Xin Yao,et al.  Materialized view selection as constrained evolutionary optimization , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[19]  Kamalakar Karlapalem,et al.  View Relevance Driven Materialized View Selection in Data Warehousing Environment , 2002, Australasian Database Conference.

[20]  T. V. Vijay Kumar,et al.  Materialized View Selection using Marriage in Honey Bees Optimization , 2015, Int. J. Nat. Comput. Res..

[21]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[22]  Neeraj Jain,et al.  Mining information for constructing materialised views , 2010, Int. J. Inf. Commun. Technol..

[23]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Genetic Algorithm , 2012, IC3.

[24]  Toby J. Teorey,et al.  A progressive view materialization algorithm , 1999, DOLAP '99.

[25]  Lawrence Davis,et al.  Applying Adaptive Algorithms to Epistatic Domains , 1985, IJCAI.

[26]  T. V. Vijay Kumar,et al.  A Query Answering Greedy Algorithm for Selecting Materialized Views , 2010, ICCCI.

[27]  T. V. Vijay Kumar,et al.  Greedy Views Selection Using Size and Query Frequency , 2011 .

[28]  Inderpal Singh Mumick,et al.  Selection of views to materialize in a data warehouse , 1997, IEEE Transactions on Knowledge and Data Engineering.

[29]  T. V. Vijay Kumar,et al.  Selection of Views for Materialization Using Size and Query Frequency , 2011 .

[30]  Bernardetta Addis,et al.  A global optimization method for the design of space trajectories , 2011, Comput. Optim. Appl..

[31]  T. V. Vijay Kumar,et al.  Proposing Candidate Views for Materialization , 2010, ICISTM.

[32]  T. V. Vijay Kumar,et al.  A Reduced Lattice Greedy Algorithm for Selecting Materialized Views , 2009, ICISTM.

[33]  Michael Lawrence,et al.  Multiobjective genetic algorithms for materialized view selection in OLAP data warehouses , 2006, GECCO '06.

[34]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Bumble Bee Mating Optimization , 2017, Int. J. Decis. Support Syst. Technol..

[35]  Jérôme Darmont,et al.  Data mining-based materialized view and index selection in data warehouses , 2007, Journal of Intelligent Information Systems.

[36]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[37]  Surajit Chaudhuri,et al.  Automated Selection of Materialized Views and Indexes in SQL Databases , 2000, VLDB.

[38]  Wilburt Labio,et al.  Physical database design for data warehouses , 1997, Proceedings 13th International Conference on Data Engineering.

[39]  Xin Yao,et al.  An evolutionary approach to materialized views selection in a data warehouse environment , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[40]  Jérôme Darmont,et al.  Clustering-Based Materialized View Selection in Data Warehouses , 2006, ADBIS.

[41]  T. V. Vijay Kumar,et al.  An Architectural Framework for Constructing Materialized Views in a Data Warehouse , 2013 .

[42]  John F. Roddick,et al.  Advances and Research Directions in Data-Warehousing Technology , 1999, Australas. J. Inf. Syst..

[43]  Rada Chirkova,et al.  A formal perspective on the view selection problem , 2002, The VLDB Journal.

[44]  Yang Ping,et al.  A bacterial foraging global optimization algorithm based on the particle swarm optimization , 2010, 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[45]  Anastasios G. Bakirtzis,et al.  A genetic algorithm solution to the unit commitment problem , 1996 .

[46]  Kang Li,et al.  An Improved Approach for Materialized View Selection Based on Genetic Algorithm , 2012, J. Comput..

[47]  Jennifer Widom,et al.  Research problems in data warehousing , 1995, CIKM '95.

[48]  Jay Prakash,et al.  A Multi-Objective Approach for Materialized View Selection , 2019, Int. J. Oper. Res. Inf. Syst..

[49]  Jeffrey D. Ullman,et al.  Index selection for OLAP , 1997, Proceedings 13th International Conference on Data Engineering.

[50]  T. V. Vijay Kumar,et al.  Materialised view selection using BCO , 2016, Int. J. Bus. Inf. Syst..

[51]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[52]  T. V. Vijay Kumar,et al.  Materialized View Selection using Artificial Bee Colony Optimization , 2017, Int. J. Intell. Inf. Technol..

[53]  Matteo Golfarelli,et al.  View materialization for nested GPSJ queries , 2000, DMDW.

[54]  T. V. Vijay Kumar,et al.  Materialised view selection using randomised algorithms , 2015, Int. J. Bus. Inf. Syst..

[55]  T. V. Vijay Kumar,et al.  Materialised views selection using size and query frequency , 2011 .

[56]  T. V. Vijay Kumar,et al.  Materialized View Selection using Improvement based Bee Colony Optimization , 2015, Int. J. Softw. Sci. Comput. Intell..

[57]  T. V. Vijay Kumar,et al.  Materialized view selection using HBMO , 2017, Int. J. Syst. Assur. Eng. Manag..

[58]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[59]  Karthik Ramachandran,et al.  A Hybrid Approach for Data Warehouse View Selection , 2006, Int. J. Data Warehous. Min..

[60]  Dimitri Theodoratos,et al.  A Randomized Approach for the Incremental Design of an Evolving Data Warehouse , 2001, ER.

[61]  Mohamed Ziauddin,et al.  Materialized Views in Oracle , 1998, VLDB.

[62]  Wen-Yang Lin,et al.  A Genetic Selection Algorithm for OLAP Data Cubes , 2003, Knowledge and Information Systems.

[63]  Nick Roussopoulos,et al.  Materialized views and data warehouses , 1998, SGMD.

[64]  Gang Luo,et al.  Partial Materialized Views , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[65]  Ziyu Lin,et al.  User-Oriented Materialized View Selection , 2007, 7th IEEE International Conference on Computer and Information Technology (CIT 2007).

[66]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Iterative Improvement , 2012, ACITY.

[67]  Zhou Lijuan,et al.  Research on Materialized View Selection Algorithm in Data Warehouse , 2009, 2009 International Forum on Computer Science-Technology and Applications.

[68]  Santosh Kumar,et al.  Materialised view selection using differential evolution , 2014 .

[69]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[70]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[71]  T. V. Vijay Kumar,et al.  Query answering-based view selection , 2015, Int. J. Bus. Inf. Syst..

[72]  Wolfgang Lehner,et al.  Improving query response time in scientific databases using data aggregation -a case study , 1996, Proceedings of 7th International Conference and Workshop on Database and Expert Systems Applications: DEXA 96.

[73]  Xin Yao,et al.  Evolving materialized views in data warehouse , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[74]  Howard J. Karloff,et al.  On the complexity of the view-selection problem , 1999, PODS '99.

[75]  Rada Chirkova,et al.  A Formal Model for the Problem of View Selection for Aggregate Queries , 2005, ADBIS.