Multi-objective materialized view selection using MOGA

Data warehouse is constructed with the purpose of supporting decision making. Decision making queries, being long and complex, consume a lot of time in processing against a continuously growing data warehouse. View materialization is one of the alternative ways of improving the response time of such analytical or decision making queries. This involves selection and materialization of views that minimize the analytical query response times while adhering to the resource constraints. This is referred to as the view selection problem, which is a NP-Hard problem. The view selection problem is concerned with simultaneously minimizing the cost of evaluating materialized and non-materialized views. This being a bi-objective optimization problem is addressed using NSGA-II in this paper. The proposed approach aims to achieve an acceptable trade-off between the afore-mentioned two objectives.

[1]  Wolfgang Lehner,et al.  Improving query response time in scientific databases using data aggregation -a case study , 1996, Proceedings of 7th International Conference and Workshop on Database and Expert Systems Applications: DEXA 96.

[2]  Inderpal Singh Mumick,et al.  Selection of views to materialize in a data warehouse , 1997, IEEE Transactions on Knowledge and Data Engineering.

[3]  T. V. Vijay Kumar,et al.  A Reduced Lattice Greedy Algorithm for Selecting Materialized Views , 2009, ICISTM.

[4]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Iterative Improvement , 2012, ACITY.

[5]  T. V. Vijay Kumar,et al.  An Architectural Framework for Constructing Materialized Views in a Data Warehouse , 2013 .

[6]  Amit Kumar,et al.  Improved Quality View Selection for Analytical Query Performance Enhancement Using Particle Swarm Optimization , 2017 .

[7]  T. V. Vijay Kumar,et al.  Selection of Views for Materialization Using Size and Query Frequency , 2011 .

[8]  Gang Luo,et al.  Partial Materialized Views , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[9]  Rada Chirkova,et al.  A Formal Model for the Problem of View Selection for Aggregate Queries , 2005, ADBIS.

[10]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Bumble Bee Mating Optimization , 2017, Int. J. Decis. Support Syst. Technol..

[11]  Neeraj Jain,et al.  Mining information for constructing materialised views , 2010, Int. J. Inf. Commun. Technol..

[12]  Jérôme Darmont,et al.  Clustering-Based Materialized View Selection in Data Warehouses , 2006, ADBIS.

[13]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Memetic Algorithm , 2013, MIKE.

[14]  Jian Yang,et al.  A framework for designing materialized views in data warehousing environment , 1997, Proceedings of 17th International Conference on Distributed Computing Systems.

[15]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[16]  Minsoo Lee,et al.  Speeding Up Materialized View Selection in Data Warehouses Using a Randomized Algorithm , 2001, Int. J. Cooperative Inf. Syst..

[17]  T. V. Vijay Kumar,et al.  Materialized View Selection using Artificial Bee Colony Optimization , 2017, Int. J. Intell. Inf. Technol..

[18]  Jian Yang,et al.  Algorithms for Materialized View Design in Data Warehousing Environment , 1997, VLDB.

[19]  Ziqiang Wang,et al.  An Efficient Materialized Views Selection Algorithm Based on PSO , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[20]  T. V. Vijay Kumar,et al.  Materialized Views Selection for Answering Queries , 2010, ICDEM.

[21]  Cheng-Yan Kao,et al.  Materialized view selection using genetic algorithms in a data warehouse system , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[22]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[23]  Dimitri Theodoratos,et al.  A Randomized Approach for the Incremental Design of an Evolving Data Warehouse , 2001, ER.

[24]  Jérôme Darmont,et al.  Data mining-based materialized view and index selection in data warehouses , 2007, Journal of Intelligent Information Systems.

[25]  T. V. Vijay Kumar,et al.  Materialized View Selection using Improvement based Bee Colony Optimization , 2015, Int. J. Softw. Sci. Comput. Intell..

[26]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[27]  John F. Roddick,et al.  Advances and Research Directions in Data-Warehousing Technology , 1999, Australas. J. Inf. Syst..

[28]  Toby J. Teorey,et al.  A progressive view materialization algorithm , 1999, DOLAP '99.

[29]  T. V. Vijay Kumar,et al.  Query Frequency based View Selection , 2017 .

[30]  Xin Yao,et al.  Materialized view selection as constrained evolutionary optimization , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[31]  T. V. Vijay Kumar,et al.  Materialised view selection using BCO , 2016, Int. J. Bus. Inf. Syst..

[32]  Santosh Kumar,et al.  Materialised view selection using differential evolution , 2014 .

[33]  Surajit Chaudhuri,et al.  Automated Selection of Materialized Views and Indexes in SQL Databases , 2000, VLDB.

[34]  Howard J. Karloff,et al.  On the complexity of the view-selection problem , 1999, PODS '99.

[35]  Wen-Yang Lin,et al.  A Genetic Selection Algorithm for OLAP Data Cubes , 2003, Knowledge and Information Systems.

[36]  Timos K. Sellis,et al.  Data Warehouse Configuration , 1997, VLDB.

[37]  T. V. Vijay Kumar,et al.  Proposing Candidate Views for Materialization , 2010, ICISTM.

[38]  Bernardetta Addis,et al.  A global optimization method for the design of space trajectories , 2011, Comput. Optim. Appl..

[39]  Kang Li,et al.  An Improved Approach for Materialized View Selection Based on Genetic Algorithm , 2012, J. Comput..

[40]  Nagwa M. El-Makky,et al.  Algorithms for selecting materialized views in a data warehouse , 2005, The 3rd ACS/IEEE International Conference onComputer Systems and Applications, 2005..

[41]  Nick Roussopoulos,et al.  Materialized views and data warehouses , 1998, SGMD.

[42]  T. V. Vijay Kumar,et al.  Materialized View Selection using Marriage in Honey Bees Optimization , 2015, Int. J. Nat. Comput. Res..

[43]  M. T. Serna-Encinas,et al.  Algorithm for selection of materialized views: based on a costs model , 2007 .

[44]  Rada Chirkova,et al.  A formal perspective on the view selection problem , 2002, The VLDB Journal.

[45]  Jay Prakash,et al.  Multi-Objective Materialized View Selection Using Improved Strength Pareto Evolutionary Algorithm , 2019, International Journal of Artificial Intelligence and Machine Learning.

[46]  W. H. Inmon,et al.  Building the data warehouse , 1992 .

[47]  Michael Lawrence,et al.  Multiobjective genetic algorithms for materialized view selection in OLAP data warehouses , 2006, GECCO '06.

[48]  Jeffrey D. Ullman,et al.  Implementing data cubes efficiently , 1996, SIGMOD '96.

[49]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[50]  T. V. Vijay Kumar,et al.  A Query Answering Greedy Algorithm for Selecting Materialized Views , 2010, ICCCI.

[51]  Panos Kalnis,et al.  View selection using randomized search , 2002, Data Knowl. Eng..

[52]  T. V. Vijay Kumar,et al.  Answering query-based selection of materialised views , 2013, Int. J. Inf. Decis. Sci..

[53]  Amit Kumar,et al.  Materialized View Selection Using Set Based Particle Swarm Optimization , 2018, Int. J. Cogn. Informatics Nat. Intell..

[54]  Inderpal Singh Mumick,et al.  Selection of Views to Materialize in a Data Warehouse , 2005, IEEE Trans. Knowl. Data Eng..

[55]  Nick Roussopoulos.  The Logical Access Path Schema of a Database , 1982, IEEE Transactions on Software Engineering.

[56]  Xin Yao,et al.  An evolutionary approach to materialized views selection in a data warehouse environment , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[57]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[58]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[59]  T. V. Vijay Kumar,et al.  A View Recommendation Greedy Algorithm for Materialized Views Selection , 2011, ICISTM.

[60]  Karthik Ramachandran,et al.  A Hybrid Approach for Data Warehouse View Selection , 2006, Int. J. Data Warehous. Min..

[61]  Lawrence Davis,et al.  Applying Adaptive Algorithms to Epistatic Domains , 1985, IJCAI.

[62]  Jeffrey D. Ullman,et al.  Index selection for OLAP , 1997, Proceedings 13th International Conference on Data Engineering.

[63]  Kamalakar Karlapalem,et al.  View Relevance Driven Materialized View Selection in Data Warehousing Environment , 2002, Australasian Database Conference.

[64]  T. V. Vijay Kumar,et al.  Greedy Views Selection Using Size and Query Frequency , 2011 .

[65]  T. V. Vijay Kumar,et al.  Query answering-based view selection , 2015, Int. J. Bus. Inf. Syst..

[66]  Jay Prakash,et al.  A Multi-Objective Approach for Materialized View Selection , 2019, Int. J. Oper. Res. Inf. Syst..

[67]  Jennifer Widom,et al.  Research problems in data warehousing , 1995, CIKM '95.

[68]  T. V. Vijay Kumar,et al.  Materialized view selection using HBMO , 2017, Int. J. Syst. Assur. Eng. Manag..

[69]  Santosh Kumar,et al.  A novel quantum-inspired evolutionary view selection algorithm , 2018, Sādhanā.

[70]  Xin Yao,et al.  Evolving materialized views in data warehouse , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[71]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[72]  Ziyu Lin,et al.  User-Oriented Materialized View Selection , 2007, 7th IEEE International Conference on Computer and Information Technology (CIT 2007).

[73]  T. V. Vijay Kumar,et al.  Materialised views selection using size and query frequency , 2011 .

[74]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Simulated Annealing , 2012, BDA.

[75]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[76]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[77]  Elena Baralis,et al.  Materialized Views Selection in a Multidimensional Database , 1997, VLDB.

[78]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Genetic Algorithm , 2012, IC3.