Materialized View Selection Using Set Based Particle Swarm Optimization

A data warehouse is a central repository of historical data designed primarily to support analytical processing. These analytical queries are exploratory, long and complex in nature. Further, the rapid and continuous growth in the size of data warehouse increases the response times of such queries. Query response times need to be reduced in order to speedup decision making. This problem, being an NP-Complete problem, can be appropriately dealt with by using swarm intelligence techniques. One such technique, i.e. the set-based particle swarm optimization (SPSO), has been proposed to address this problem. Accordingly, a SPSO based view selection algorithm (SPSOVSA), which selects the Top-K views from a multidimensional lattice, is proposed. Experimental based comparison of SPSOVSA with the most fundamental view selection algorithm shows that SPSOVSA is able to select comparatively better quality Top-K views for materialization. The materialization of these selected views would improve the performance of analytical queries and lead to efficient decision making.

[1]  Wolfgang Lehner,et al.  Improving query response time in scientific databases using data aggregation -a case study , 1996, Proceedings of 7th International Conference and Workshop on Database and Expert Systems Applications: DEXA 96.

[2]  Inderpal Singh Mumick,et al.  Selection of views to materialize in a data warehouse , 1997, IEEE Transactions on Knowledge and Data Engineering.

[3]  Changhai Nie,et al.  A Discrete Particle Swarm Optimization for Covering Array Generation , 2015, IEEE Transactions on Evolutionary Computation.

[4]  Yingxu Wang.  On Cognitive Informatics , 2003 .

[5]  D. Y. Sha,et al.  A hybrid particle swarm optimization for job shop scheduling problem , 2006, Comput. Ind. Eng..

[6]  T. V. Vijay Kumar,et al.  Materialized View Selection using Marriage in Honey Bees Optimization , 2015, Int. J. Nat. Comput. Res..

[7]  Chunguang Zhou,et al.  Particle swarm optimization for traveling salesman problem , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[8]  T. V. Vijay Kumar,et al.  Materialized view selection using HBMO , 2017, Int. J. Syst. Assur. Eng. Manag..

[9]  Jeffrey Xu Yu,et al.  What Difference Heuristics Make: Maintenance-Cost View-Selection Revisited , 2002, WAIM.

[10]  Jeffrey F. Naughton,et al.  Materialized View Selection for Multidimensional Datasets , 1998, VLDB.

[11]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[12]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Simulated Annealing , 2012, BDA.

[13]  T. V. Vijay Kumar,et al.  A Reduced Lattice Greedy Algorithm for Selecting Materialized Views , 2009, ICISTM.

[14]  T. V. Vijay Kumar,et al.  Materialised view selection using randomised algorithms , 2015, Int. J. Bus. Inf. Syst..

[15]  Kenya Jin'no,et al.  Lévy flight PSO , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[16]  T. V. Vijay Kumar,et al.  Materialised view construction in data warehouse for decision making , 2012, Int. J. Bus. Inf. Syst..

[17]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Bumble Bee Mating Optimization , 2017, Int. J. Decis. Support Syst. Technol..

[18]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Memetic Algorithm , 2013, MIKE.

[19]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Genetic Algorithm , 2012, IC3.

[20]  Jeffrey D. Ullman,et al.  Index selection for OLAP , 1997, Proceedings 13th International Conference on Data Engineering.

[21]  Neeraj Jain,et al.  Mining information for constructing materialised views , 2010, Int. J. Inf. Commun. Technol..

[22]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[23]  Ziqiang Wang,et al.  An Efficient Materialized Views Selection Algorithm Based on PSO , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[24]  T. V. Vijay Kumar,et al.  Proposing Candidate Views for Materialization , 2010, ICISTM.

[25]  Jian Yang,et al.  Algorithms for Materialized View Design in Data Warehousing Environment , 1997, VLDB.

[26]  T. V. Vijay Kumar,et al.  Materialized View Selection using Artificial Bee Colony Optimization , 2017, Int. J. Intell. Inf. Technol..

[27]  T. V. Vijay Kumar,et al.  Greedy Views Selection Using Size and Query Frequency , 2011 .

[28]  T. V. Vijay Kumar,et al.  Materialised views selection using size and query frequency , 2011 .

[29]  T. V. Vijay Kumar,et al.  Query answering-based view selection , 2015, Int. J. Bus. Inf. Syst..

[30]  Chunguang Zhou,et al.  Fuzzy discrete particle swarm optimization for solving traveling salesman problem , 2004, The Fourth International Conference onComputer and Information Technology, 2004. CIT '04..

[31]  T. V. Vijay Kumar,et al.  Materialised view selection using BCO , 2016, Int. J. Bus. Inf. Syst..

[32]  T. V. Vijay Kumar,et al.  A Query Answering Greedy Algorithm for Selecting Materialized Views , 2010, ICCCI.

[33]  Meie Shen,et al.  Bi-Velocity Discrete Particle Swarm Optimization and Its Application to Multicast Routing Problem in Communication Networks , 2014, IEEE Transactions on Industrial Electronics.

[34]  Maurice Clerc,et al.  Discrete Particle Swarm Optimization, illustrated by the Traveling Salesman Problem , 2004 .

[35]  T. V. Vijay Kumar,et al.  Materialized Views Selection for Answering Queries , 2010, ICDEM.

[36]  Hamid Pirahesh,et al.  Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals , 1996, Data Mining and Knowledge Discovery.

[37]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[38]  T. V. Vijay Kumar,et al.  Query Frequency based View Selection , 2017 .

[39]  Rahul Singh,et al.  Distributed Query Plan Generation using Particle Swarm Optimization , 2013, Int. J. Swarm Intell. Res..

[40]  Timos K. Sellis,et al.  Data Warehouse Configuration , 1997, VLDB.

[41]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[42]  Jeffrey D. Ullman,et al.  Implementing data cubes efficiently , 1996, SIGMOD '96.

[43]  Yingxu Wang,et al.  On Abstract Intelligence: Toward a Unifying Theory of Natural, Artificial, Machinable, and Computational Intelligence , 2009, Int. J. Softw. Sci. Comput. Intell..

[44]  T. V. Vijay Kumar,et al.  A View Recommendation Greedy Algorithm for Materialized Views Selection , 2011, ICISTM.

[45]  Yingxu Wang,et al.  On abstract intelligence and its denotational mathematics foundations , 2008, 2008 7th IEEE International Conference on Cognitive Informatics.

[46]  T. V. Vijay Kumar,et al.  An Architectural Framework for Constructing Materialized Views in a Data Warehouse , 2013 .

[47]  T. V. Vijay Kumar,et al.  Selection of Views for Materialization Using Size and Query Frequency , 2011 .

[48]  T. V. Vijay Kumar,et al.  Materialized View Selection using Improvement based Bee Colony Optimization , 2015, Int. J. Softw. Sci. Comput. Intell..

[49]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[50]  Santosh Kumar,et al.  Materialised view selection using differential evolution , 2014 .

[51]  Jun Zhang,et al.  A Novel Set-Based Particle Swarm Optimization Method for Discrete Optimization Problems , 2010, IEEE Transactions on Evolutionary Computation.

[52]  Xin Yao,et al.  An evolutionary approach to materialized views selection in a data warehouse environment , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[53]  Pin Luarn,et al.  A discrete version of particle swarm optimization for flowshop scheduling problems , 2007, Comput. Oper. Res..

[54]  A. Rahimi-Kian,et al.  A Novel Binary Particle Swarm Optimization Method Using Artificial Immune System , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[55]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Iterative Improvement , 2012, ACITY.

[56]  Jorng-Tzong Horng,et al.  Applying evolutionary algorithms to materialized view selection in a data warehouse , 2003, Soft Comput..

[57]  T. V. Vijay Kumar,et al.  Answering query-based selection of materialised views , 2013, Int. J. Inf. Decis. Sci..