Materialised view selection using randomised algorithms

A data warehouse stores historical data for the purpose of answering decision making queries. Such queries are usually exploratory and complex in nature and have a high response time when processed against a continuously growing data warehouse. This response time can be reduced by materialising the views in a data warehouse. All views cannot be materialised due to space constraints. Also, optimal view selection is an NP-complete problem. This paper proposes a randomised view selection two phase optimisation algorithm VS2POA that selects the top-T views from a multi-dimensional lattice. VS2POA selects views in two phases wherein, in the first phase, iterative improvement is used to select the best local optimised top-T views. These become the initial set of top-T views for the next phase, which is based on simulated annealing. VS2POA, in comparison to the well known greedy algorithm HRUA, selects comparatively better quality views for higher dimensional datasets.

[1]  Nagwa M. El-Makky,et al.  Algorithms for selecting materialized views in a data warehouse , 2005, The 3rd ACS/IEEE International Conference onComputer Systems and Applications, 2005..

[2]  M. T. Serna-Encinas,et al.  Algorithm for selection of materialized views: based on a costs model , 2007 .

[3]  Rada Chirkova,et al.  A formal perspective on the view selection problem , 2002, The VLDB Journal.

[4]  Kamalakar Karlapalem,et al.  View Relevance Driven Materialized View Selection in Data Warehousing Environment , 2002, Australasian Database Conference.

[5]  T. V. Vijay Kumar,et al.  Greedy Views Selection Using Size and Query Frequency , 2011 .

[6]  Rada Chirkova,et al.  Materialized Views , 2012, Found. Trends Databases.

[7]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Iterative Improvement , 2012, ACITY.

[8]  Xin Yao,et al.  Evolving materialized views in data warehouse , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  François Goasdoué,et al.  View Selection in Semantic Web Databases , 2011, Proc. VLDB Endow..

[10]  Jeffrey F. Naughton,et al.  Materialized View Selection for Multidimensional Datasets , 1998, VLDB.

[11]  John F. Roddick,et al.  Advances and Research Directions in Data-Warehousing Technology , 1999, Australas. J. Inf. Syst..

[12]  T. V. Vijay Kumar,et al.  Materialised views selection using size and query frequency , 2011 .

[13]  Wolfgang Lehner,et al.  Improving query response time in scientific databases using data aggregation -a case study , 1996, Proceedings of 7th International Conference and Workshop on Database and Expert Systems Applications: DEXA 96.

[14]  T. V. Vijay Kumar,et al.  A Reduced Lattice Greedy Algorithm for Selecting Materialized Views , 2009, ICISTM.

[15]  Alan D. Smith,et al.  Quality assurance practices for competitive data warehouse management systems , 2011, Int. J. Bus. Inf. Syst..

[16]  Neeraj Jain,et al.  Mining information for constructing materialised views , 2010, Int. J. Inf. Commun. Technol..

[17]  Jian Yang,et al.  Algorithms for Materialized View Design in Data Warehousing Environment , 1997, VLDB.

[18]  Nick Roussopoulos,et al.  Materialized views and data warehouses , 1998, SGMD.

[19]  T. V. Vijay Kumar,et al.  A Query Answering Greedy Algorithm for Selecting Materialized Views , 2010, ICCCI.

[20]  Jérôme Darmont,et al.  Data mining-based materialized view and index selection in data warehouses , 2007, Journal of Intelligent Information Systems.

[21]  Surajit Chaudhuri,et al.  Automated Selection of Materialized Views and Indexes in SQL Databases , 2000, VLDB.

[22]  T. V. Vijay Kumar,et al.  Query answering-based view selection , 2015, Int. J. Bus. Inf. Syst..

[23]  Sartaj Sahni,et al.  Simulated Annealing and Combinatorial Optimization , 1986, DAC 1986.

[24]  Alexeis Garcia-Perez,et al.  Revisiting knowledge warehousing: theoretical foundations , 2008, Int. J. Bus. Inf. Syst..

[25]  T. V. Vijay Kumar,et al.  Proposing Candidate Views for Materialization , 2010, ICISTM.

[26]  T. V. Vijay Kumar,et al.  A View Recommendation Greedy Algorithm for Materialized Views Selection , 2011, ICISTM.

[27]  Jennifer Widom,et al.  Research problems in data warehousing , 1995, CIKM '95.

[28]  Toby J. Teorey,et al.  A progressive view materialization algorithm , 1999, DOLAP '99.

[29]  Karthik Ramachandran,et al.  A Hybrid Approach for Data Warehouse View Selection , 2006, Int. J. Data Warehous. Min..

[30]  Xin Yao,et al.  Materialized view selection as constrained evolutionary optimization , 2003, IEEE Trans. Syst. Man Cybern. Part C.

[31]  Minsoo Lee,et al.  Speeding Up Materialized View Selection in Data Warehouses Using a Randomized Algorithm , 2001, Int. J. Cooperative Inf. Syst..

[32]  Dimitri Theodoratos,et al.  A Randomized Approach for the Incremental Design of an Evolving Data Warehouse , 2001, ER.

[33]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Memetic Algorithm , 2013, MIKE.

[34]  Zohra Bellahsene,et al.  A survey of view selection methods , 2012, SGMD.

[35]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Simulated Annealing , 2012, BDA.

[36]  Elena Baralis,et al.  Materialized Views Selection in a Multidimensional Database , 1997, VLDB.

[37]  Klemens Böhm,et al.  Towards materialized view selection for distributed databases , 2009, EDBT '09.

[38]  T. V. Vijay Kumar,et al.  Materialised view construction in data warehouse for decision making , 2012, Int. J. Bus. Inf. Syst..

[39]  T. V. Vijay Kumar,et al.  Materialized View Selection Using Genetic Algorithm , 2012, IC3.

[40]  W. H. Inmon,et al.  Building the Data Warehouse,3rd Edition , 2002 .

[41]  T. V. Vijay Kumar,et al.  Selection of Views for Materialization Using Size and Query Frequency , 2011 .

[42]  Gang Luo,et al.  Partial Materialized Views , 2007, 2007 IEEE 23rd International Conference on Data Engineering.

[43]  Yannis E. Ioannidis,et al.  Randomized algorithms for optimizing large join queries , 1990, SIGMOD '90.

[44]  Inderpal Singh Mumick,et al.  Selection of Views to Materialize in a Data Warehouse , 2005, IEEE Trans. Knowl. Data Eng..

[45]  Xin Yao,et al.  An evolutionary approach to materialized views selection in a data warehouse environment , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[46]  Matteo Golfarelli,et al.  View materialization for nested GPSJ queries , 2000, DMDW.

[47]  Timos K. Sellis,et al.  Data Warehouse Configuration , 1997, VLDB.

[48]  T. V. Vijay Kumar,et al.  Answering query-based selection of materialised views , 2013, Int. J. Inf. Decis. Sci..

[49]  Michael Lawrence,et al.  Multiobjective genetic algorithms for materialized view selection in OLAP data warehouses , 2006, GECCO '06.

[50]  Jeffrey D. Ullman,et al.  Implementing data cubes efficiently , 1996, SIGMOD '96.

[51]  M. Teschke,et al.  Using Materialized Views To Speed Up Data Warehousing , 1998 .

[52]  Ioana Manolescu,et al.  Materialized view selection for XQuery workloads , 2012, SIGMOD Conference.

[53]  W. H. Inmon,et al.  Building the data warehouse , 1992 .

[54]  Jérôme Darmont,et al.  Clustering-Based Materialized View Selection in Data Warehouses , 2006, ADBIS.

[55]  Rada Chirkova,et al.  Materialized Views , 2012, Found. Trends Databases.

[56]  Jeffrey D. Ullman,et al.  Index selection for OLAP , 1997, Proceedings 13th International Conference on Data Engineering.

[57]  T. V. Vijay Kumar,et al.  Materialized Views Selection for Answering Queries , 2010, ICDEM.

[58]  Cheng-Yan Kao,et al.  Materialized view selection using genetic algorithms in a data warehouse system , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).