Intelligent Decision Making Based on Data Mining Using Differential Evolution Algorithms and Framework for ETL Workflow Management

Business decision-making is not a simple task. There are many reasons for that but one of the main reason might be that data comes from different operational sources of an organization and it is difficult to organize and maintain especially if a huge volume of data is involved. A Data warehouse is helpful in this regard as it can assist in business decision-making by collecting data from different operational sources of the organization. To collect the data from different sources and then loading it into a warehouse is also difficult to manage the data on these sources is not in a consistent format. It is usually a three step process that involves extraction, transformation and loading. The extraction of data from these different sources, then transform it into a consistent format and consequently load it into the warehouse, by using ETL (Extract, transform and load) tools. Nowadays, the majority of ETL tools organize workflow. An ETL workflow can be considered as a group of ETL jobs with dependencies between them. In this research different considerations are discussed which are necessary for the proper management of workflow in context of efficient business decision-making process. The purpose of this research paper is to give a novel idea about the possibility of designing an intelligent decision support system by using the techniques of data mining as well as the differential evolution algorithm of artificial neural networks. Artificial neural networks are being used to enhance the capabilities of the intelligent decision support system. A preexisting differential evolution algorithm with slight modification is being used within the DSS environment. It has been assumed that this merger will lead towards more development and advancement within the concept of DSS.

[1]  Qi Luo,et al.  Advancing Knowledge Discovery and Data Mining , 2008, First International Workshop on Knowledge Discovery and Data Mining (WKDD 2008).

[2]  M. Bialko,et al.  Training of artificial neural networks using differential evolution algorithm , 2008, 2008 Conference on Human System Interactions.

[3]  Bingru Yang,et al.  Intelligent Decision Support System Based on Data Mining: Foreign Trading Case Study , 2007, 2007 IEEE International Conference on Control and Automation.

[4]  Efraim Turban,et al.  Decision support systems and intelligent systems , 1997 .

[5]  Lakshmi S. Iyer,et al.  Knowledge warehouse: an architectural integration of knowledge management, decision support, artificial intelligence and data warehousing , 2002, Decis. Support Syst..

[6]  Panos Vassiliadis,et al.  Deciding the physical implementation of ETL workflows , 2007, DOLAP '07.

[7]  Laurene V. Fausett,et al.  Fundamentals Of Neural Networks , 1994 .

[8]  Stephan Kudyba,et al.  Data Mining and Business Intelligence: A Guide to Productivity , 2001 .

[9]  Carolyn Begg Thomas Connolly,et al.  Database Systems: A Practical Approach To Design, , 2004 .

[10]  Xindong Wu Data mining: artificial intelligence in data analysis , 2004 .

[11]  Padhraic Smyth,et al.  From Data Mining to Knowledge Discovery in Databases , 1996, AI Mag..

[12]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[13]  Timos K. Sellis,et al.  Optimizing ETL processes in data warehouses , 2005, 21st International Conference on Data Engineering (ICDE'05).