Intelligent Data Analysis: Issues and Challenges

Today with the advances of technology, mountainous amounts of data are now available in science, business, industry and many other areas. Evaluation of these collected data may lead to the discovery of trends and patterns hidden within the data that increase the working efficiency and improve the quality of decision making. Of course this advantage comes with a price. It is becoming more and more difficult to gain some valuable information when analysing with these increasing data sets. This paper attempts to discuss a wide range of problems that may appear while analysing the data, and suggests strategies to deal with them. Some of these problems and suggestions are examined with the results of data analysis on a real-life example of risk assessment of level crossing data.

[1]  Nada Lavrac,et al.  Selected techniques for data mining in medicine , 1999, Artif. Intell. Medicine.

[2]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[3]  Karim K. Hirji,et al.  Discovering data mining: from concept to implementation , 1999, SKDD.

[4]  Joachim Diederich,et al.  Inductive knowledge acquisition usingfeedforward neural networks with rule-extractionRichi , 1998 .

[5]  Wei-Min Shen,et al.  Data Preprocessing and Intelligent Data Analysis , 1997, Intell. Data Anal..

[6]  Eric R. Ziegel,et al.  Mastering Data Mining , 2001, Technometrics.

[7]  Xiaohui Liu,et al.  Intelligent data analysis: issues and challenges , 1996, The Knowledge Engineering Review.

[8]  Richi Nayak,et al.  Data mining for web-enabled electronic business applications , 2003 .

[9]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[10]  J. R. Quinlan,et al.  Comparing connectionist and symbolic learning methods , 1994, COLT 1994.

[11]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[12]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[13]  David J. Hand Intelligent Data Analysis: Issues and Opportunities , 1998, Intell. Data Anal..

[14]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[15]  Frank Dignum,et al.  Agent-Mediated Electronic Commerce III: Current Issues in Agent-Based Electronic Commerce Systems , 2001 .

[16]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[17]  Richi Nayak,et al.  GYAN: A methodology for rule extraction from artificial neural networks , 1999 .