Data mining performance on perturbed databases: important influences on classification accuracy

Data perturbation via the Generalised Additive Data Perturbation (GADP) method has been shown to be an effective technique for protecting disclosure of confidential attributes in databases. GADP is a viable internal security tool that preserves the statistical relationships in a database while hiding confidential data. Unfortunately, the potential impact of GADP on the ability of data mining tools to discover knowledge in a perturbed database has not been extensively studied. This study fills this gap with a comprehensive investigation of the impact of various factors surrounding databases, data security and data mining. Results support the notion that data perturbation techniques may reduce the ability of data mining tools to accurately find knowledge, and that there are other factors that also influence tool performance. These include the underlying structure of the knowledge to be discovered, the relationship of the tool to this so-called knowledge structure, the degree of noise in the knowledge, and the relationship of the confidential attributes to the knowledge.

[1]  Namsik Chang,et al.  Dynamics of Modeling in Data Mining: Interpretive Approach to Bankruptcy Prediction , 1999, J. Manag. Inf. Syst..

[2]  Wei-Yin Loh,et al.  A Comparison of Prediction Accuracy, Complexity, and Training Time of Thirty-Three Old and New Classification Algorithms , 2000, Machine Learning.

[3]  Guido Bologna,et al.  Lessons from Past, Current Issues, and Future Research Directions in Extracting the Knowledge Embedded in Artificial Neural Networks , 1998, Hybrid Neural Systems.

[4]  Sholom M. Weiss,et al.  Computer Systems That Learn , 1990 .

[5]  Rathindra Sarathy,et al.  A General Additive Data Perturbation Method for Database Security , 1999 .

[6]  Renpu Li,et al.  Mining classification rules using rough sets and neural networks , 2004, Eur. J. Oper. Res..

[7]  J. R. Quinlan,et al.  Comparing connectionist and symbolic learning methods , 1994, COLT 1994.

[8]  Simon Parsons,et al.  Principles of Data Mining by David J. Hand, Heikki Mannila and Padhraic Smyth, MIT Press, 546 pp., £34.50, ISBN 0-262-08290-X , 2004, The Knowledge Engineering Review.

[9]  Heikki Mannila,et al.  Principles of Data Mining , 2001, Undergraduate Topics in Computer Science.

[10]  Paul D. Scott,et al.  Evaluating data mining procedures: techniques for generating artificial data sets , 1999, Inf. Softw. Technol..

[11]  Balaji Padmanabhan,et al.  On the Use of Optimization for Data Mining: Theoretical Interactions and eCRM Opportunities , 2003, Manag. Sci..