Optimization of missing value imputation using Reinforcement Programming

Missing value imputation is a crucial and challenging research topic in data mining because the data in real life are often contains missing value. The incorrect way to handle missing value will lead major problem in data mining processing to produce a new knowledge. One technique to solve Missing value imputation is by using machine learning algorithm. In this paper, we will present a new approach for missing data imputation using Reinforcement Programming to deal with incomplete data by filling the incompleteness data with considering exploration and exploitation of its environment to learn the data pattern. The experimental result demonstrates that Reinforcement Programming runs well and has a great result of SSE of new data with assigned value and shows effectiveness computational time than the other five imputation methods used as benchmark.

[1]  B. Noble,et al.  On certain integrals of Lipschitz-Hankel type involving products of bessel functions , 1955, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[2]  D. Rubin INFERENCE AND MISSING DATA , 1975 .

[3]  Subramani Mani,et al.  Building Bayesian Network Models in Medicine: The MENTOR Experience , 2005, Applied Intelligence.

[4]  Ahmet Arslan,et al.  A NOVEL HYBRID APPROACH TO ESTIMATING MISSING VALUES IN DATABASES USING K-NEAREST NEIGHBORS AND NEURAL NETWORKS , 2012 .

[5]  Harri Niska,et al.  Methods for imputation of missing values in air quality data sets , 2004 .

[6]  Chengqi Zhang,et al.  Semi-parametric optimization for missing data imputation , 2007, Applied Intelligence.

[7]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[8]  G. H. Raisoni,et al.  Ijca Special Issue on " Evolutionary Computation for Optimization Techniques " Ecot, 2010 Multiple Imputation of Missing Data with Genetic Algorithm Based Techniques , 2022 .

[9]  Peter L. Hammer,et al.  A new imputation method for incomplete binary data , 2011, ISAIM.

[10]  Jean-Frangois Beaumont ON REGRESSION IMPUTATION IN THE PRESENCE OF NONIGNORABLE NONRESPONSE , 2002 .

[11]  Esther-Lydia Silva-Ramírez,et al.  Missing value imputation on missing completely at random data using multilayer perceptrons , 2011, Neural Networks.

[12]  Ida Scheel,et al.  The influence of missing value imputation on detection of differentially expressed genes from microarray data , 2005, Bioinform..

[13]  Panos Liatsis,et al.  A robust missing value imputation method for noisy data , 2010, Applied Intelligence.

[14]  Xiaofeng Zhu,et al.  Missing data imputation by utilizing information within incomplete instances , 2011, J. Syst. Softw..

[15]  Tshilidzi Marwala,et al.  A dynamic programming approach to missing data estimation using neural networks , 2013, Inf. Sci..

[16]  Tshilidzi Marwala,et al.  Neural Network Based Techniques for Estimating Missing Data in Databases , 2005 .

[17]  Estevam R. Hruschka,et al.  Bayesian networks for imputation in classification problems , 2007, Journal of Intelligent Information Systems.

[18]  Dimitri P. Solomatine,et al.  Application of adaptive fuzzy rule-based models for reconstruction of missing precipitation events , 2000 .

[19]  Carol M Musil,et al.  A Comparison of Imputation Techniques for Handling Missing Data , 2002, Western journal of nursing research.