Technical efficiency-based selection of learning cases to improve forecasting accuracy of neural networks under monotonicity assumption

In this paper, we show that when an artificial neural network (ANN) model is used for learning monotonic forecasting functions, it may be useful to screen training data so the screened examples approximately satisfy the monotonicity property. We show how a technical efficiency-based ranking, using the data envelopment analysis (DEA) model, and a predetermined monotonicity property can be identified. Using a health care forecasting problem, the monotonicity assumption, and a predetermined threshold efficiency level, we use DEA to split training data into two mutually exclusive, "efficient" and "inefficient", training data subsets. We compare the performance of the ANN by using the "efficient" and "inefficient" training data subsets. Our results indicate that the predictive performance of an ANN that is trained on the "efficient" training data subset is higher than the predictive performance of an ANN that is trained on the "inefficient" training data subset.

[1]  Shouhong Wang,et al.  An insight into the standard back-propagation neural network model for regression analysis , 1998 .

[2]  A. Charnes,et al.  Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis , 1984 .

[3]  Albert Nigrin,et al.  Neural networks for pattern recognition , 1993 .

[4]  Michael Z. F. Li.  Pricing non-storable perishable goods by using a purchase restriction with an application to airline fare pricing , 2001, Eur. J. Oper. Res..

[5]  Parag C. Pendharkar,et al.  A computational study on the performance of artificial neural networks under changing structural design and data distribution , 2002, Eur. J. Oper. Res..

[6]  M. Caudill.  Using neural nets: representing knowledge, part 1 , 1989 .

[7]  Michael Lee Steib,et al.  Expert systems for guiding backpropagation training of layered perceptrons , 1991 .

[8]  Bharat A. Jain,et al.  Artificial Neural Network Models for Pricing Initial Public Offerings , 1995 .

[9]  G. David Garson,et al.  Interpreting neural-network connection weights , 1991 .

[10]  Robert J. Schalkoff,et al.  Artificial neural networks , 1997 .

[11]  Jae Kyu Lee,et al.  Quasi-optimal case-selective neural network model for software effort estimation , 2001, Expert Syst. Appl..

[12]  R. Banker,et al.  NONPARAMETRIC ANALYSIS OF TECHNICAL AND ALLOCATIVE EFFICIENCIES IN PRODUCTION , 1988 .

[13]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[14]  Siddhartha Bhattacharyya,et al.  Inductive, Evolutionary, and Neural Computing Techniques for Discrimination: A Comparative Study* , 1998 .

[15]  Yann LeCun,et al.  Improving the convergence of back-propagation learning with second-order methods , 1989 .

[16]  Parag C. Pendharkar,et al.  An empirical study of design and testing of hybrid evolutionary–neural approach for classification , 2001 .

[17]  Abraham Charnes,et al.  Measuring the efficiency of decision making units , 1978 .

[18]  Michael Y. Hu,et al.  Two-Group Classification Using Neural Networks* , 1993 .

[19]  Tommy W. S. Chow,et al.  Least third-order cumulant method with adaptive regularization parameter selection for neural networks , 2001, Artif. Intell..

[20]  Maureen Caudill,et al.  Neural network training tips and techniques , 1991 .

[21]  B. Curry,et al.  Neural networks: a need for caution , 1997 .

[22]  Efraim Turban,et al.  Integrating Expert Systems and Neural Computing for Decision Support , 1994, HICSS.

[23]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  Raymond J. Mooney,et al.  Symbolic and Neural Learning Algorithms: An Experimental Comparison , 1991, Machine Learning.

[25]  Shouhong Wang.  The unpredictability of standard back propagation neural networks in classification applications , 1995 .

[26]  Robert J. Kauffman,et al.  Comparing the Modeling Performance of Regression and Neural Networks as Data Quality Varies: A Business Value Approach , 1993, J. Manag. Inf. Syst..

[27]  Pascal Neveu,et al.  Bayesian nonlinear model selection and neural networks: a conjugate prior approach , 2000, IEEE Trans. Neural Networks Learn. Syst..

[28]  Christian Kanzow,et al.  A continuation method for (strongly) monotone variational inequalities , 1998, Math. Program..

[29]  Alan F. Murray,et al.  IEEE International Conference on Neural Networks , 1997 .

[30]  Selwyn Piramuthu,et al.  Using Feature Construction to Improve the Performance of Neural Networks , 1998 .

[31]  Marvin D. Troutt,et al.  The potential use of DEA for credit applicant acceptance systems , 1996, Comput. Oper. Res..

[32]  Larry R. Medsker,et al.  Hybrid Intelligent Systems , 1995, Springer US.

[33]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[34]  Li-Min Fu,et al.  Knowledge-based connectionism for revising domain theories , 1993, IEEE Trans. Syst. Man Cybern..

[35]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[36]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[37]  Yakar Kannai.  A characterization of monotone individual demand functions , 1989 .

[38]  David M. Skapura,et al.  Neural networks - algorithms, applications, and programming techniques , 1991, Computation and neural systems series.

[39]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[40]  Antreas D. Athanassopoulos,et al.  A Comparison of Data Envelopment Analysis and Artificial Neural Networks as Tools for Assessing the Efficiency of Decision Making Units , 1996 .

[41]  Shouhong Wang,et al.  An Adaptive Approach to Market Development Forecasting , 1999, Neural Computing & Applications.

[42]  J. Quah.  The Monotonicity of Individual and Market Demand , 2000 .

[43]  W. A. Wright,et al.  Bayesian approach to neural-network modeling with input uncertainty , 1999, IEEE Trans. Neural Networks.