Symbolic Rule Extraction From Neural Networks: An Application to Identifying Organizations Adopting IT

Interest in the application of neural networks as tools for decision support has been growing in recent years. A major drawback often associated with neural networks is the difficulty in understanding the knowledge represented by a trained network. This paper describes an approach that can extract symbolic rules from neural networks. We illustrate how the approach successfully extracted rules from a data set collected from a survey of the service sectors in the United Kingdom. The extracted rules were then used to distinguish between organizations using computers from those that do not. The classification scheme based on these rules was used to identify specific segments of a market for promoting adoption of information technology. The extracted rules are not only concise but also outperform discriminant analysis in terms of predictive accuracy.

[1]  Hongjun Lu,et al.  Effective Data Mining Using Neural Networks , 1996, IEEE Trans. Knowl. Data Eng..

[2]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[3]  Huan Liu,et al.  Symbolic Representation of Neural Networks , 1996, Computer.

[4]  Pi-Sheng Deng,et al.  Experimentation with a back-propagation neural network: An application to planning end user system development , 1993, Inf. Manag..

[5]  Michael J. Shaw,et al.  A classification approach using multi-layered neural networks , 1994, Decis. Support Syst..

[6]  Arjen van Ooyen,et al.  Improving the convergence of the back-propagation algorithm , 1992, Neural Networks.

[7]  Rudy Setiono,et al.  A Penalty-Function Approach for Pruning Feedforward Neural Networks , 1997, Neural Computation.

[8]  Ehud D. Karnin,et al.  A simple procedure for pruning back-propagation trained neural networks , 1990, IEEE Trans. Neural Networks.

[9]  George D. Magoulas,et al.  Improving the Convergence of the Backpropagation Algorithm Using Learning Rate Adaptation Methods , 1999, Neural Computation.

[10]  E. Mine Cinar,et al.  Neural Networks: A New Tool for Predicting Thrift Failures , 1992 .

[11]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[12]  Soumitra Dutta,et al.  Decision support in non-conservative domains: Generalization with neural networks , 1992, Decis. Support Syst..

[13]  Murray Smith,et al.  Neural Networks for Statistical Modeling , 1993 .

[14]  Carol E. Brown,et al.  Artificial neural networks applied to ratio analysis in the analytical review process , 1993 .

[15]  Hans Henrik Thodberg,et al.  Improving Generalization of Neural Networks Through Pruning , 1991, Int. J. Neural Syst..

[16]  Berndt Müller,et al.  Neural networks: an introduction , 1990 .

[17]  Chee-Sing Yap,et al.  Distinguishing characteristics of organizations using computers , 1990, Inf. Manag..

[18]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[19]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[20]  A. R. Venkatachalam,et al.  A neural network approach to forecasting model selection , 1995, Inf. Manag..

[21]  Melody Y. Kiang,et al.  Managerial Applications of Neural Networks: The Case of Bank Failure Predictions , 1992 .

[22]  Huan Liu,et al.  X2R: a fast rule generator , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.