Case-based reasoning and neural network based expert system for personalization

Abstract We suggest a hybrid expert system of case-based reasoning (CBR) and neural network (NN) for symbolic domain. In previous research, we proposed a hybrid system of memory and neural network based learning. In the system, the feature weights are extracted from the trained neural network, and used to improve retrieval accuracy of case-based reasoning. However, this system has worked best in domains in which all features had numeric values. When the feature values are symbolic, nearest neighbor methods typically resort to much simpler metrics, such as counting the features that match. A more sophisticated treatment of the feature space is required in symbolic domains. We propose feature-weighted CBR with neural network, which uses value difference metric (VDM) as distance function for symbolic features. In our system, the feature weight set calculated from the trained neural network plays the core role in connecting both the learning strategies. Moreover, the explanation on prediction can be given by presenting the most similar cases from the case base. To validate our system, illustrative experimental results are presented. We use datasets from the UCI machine learning archive for experiments. Finally, we present an application with a personalized counseling system for cosmetic industry whose questionnaires have symbolic features. Feature-weighted CBR with neural network predicts the five elements, which show customers’ character and physical constitution, with relatively high accuracy and expert system for personalization recommends personalized make-up style, color, life style and products.

[1]  Robert Tibshirani,et al.  Discriminant Adaptive Nearest Neighbor Classification , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Tony R. Martinez,et al.  Improved Heterogeneous Distance Functions , 1996, J. Artif. Intell. Res..

[3]  Kai Ming Ting,et al.  Discretization of Continuous-Valued Attributes and Instance-Based Learning , 1994 .

[4]  Sang-Chan Park,et al.  A hybrid approach of neural network and memory-based learning to data mining , 2000, IEEE Trans. Neural Networks Learn. Syst..

[5]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.

[6]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[7]  S. Salzberg,et al.  A weighted nearest neighbor algorithm for learning with symbolic features , 2004, Machine Learning.

[8]  David L. Waltz,et al.  Toward memory-based reasoning , 1986, CACM.

[9]  David W. Aha,et al.  A Review and Empirical Evaluation of Feature Weighting Methods for a Class of Lazy Learning Algorithms , 1997, Artificial Intelligence Review.

[10]  David W. Aha,et al.  Weighting Features , 1995, ICCBR.

[11]  B. E. Segee,et al.  Fault tolerance of pruned multilayer networks , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.