Approximate reasoning to learn classification rules

In this paper, we propose an original use of approximate reasoning not only as a mode of inference but also as a means to refine a learning process. This work is done within the framework of the supervised learning method SUCRAGE which is based on automatic generation of classification rules. Production rules whose conclusions are accompanied by belief degrees, are obtained by supervised learning from a training set. These rules are then exploited by a basic inference engine: it fires only the rules with which the new observation to classify matches exactly. To introduce more flexibility, this engine was extended to an approximate inference which allows to fire rules not too far from the new observation. In this paper, we propose to use approximate reasoning to generate new rules with widened premises: thus imprecision of the observations are taken into account and problems due to the discretization of continuous attributes are eased. The objective is then to exploit the new base of rules by a basic inference engine, easier to interpret. The proposed method was implemented and experimental tests were carried out.

[1]  Thomas Whalen Mixed-initiative, goal-directed dialog in a fuzzy knowledge based consultant system , 1988 .

[2]  Gianni Vernazza Image classification by extended certainty factors , 1993, Pattern Recognit..

[3]  Herman Akdag,et al.  Apprentissage supervisé et raisonnement approximatif, l'hypothèse des imperfections , 2001, Rev. d'Intelligence Artif..

[4]  Ronald R. Yager Approximate reasoning and conflict resolution , 2000, Int. J. Approx. Reason..

[5]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[6]  Jacek M. Zurada,et al.  Computational intelligence methods for rule-based data understanding , 2004, Proceedings of the IEEE.

[7]  Zhi-Hua Zhou,et al.  Three perspectives of data mining , 2003, Artif. Intell..

[8]  Amel Borgi Ben Bouzid Apprentissage supervise par generation de regles : le systeme sucrage , 1999 .

[9]  Herman Akdag,et al.  Knowledge Based Supervised Fuzzy-Classification: An Application to Image Processing , 2004, Annals of Mathematics and Artificial Intelligence.

[10]  Lotfi A. Zadeh,et al.  A Theory of Approximate Reasoning , 1979 .

[11]  Daniel Pacholczyk,et al.  Towards a Symbolic Interpretation of Approximate Reasoning , 2003, RSKD.

[12]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[13]  Alan Bundy,et al.  Constructing Induction Rules for Deductive Synthesis Proofs , 2006, CLASE.

[14]  Glenn Shafer,et al.  Readings in Uncertain Reasoning , 1990 .

[15]  Hisao Ishibuchi,et al.  Selecting fuzzy rules with forgetting in fuzzy classification systems , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[16]  Enrique H. Ruspini,et al.  On the semantics of fuzzy logic , 1991, Int. J. Approx. Reason..