A cascade of linguistic CMAC neural networks for decision making

A CMAC (Cerebellar Model Articulation Controller) is a kind of feed-forward neural networks (FFNNs), but the feature of fast learning makes it different from classic FFNNs. A CMAC has a single linear trainable layer, but due to the input information is distributed in a hypercube grid, it is suitable for modeling any non-linear relationship. It has been proved that a linguistic CMAC (LCMAC) based on the Label Semantics can represent the rules that a linguistic decision tree (LDT) does when they are used to map the relationship between inputs and outputs. In order to overcome the `curse of dimensionality' of an LCMAC in memory use for multi-attribute decision making, a cascade of LCMACs is proposed, and the linguistic interpretation of a cascade of LCMACs is investigated to break the convention of neural networks as a black box. An algorithm for training a cascade of LCMACs is developed. The proposed cascade of LCMACs has a great reduction in the use of memory units, and as a decision maker, it can achieve better performance in accuracy and F1-score than the cascade of LDTs does for those data sets with non-linear relations between inputs and outputs.

[1]  Chih-Ming Chen,et al.  A self-organizing HCMAC neural-network classifier , 2003, IEEE Trans. Neural Networks.

[2]  Jonathan Lawry.  Modelling and Reasoning with Vague Concepts , 2006, Studies in Computational Intelligence.

[3]  Stan Szpakowicz,et al.  Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation , 2006, Australian Conference on Artificial Intelligence.

[4]  Jonathan Lawry,et al.  Multi-Attribute Decision Making Based on Label Semantics , 2008, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[5]  James S. Albus,et al.  Data Storage in the Cerebellar Model Articulation Controller (CMAC) , 1975 .

[6]  Ingoo Han,et al.  The discovery of experts' decision rules from qualitative bankruptcy data using genetic algorithms , 2003, Expert Syst. Appl..

[7]  T. Martin McGinnity,et al.  Linguistic Decision Making for Robot Route Learning , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[8]  D. F. Kerridge,et al.  The Logic of Decision , 1967 .

[9]  Filson H. Glanz,et al.  Application of a General Learning Algorithm to the Control of Robotic Manipulators , 1987 .

[10]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[11]  Y. Takefuji,et al.  Design of parallel distributed Cauchy machines , 1989, International 1989 Joint Conference on Neural Networks.

[12]  Jonathan Lawry,et al.  A linguistic CMAC equivalent to a Linguistic Decision Tree for classification , 2009, 2009 International Joint Conference on Neural Networks.

[13]  Morris W. Hirsch,et al.  Convergent activation dynamics in continuous time networks , 1989, Neural Networks.

[14]  Jonathan Lawry,et al.  Decision tree learning with fuzzy labels , 2005, Inf. Sci..

[15]  J. Lawry,et al.  Optimal Cascaded Hierarchies of Linguistic Decision Trees for Decision Making , 2008 .

[16]  Hsin-Chia Fu,et al.  Cascade-CMAC neural network applications on the color scanner to printer calibration , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[17]  T. Miranda Lakshmi,et al.  An Analysis on Qualitative Bankruptcy Prediction Rules using Ant-Miner , 2014 .