A Computationally Inexpensive Classifier Merging Cellular Automata and MCP-Neurons

There is an increasing need for personalised and context-aware services in our everyday lives and we rely on mobile and wearable devices to provide such services. Context-aware applications often make use of machine-learning algorithms, but many of these are too complex or resource-consuming for implementation on some devices that are common in pervasive and mobile computing. The algorithm presented in this paper, named CAMP, has been developed to obtain a classifier that is suitable for resource-constrained devices such as FPGA:s, ASIC:s or microcontrollers. The algorithm uses a combination of the McCulloch-Pitts neuron model and Cellular Automata in order to produce a computationally inexpensive classifier with a small memory footprint. The algorithm consists of a sparse binary neural network where neurons are updated using a Cellular Automata rule as the activation function. Output of the classifier is depending on the selected rule and the interconnections between the neurons. Since solving the input-output mapping mathematically can not be performed using traditional optimization algorithms, the classifier is trained using a genetic algorithm. The results of the study show that CAMP, despite its minimalistic structure, has a comparable accuracy to that of more advanced algorithms for the datasets tested containing few classes, while performing poorly on the datasets with a higher amount of classes. CAMP could thus be a viable choice for solving classification problems in environments with extreme demands on low resource consumption.

[1]  Biplab K. Sikdar,et al.  Design and characterization of cellular automata based associative memory for pattern recognition , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  Dennis W. Duke,et al.  Proceedings of the Conference on Measuring Chaos in the Human Brain : April 3-5, 1991, at the Supercomputer Computations Research Institute, Florida State University, Tallahassee, FL , 1991 .

[3]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[4]  Matthew Cook,et al.  Universality in Elementary Cellular Automata , 2004, Complex Syst..

[5]  D. Smith,et al.  A random walk in Hamming space , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[6]  Zoltán Nagy,et al.  Simulation of 2D inviscid, adiabatic, compressible flows on emulated digital CNN-UM , 2009 .

[7]  Verónica Bolón-Canedo,et al.  A review of feature selection methods on synthetic data , 2013, Knowledge and Information Systems.

[8]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[9]  Edward M. Reingold,et al.  Efficient generation of the binary reflected gray code and its applications , 1976, CACM.

[10]  K. Aihara,et al.  Forced Oscillations and Routes to Chaos in the Hodgkin-Huxley Axons and Squid Giant Axons , 1987 .

[11]  Stephen R. Marsland,et al.  A tale of two filters-on-line novelty detection , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[12]  Alfredo Vellido,et al.  Neural networks in business: a survey of applications (1992–1998) , 1999 .

[13]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[14]  Palash Sarkar,et al.  A brief history of cellular automata , 2000, CSUR.

[15]  Parimal Pal Chaudhuri,et al.  Cellular Automata Machine for Pattern Recognition , 2002, ACRI.

[16]  Tamás Roska,et al.  Statistical physics on cellular neural network computers , 2008 .

[17]  Zhenzhen Xie A non-linear approximation of the sigmoid function based on FPGA , 2012 .

[18]  B.M. Wilamowski,et al.  A Neural Network Implementation on an Inexpensive Eight Bit Microcontroller , 2008, 2008 International Conference on Intelligent Engineering Systems.

[19]  Dennis W. Duke,et al.  Measuring Chaos in the Human Brain: Proceedings of the Conference , 1991 .

[20]  K. Aihara,et al.  12. Chaotic oscillations and bifurcations in squid giant axons , 1986 .

[21]  Santanu Chattopadhyay,et al.  Highly regular, modular, and cascadable design of cellular automata-based pattern classifier , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[22]  Burton Voorhees,et al.  Additive Cellular Automata , 2009, Encyclopedia of Complexity and Systems Science.

[23]  Enis Günay,et al.  Efficient edge detection in digital images using a cellular neural network optimized by differential evolution algorithm , 2009, Expert Syst. Appl..

[24]  Kazuyuki Aihara,et al.  Associative Dynamics in a Chaotic Neural Network , 1997, Neural Networks.