Dimensionality Reduction for Sensory Datasets Based on Master-slave Synchronization of Lorenz System

In this study, we propose a novel method for reducing the attributes of sensory datasets using Master–Slave Synchronization of chaotic Lorenz Systems (DPSMS). As part of the performance testing, three benchmark datasets and one Electronic Nose (EN) sensory dataset with 3 to 13 attributes were presented to our algorithm to be projected into two attributes. The DPSMS-processed datasets were then used as input vector to four artificial intelligence classifiers, namely Feed-Forward Artificial Neural Networks (FFANN), Multilayer Perceptron (MLP), Decision Tree (DT) and K-Nearest Neighbor (KNN). The performance of the classifiers was then evaluated using the original and reduced datasets. Classification rate of 94.5%, 89%, 94.5% and 82% were achieved when reduced Fishers iris, crab gender, breast cancer and electronic nose test datasets were presented to the above classifiers.

[1]  Pedro Larrañaga,et al.  A review of feature selection techniques in bioinformatics , 2007, Bioinform..

[2]  Colin Sparrow,et al.  The Lorenz equations , 1982 .

[3]  E. Atlee Jackson,et al.  An open-plus-closed-loop (OPCL) control of complex dynamic systems , 1995 .

[4]  Dimitris K. Tasoulis,et al.  Unsupervised Clustering Using Fractal Dimension , 2006, Int. J. Bifurc. Chaos.

[5]  Andrew R. Jamieson,et al.  Exploring nonlinear feature space dimension reduction and data representation in breast Cadx with Laplacian eigenmaps and t-SNE. , 2009, Medical physics.

[6]  Hyunsoo Kim,et al.  Multiclass classifiers based on dimension reduction with generalized LDA , 2007, Pattern Recognit..

[7]  Paul Scheunders,et al.  Non-linear dimensionality reduction techniques for unsupervised feature extraction , 1998, Pattern Recognit. Lett..

[8]  Kari Torkkola,et al.  Feature Extraction by Non-Parametric Mutual Information Maximization , 2003, J. Mach. Learn. Res..

[9]  C. Sparrow.  The Lorenz Equations: Bifurcations, Chaos, and Strange Attractors , 1982 .

[10]  Sören Anderson.  On optimal dimension reduction for sensor array signal processing , 1993, Signal Process..

[11]  Evor L. Hines,et al.  Classification of Ear, Nose, and Throat Bacteria Using a Neural-Network-Based Electronic Nose , 2004 .

[12]  P. K. Roy,et al.  Design of coupling for synchronization of chaotic oscillators. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  O. Rössler.  An equation for continuous chaos , 1976 .

[14]  F. Chiaromonte,et al.  Dimension reduction strategies for analyzing global gene expression data with a response. , 2002, Mathematical biosciences.

[15]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[16]  P. McClintock.  Synchronization:a universal concept in nonlinear science , 2003 .

[17]  Oscar De Feo,et al.  Tuning Chaos Synchronization and Anti-Synchronization for Applications in Temporal Pattern Recognition , 2005, Int. J. Bifurc. Chaos.

[18]  Yanqiu Che,et al.  Chaos control and synchronization of two neurons exposed to ELF external electric field , 2007 .

[19]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[20]  Yoshihiko Hamamoto,et al.  Evaluation of the branch and bound algorithm for feature selection , 1990, Pattern Recognit. Lett..

[21]  Guanrong Chen,et al.  Analysis of a new chaotic system , 2005 .

[22]  Jürgen Kurths,et al.  Synchronization - A Universal Concept in Nonlinear Sciences , 2001, Cambridge Nonlinear Science Series.

[23]  Robin J. Evans,et al.  Control of chaos: Methods and applications in engineering, , 2005, Annu. Rev. Control..

[24]  Edward Ott,et al.  Controlling chaos , 2006, Scholarpedia.

[25]  Qinghua Hu,et al.  Information-preserving hybrid data reduction based on fuzzy-rough techniques , 2006, Pattern Recognit. Lett..

[26]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[27]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[28]  Bruno Cessac,et al.  A View of Neural Networks as Dynamical Systems , 2009, Int. J. Bifurc. Chaos.

[29]  Ioan Grosu,et al.  Collection of mutually synchronized chaotic systems , 2006 .

[30]  Qiang Jia,et al.  Hyperchaos generated from the Lorenz chaotic system and its control , 2007 .

[31]  M. A. Faruqi,et al.  Modelling and control of chaotic processes through their Bifurcation Diagrams generated with the help of Recurrent Neural Network models: Part 1—simulation studies , 2006 .

[32]  I. Grosu,et al.  Collection of master–slave synchronized chaotic systems , 2004 .