Behavior learning of a memristor-based chaotic circuit by extreme learning machines

As the behavior of a chaotic Chua's circuit is nonstationary and inherently noisy, it is regarded as one of the most challenging applications. One of the fundamental problems in the prediction of the behavior of a chaotic Chua's circuit is to model the circuit with high accuracy. The current paper presents a novel method based on multiple extreme learning machine (ELM) models to learn the chaotic behavior of the four elements canonical Chua's circuit containing a memristor instead of a nonlinear resistor only by using the state variables as the input. In the proposed method four ELM models are used to estimate the state variables of the circuit. ELMs arerst trained by using the data spoilt by noise obtained from MATLAB models of a memristor and Chua's circuit. A multistep-ahead prediction is then carried out by the trained ELMs in the autonomous mode. All attractors of the circuit arenally reconstructed by the outputs of the models. The results of the four ELMs are compared to those of multiple linear regressors (MLRs) and support vector machines (SVMs) in terms of scatter plots, power spectral density, training time, prediction time, and some statistical error measures. Extensive numerical simulations results show that the proposed system exhibits a highly accurate multistep iterated prediction consisting of 1104 steps of the chaotic circuit. Consequently, the proposed model can be considered a promising and powerful tool for modeling and predicting the behavior of Chua's circuit with excellent performance, reducing training time, testing time, and practically realization probability.

[1]  Basabi Chakraborty,et al.  A novel approach for estimation of optimal embedding parameters of nonlinear time series by structural learning of neural network , 2007, Neurocomputing.

[2]  Mustafa Türk,et al.  Recognition of multi-scroll chaotic attractors using wavelet-based neural network and performance comparison of wavelet families , 2010, Expert Syst. Appl..

[3]  F. Pan,et al.  A Hybrid Time-Series Forecasting Model Using Extreme Learning Machines , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[4]  Yunqian Ma,et al.  Practical selection of SVM parameters and noise estimation for SVM regression , 2004, Neural Networks.

[5]  Klaus Witrisal,et al.  Memristor-based stored-reference receiver - the UWB solution? , 2009 .

[6]  Saeed Zolfaghari,et al.  Chaotic time series prediction with residual analysis method using hybrid Elman-NARX neural networks , 2010, Neurocomputing.

[7]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[8]  J. Suykens,et al.  Recurrent least squares support vector machines , 2000 .

[9]  William D. Jemison,et al.  An automatic gain control circuit with TiO2 memristor variable gain amplifier , 2012, Proceedings of the 8th IEEE International NEWCAS Conference 2010.

[10]  Bharathwaj Muthuswamy,et al.  Memristor-Based Chaotic Circuits , 2009 .

[11]  Idongesit Effiong Ebong,et al.  Training Memristors for Reliable Computing. , 2013 .

[12]  D. Brillinger.  Time series - data analysis and theory , 1981, Classics in applied mathematics.

[13]  Henry Leung,et al.  Prediction of noisy chaotic time series using an optimal radial basis function neural network , 2001, IEEE Trans. Neural Networks.

[14]  Zhigang Zeng,et al.  Exponential synchronization of memristor-based recurrent neural networks with time delays , 2011, Neurocomputing.

[15]  Wei Wang,et al.  FPGA based on integration of memristors and CMOS devices , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[16]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[17]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[18]  J. Suykens,et al.  Learning a simple recurrent neural state space model to behave like Chua's double scroll , 1995 .

[19]  Massimiliano Di Ventra,et al.  Practical Approach to Programmable Analog Circuits With Memristors , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[20]  Jason Cong,et al.  mrFPGA: A novel FPGA architecture with memristor-based reconfiguration , 2011, 2011 IEEE/ACM International Symposium on Nanoscale Architectures.

[21]  Davut Hanbay,et al.  An expert system based on wavelet decomposition and neural network for modeling Chua's circuit , 2008, Expert Syst. Appl..

[22]  Warren Robinett,et al.  Memristor-CMOS hybrid integrated circuits for reconfigurable logic. , 2009, Nano letters.

[23]  C. Toumazou,et al.  A Versatile Memristor Model With Nonlinear Dopant Kinetics , 2011, IEEE Transactions on Electron Devices.

[24]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[25]  Leon O. Chua,et al.  MEMRISTOR CELLULAR AUTOMATA AND MEMRISTOR DISCRETE-TIME CELLULAR NEURAL NETWORKS , 2009 .

[26]  Farnood Merrikh-Bayat,et al.  Mixed analog-digital crossbar-based hardware implementation of sign–sign LMS adaptive filter , 2011 .

[27]  Jian-Cheng Sun,et al.  Chaotic behavior learning of Chua's circuit , 2012 .

[28]  Ravi Sankar,et al.  Time Series Prediction Using Support Vector Machines: A Survey , 2009, IEEE Computational Intelligence Magazine.

[29]  Hongxia Wang,et al.  Efficient Image Encryption Using a Chaos-based PWL Memristor , 2010 .

[30]  Khaled N. Salama,et al.  Generalized model for Memristor-based Wien family oscillators , 2011, Microelectron. J..

[31]  Leon O. Chua,et al.  Simplest Chaotic Circuit , 2010, Int. J. Bifurc. Chaos.

[32]  Paolo Gastaldo,et al.  Efficient Digital Implementation of Extreme Learning Machines for Classification , 2012, IEEE Transactions on Circuits and Systems II: Express Briefs.

[33]  Chee Kheong Siew,et al.  Real-time learning capability of neural networks , 2006, IEEE Trans. Neural Networks.

[34]  Stephen J. Wolf,et al.  The elusive memristor: properties of basic electrical circuits , 2008, 0807.3994.

[35]  R. Williams,et al.  Nano/CMOS architectures using a field-programmable nanowire interconnect , 2007 .

[36]  György Cserey,et al.  Macromodeling of the Memristor in SPICE , 2010, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[37]  G. Subramanyam,et al.  A Memristor Device Model , 2011, IEEE Electron Device Letters.

[38]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[39]  L. Chua.  Memristor-The missing circuit element , 1971 .