Development of Quantum Local Potential Function Networks Based on Quantum Assimilation and Subspace Division

The centers and radii of radial basis functions (RBFs) greatly affect the approximation capability of RBF networks (RBFNs). Traditional statistics-based approaches are widely used, but they may lack adaptivity to different data structures. Quantum clustering (QC), derived from quantum mechanics and the Schrödinger equation, demonstrates excellent capability in finding the structure and conformity toward data distribution. In this paper, a novel neural networks model called quantum local potential function networks (QLPFNs) is proposed. The QLPFN inherits the outstanding properties of QC by constructing the waves and the potential functions, and the level of data concentration can be discovered to obtain the inherent structures of the given data set. The local potential functions form the basic components of the QLPFN structure, which are automatically generated from the subsets of training data following specific subspace division procedures. Therefore, the QLPFN model in fact incorporates the level of data concentration as a computation technique, which is different from the classical RBFN model that exhibits radial symmetry toward specific centers. Some application examples are given in this paper to show the effectiveness of the QLPFN model.

[1]  Junyou Shi,et al.  Lazy Quantum clustering induced radial basis function networks (LQC-RBFN) with effective centers selection and radii determination , 2016, Neurocomputing.

[2]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[3]  Sung-Kwun Oh,et al.  Design of hybrid radial basis function neural networks (HRBFNNs) realized with the aid of hybridization of fuzzy clustering method (FCM) and polynomial neural networks (PNNs) , 2014, Neural Networks.

[4]  Peter W. Shor,et al.  Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1995, SIAM Rev..

[5]  Sung-Suk Kim,et al.  Development of Quantum-Based Adaptive Neuro-Fuzzy Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  David Saad,et al.  Learning and Generalization in Radial Basis Function Networks , 1995, Neural Computation.

[7]  Cheng-Han Tsai,et al.  A novel self-constructing Radial Basis Function Neural-Fuzzy System , 2013, Appl. Soft Comput..

[8]  Qi-Lun Zheng,et al.  Chaotic Time Series Prediction Based on Evolving Recurrent Neural Networks , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[9]  Zonghai Chen,et al.  Quantum robot: structure, algorithms and applications , 2005, Robotica.

[10]  Lov K. Grover.  Quantum Mechanics Helps in Searching for a Needle in a Haystack , 1997, quant-ph/9706033.

[11]  Maria Schuld,et al.  The quest for a Quantum Neural Network , 2014, Quantum Information Processing.

[12]  Michael Defoin-Platel,et al.  Quantum-Inspired Evolutionary Algorithm: A Multimodel EDA , 2009, IEEE Transactions on Evolutionary Computation.

[13]  Dan Ventura,et al.  Quantum Neural Networks , 2000 .

[14]  Sheng Chen.  Nonlinear time series modelling and prediction using Gaussian RBF networks with enhanced clustering and RLS learning , 1995 .

[15]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithm for a class of combinatorial optimization , 2002, IEEE Trans. Evol. Comput..

[16]  Witold Pedrycz,et al.  Conditional fuzzy clustering in the design of radial basis function neural networks , 1998, IEEE Trans. Neural Networks.

[17]  David Horn,et al.  The Method of Quantum Clustering , 2001, NIPS.

[18]  Ren-long Zhang,et al.  A novel fuzzy hybrid quantum artificial immune clustering algorithm based on cloud model , 2014, Eng. Appl. Artif. Intell..

[19]  Madhav J. Nigam,et al.  Applications of quantum inspired computational intelligence: a survey , 2014, Artificial Intelligence Review.

[20]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[21]  Saeed Zolfaghari,et al.  Chaotic time series prediction with residual analysis method using hybrid Elman-NARX neural networks , 2010, Neurocomputing.

[22]  Gexiang Zhang,et al.  Quantum-inspired evolutionary algorithms: a survey and empirical study , 2011, J. Heuristics.

[23]  David S. Broomhead,et al.  Multivariable Functional Interpolation and Adaptive Networks , 1988, Complex Syst..

[24]  Adrian G. Bors,et al.  Nonparametric clustering using quantum mechanics , 2005, IEEE International Conference on Image Processing 2005.

[25]  Daoqiang Zhang,et al.  Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation , 2007, Pattern Recognit..

[26]  Nicolaos B. Karayiannis,et al.  Growing radial basis neural networks: merging supervised and unsupervised learning with network growth techniques , 1997, IEEE Trans. Neural Networks.

[27]  Tzyh Jong Tarn,et al.  Quantum Reinforcement Learning , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Jiann-Horng Lin,et al.  Adaptive fuzzy identification of nonlinear dynamical systems based on quantum mechanics , 2005, IRI -2005 IEEE International Conference on Information Reuse and Integration, Conf, 2005..

[29]  Ignacio Rojas,et al.  A New Clustering Technique for Function Approximation , 2005 .

[30]  Daoyi Dong,et al.  Robust Quantum-Inspired Reinforcement Learning for Robot Navigation , 2012, IEEE/ASME Transactions on Mechatronics.

[31]  Stephen A. Billings,et al.  Generalized multiscale radial basis function networks , 2007, Neural Networks.

[32]  Peter Wittek,et al.  High-performance dynamic quantum clustering on graphics processors , 2013, J. Comput. Phys..

[33]  Laxmidhar Behera,et al.  Visual–Motor Coordination Using a Quantum Clustering Based Neural Control Scheme , 2004, Neural Processing Letters.

[34]  Mengjie Zhang,et al.  Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction , 2012, Neurocomputing.

[35]  Shi-tong Wang,et al.  Quantum Theory: The unified framework for FCM and QC algorithm , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[36]  Michal Linial,et al.  Global Considerations in Hierarchical Clustering Reveal Meaningful Patterns in Data , 2008, PloS one.

[37]  Αλέξανδρος Π. Αλεξανδρίδης,et al.  A fast training algorithm for RBF networks based on subtractive clustering , 2015 .

[38]  Cong Xu,et al.  Multi-elitist immune clonal quantum clustering algorithm , 2013, Neurocomputing.

[39]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[40]  M.N.S. Swamy,et al.  Radial Basis Function Networks , 2014 .

[41]  S..  Nonlinear time series modelling and prediction using Gaussian RBF networks with enhanced clustering and RLS learning , 2004 .

[42]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[43]  David Horn,et al.  Novel Clustering Algorithm for Microarray Expression Data in A Truncated SVD Space , 2003, Bioinform..

[44]  Ho-Jin Choi,et al.  Knowledge extraction and representation using quantum mechanics and intelligent models , 2012, Expert Syst. Appl..

[45]  Adrian G. Bors,et al.  Kernel-based classification using quantum mechanics , 2007, Pattern Recognit..

[46]  D. Lowe,et al.  Adaptive radial basis function nonlinearities, and the problem of generalisation , 1989 .

[47]  Pedro Antonio Gutiérrez,et al.  Generalised Gaussian radial basis function neural networks , 2012, Soft Computing.

[48]  Cheng-Liang Chen,et al.  Hybrid learning algorithm for Gaussian potential function networks , 1993 .

[49]  Zekeriya Uykan,et al.  Analysis of input-output clustering for determining centers of RBFN , 2000, IEEE Trans. Neural Networks Learn. Syst..

[50]  Ajit Narayanan,et al.  Quantum-inspired Neural Networks , 1995 .

[51]  Haralambos Sarimveis,et al.  A new algorithm for online structure and parameter adaptation of RBF networks , 2003, Neural Networks.

[52]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .