Recurrent neural networks for automatic clustering of multispectral satellite images

In the present work we applied a recently developed procedure for multidimensional data clustering to multispectral satellite images. The core of our approach lays in projection of the multidimensional image to a two dimensional space. For this purpose we used extensively investigated family of recurrent artificial neural networks (RNN) called “Echo state network” (ESN). ESN incorporates a randomly generated recurrent reservoir with sigmoid nonlinearities of neurons outputs. The procedure called Intrinsic Plasticity (IP) that is aimed at reservoir output entropy maximization was applied for adapting of reservoir steady states to the multidimensional input data. Next we consider all possible combinations between steady states of each two neurons in the reservoir as two-dimensional projections of the original multidimensional data. These low dimensional projections were subjected to subtractive clustering in order to determine number and position of data clusters. Two approaches to choose a proper projection among the all possible combinations between neurons were investigated. The first one is based on the calculation of two-dimensional density distributions of each projection, determination of number of their local maxima and choice of the projections with biggest number of these maxima. The second one applies clustering to all projections and chooses those with maximum number of clusters. Multispectral data from Landsat 7 Enhanced Thematic Mapper Plus (ETM+) instrument are used in this work. The obtained number and position of clusters of a multi-spectral image of a mountain region in Bulgaria is compared with the regional landscape classification.

[1]  Dimitar Filev,et al.  Generation of Fuzzy Rules by Mountain Clustering , 1994, J. Intell. Fuzzy Syst..

[2]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[3]  Jochen J. Steil,et al.  Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning , 2007, Neural Networks.

[4]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[5]  Petia D. Koprinkova-Hristova,et al.  Echo State Networks for Multi-dimensional Data Clustering , 2012, ICANN.

[6]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[7]  Petia D. Koprinkova-Hristova,et al.  ESN Intrinsic Plasticity versus Reservoir Stability , 2011, ICANN.

[8]  Herbert Jaeger,et al.  Reservoir computing approaches to recurrent neural network training , 2009, Comput. Sci. Rev..

[9]  Takashi Ikegami,et al.  A Reservoir Computing approach to Image Classification using Coupled Echo State and BackPropagation Neural Networks , 2011 .

[10]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[11]  Petia Koprinkova-Hristova,et al.  Clustering of spectral images using Echo state networks , 2013, 2013 IEEE INISTA.

[12]  Jochen J. Steil,et al.  Improving reservoirs using intrinsic plasticity , 2008, Neurocomputing.

[13]  José Carlos Príncipe,et al.  Analysis and Design of Echo State Networks , 2007, Neural Computation.

[14]  Nishu Sharma,et al.  A Comparative Study Of Data Clustering Techniques , 2013 .

[15]  Herbert Jaeger,et al.  A tutorial on training recurrent neural networks , covering BPPT , RTRL , EKF and the " echo state network " approach - Semantic Scholar , 2005 .

[16]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.