Visualization of fuzzy clusters by fuzzy Sammon mapping projection: application to the analysis of phase space trajectories

Since in practical data mining problems high-dimensional data are clustered, the resulting clusters are high-dimensional geometrical objects, which are difficult to analyze and interpret. Cluster validity measures try to solve this problem by providing a single numerical value. As a low dimensional graphical representation of the clusters could be much more informative than such a single value, this paper proposes a new tool for the visualization of fuzzy clustering results. By using the basic properties of fuzzy clustering algorithms, this new tool maps the cluster centers and the data such that the distances between the clusters and the data-points are preserved. During the iterative mapping process, the algorithm uses the membership values of the data and minimizes an objective function similar to the original clustering algorithm. Comparing to the original Sammon mapping not only reliable cluster shapes are obtained but the numerical complexity of the algorithm is also drastically reduced. The developed tool has been applied for visualization of reconstructed phase space trajectories of chaotic systems. The case study demonstrates that proposed FUZZSAMM algorithm is a useful tool in user-guided clustering.

[1]  Caro Lucas,et al.  Model based method for estimating an attractor dimension from uni/multivariate chaotic time series with application to Bremen climatic dynamics , 2004 .

[2]  Its'hak Dinstein,et al.  On pattern classification with Sammon's nonlinear mapping an experimental study , 1998, Pattern Recognit..

[3]  Dimitris Kugiumtzis,et al.  Chaotic time series. Part II. System Identification and Prediction , 1994, chao-dyn/9401003.

[4]  L. Cao.  Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[5]  Y. Ashkenazy.  The use of generalized information dimension in measuring fractal dimension of time series , 1998, chao-dyn/9805001.

[6]  Hojjat Adeli,et al.  Fuzzy clustering approach for accurate embedding dimension identification in chaotic time series , 2003, Integr. Comput. Aided Eng..

[7]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[8]  Robert P. W. Duin,et al.  Sammon's mapping using neural networks: A comparison , 1997, Pattern Recognit. Lett..

[9]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[10]  Monika Hanesch,et al.  The application of fuzzy C-means cluster analysis and non-linear mapping to a soil data set for the detection of polluted sites , 2001 .

[11]  Nikhil R. Pal,et al.  Two efficient connectionist schemes for structure preserving dimensionality reduction , 1998, IEEE Trans. Neural Networks.

[12]  Martin Casdagli,et al.  Nonlinear prediction of chaotic time series , 1989 .

[13]  János Abonyi,et al.  State-space reconstruction and prediction of chaotic time series based on fuzzy clustering , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[14]  Anil K. Jain,et al.  Artificial neural networks for feature extraction and multivariate data projection , 1995, IEEE Trans. Neural Networks.

[15]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[16]  Kristian M. Lien,et al.  A new robust design model for gas separating membrane modules, based on analogy with counter-current heat exchangers , 1994 .

[17]  Frank Klawonn,et al.  Visual Inspection of Fuzzy Clustering Results , 2003 .

[18]  Béla G. Lakatos.  Stability and dynamics of continuous crystallizers , 1994 .

[19]  F. Takens.  Detecting strange attractors in turbulence , 1981 .