Dynamic pattern denoising method using multi-basin system with kernels

In this paper, we propose a novel pattern denoising method that utilizes the topological property of a support that describes the distribution of normal patterns to denoise noisy patterns. The method first trains a support function which captures the domain of normal patterns and then construct a so-called multi-basin system associated with the trained support function. By moving noisy patterns along the trajectories of the multi-basin system, noise is removed while the pattern recovers its normality. The denoised pattern is obtained when the noisy pattern arrives at the attracting manifold generated by a set of normal patterns and this is the most similar normal pattern with the noisy pattern in the topological sense. Through simulations on some toy dataset and real image datasets, we show that the proposed framework effectively removes the noise while preserving the information contained in the noisy pattern.

[1]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[2]  Francesco Camastra,et al.  A Novel Kernel Method for Clustering , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Robert P. W. Duin,et al.  On Combining One-Class Classifiers for Image Database Retrieval , 2002, Multiple Classifier Systems.

[4]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[5]  Daewon Lee,et al.  An improved cluster labeling method for support vector clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Daewon Lee,et al.  Constructing Sparse Kernel Machines Using Attractors , 2009, IEEE Transactions on Neural Networks.

[7]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[8]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[9]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[10]  Daewon Lee,et al.  Equilibrium-Based Support Vector Machine for Semisupervised Classification , 2007, IEEE Transactions on Neural Networks.

[11]  Hsiao-Dong Chiang,et al.  Theory of stability regions for a class of nonhyperbolic dynamical systems and its application to constraint satisfaction problems , 2002 .

[12]  Jianhua Yang,et al.  Support vector clustering through proximity graph modelling , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[13]  Francesco Camastra,et al.  Offline Cursive Character Challenge: a New Benchmark for Machine Learning and Pattern Recognition Algorithms. , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  J. Morel,et al.  On image denoising methods , 2004 .

[15]  Daewon Lee,et al.  Fast support-based clustering method for large-scale problems , 2010, Pattern Recognit..

[16]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[17]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Seiji Yamada,et al.  Non-Relevance Feedback Document Retrieval based on One Class SVM and SVDD , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[19]  Ivor W. Tsang,et al.  SVDD-Based Pattern Denoising , 2007, Neural Computation.

[20]  Ivor W. Tsang,et al.  The pre-image problem in kernel methods , 2003, IEEE Transactions on Neural Networks.

[21]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[22]  Daewon Lee,et al.  Dynamic Characterization of Cluster Structures for Robust and Inductive Support Vector Clustering , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Francesco Camastra,et al.  A SVM-based cursive character recognizer , 2007, Pattern Recognit..

[25]  Rakhi C. Motwani,et al.  Survey of Image Denoising Techniques , 2004 .

[26]  Jaewook Lee,et al.  Clustering Based on Gaussian Processes , 2007, Neural Computation.

[27]  Daewon Lee,et al.  Domain described support vector classifier for multi-classification problems , 2007, Pattern Recognit..

[28]  Daewon Lee,et al.  Dynamic Dissimilarity Measure for Support-Based Clustering , 2010, IEEE Transactions on Knowledge and Data Engineering.

[29]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.