A new multiresolution classification model based on partitioning of feature space

Multiresolution analysis is a hot topic in the past decade. In this paper, we propose a new multiresolution classification method which adopts a coarse-to-fine strategy both during the training and the testing processes based on decomposing of the feature space. The training algorithm locates the boundary between two classes from coarse to fine by dividing the hypercubes which lie on the boundary step by step. The testing algorithm firstly labels the testing data set by the classifier trained at initial resolution. Then, only those lying on the boundary are labeled at the finer resolution. As an example, an approach named MRSVC is proposed, which exploits support vector machines as the basic classifier. Finally, theoretical analysis and experimental results have substantiated the effectiveness of the proposed method.

[1]  Robert Haimes,et al.  Multiscale and Multiresolution Methods , 2002 .

[2]  Lai-Wan Chan,et al.  Transformation of back-propagation networks in multiresolution learning , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[3]  David G. Stork,et al.  Pattern Classification , 1973 .

[4]  Bo Zhang,et al.  The Quotient Space Theory of Problem Solving , 2003, Fundam. Informaticae.

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Ilva Blayvas,et al.  Machine Learning via multiresolution approximation , 2003 .

[7]  Sameer Singh,et al.  Multiresolution Estimates of Classification Complexity , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[9]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[10]  Witold Pedrycz,et al.  Granular computing: an introduction , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[11]  Vladimir Cherkassky,et al.  Multi-resolution support vector machine , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[12]  Armin Iske,et al.  Multiresolution Methods in Scattered Data Modelling , 2004, Lecture Notes in Computational Science and Engineering.

[13]  Yao Liang,et al.  Multiresolution learning paradigm and signal prediction , 1997, IEEE Trans. Signal Process..

[14]  Michael Griebel,et al.  Data Mining with Sparse Grids , 2001, Computing.

[15]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[16]  Yiyu Yao,et al.  A Partition Model of Granular Computing , 2004, Trans. Rough Sets.

[17]  Jiawei Han,et al.  Classifying large data sets using SVMs with hierarchical clusters , 2003, KDD '03.