Modeling multi-source remote sensing image classifier based on the MDL principle: Experimental studies

In classification of multi-source remote sensing image, it is usually difficult to obtain higher classification accuracy. In the previous work, the modeling technique for the remote sensing image classification based on the minimum description length (MDL) principle with mixture model is analyzed theoretically. In this work, experimental studies are performed for investigating the modeling technique. With intensive experiments and sophisticated analysis, it is found that the developed modeling technique can build a robust classification system, which can avoid classifier over-fitting training data and make the learning process trade-off between bias and variance. Meanwhile, designed mixture model is more efficient to represent real multi-source remote sensing images compared to single model.

[1]  Jorma Rissanen,et al.  The Minimum Description Length Principle in Coding and Modeling , 1998, IEEE Trans. Inf. Theory.

[2]  Frédéric Galland,et al.  Minimum description length synthetic aperture radar image segmentation , 2003, IEEE Trans. Image Process..

[3]  Ping Guo Spectral pattern recognition with regularized Gaussian classifier , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[4]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[5]  Henri Nicolas,et al.  Minimum description length criterion and segmentation map coding for region-based video compression , 2001, IEEE Trans. Circuits Syst. Video Technol..

[6]  Qian Yin,et al.  Modeling multisource remote sensing image classifier based on the MDL principle: Theoretical aspects , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[7]  Rik Pintelon,et al.  Modified AIC and MDL model selection criteria for short data records , 2004, IEEE Transactions on Instrumentation and Measurement.

[8]  Petar M. Djuric,et al.  Asymptotic MAP criteria for model selection , 1998, IEEE Trans. Signal Process..

[9]  Michael R. LyuDepartment,et al.  Classi cation for High-Dimension Small-Sample data Sets Based on Kullback-Leibler Information Measure , 2000 .

[10]  Yunde Jia,et al.  A study of regularized Gaussian classifier in high-dimension small sample set case based on MDL principle with application to spectrum recognition , 2008, Pattern Recognit..

[11]  Dean P. Foster,et al.  Local Asymptotic Coding and the Minimum Description Length , 1999, IEEE Trans. Inf. Theory.

[12]  Paul M. Mather,et al.  Classification of multisource remote sensing imagery using a genetic algorithm and Markov random fields , 1999, IEEE Trans. Geosci. Remote. Sens..

[13]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics (Revised Edition) , 1999 .

[14]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[15]  Barnali M. Dixon,et al.  Multispectral landuse classification using neural networks and support vector machines: one or the other, or both? , 2008 .

[16]  Ping Guo,et al.  Automated Separation of Stars and Normal Galaxies Based on Statistical Mixture Modeling with RBF Neural Networks , 2003 .

[17]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[18]  Craig B. Borkowf,et al.  Random Number Generation and Monte Carlo Methods , 2000, Technometrics.

[19]  Liu Li On Remote Sensing Image Classification Method Based on Improved BP Neural Network Model , 2009 .

[20]  Anil K. Jain,et al.  A Markov random field model for classification of multisource satellite imagery , 1996, IEEE Trans. Geosci. Remote. Sens..

[21]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[22]  Aleksandar Kavcic,et al.  The minimum description length principle for modeling recording channels , 2001, IEEE J. Sel. Areas Commun..

[23]  Johannes R. Sveinsson,et al.  Multiple classifiers applied to multisource remote sensing data , 2002, IEEE Trans. Geosci. Remote. Sens..

[24]  Narasimhan Sundararajan,et al.  A sequential multi-category classifier using radial basis function networks , 2008, Neurocomputing.