COMPARATIVE ANALYSIS OF TWO CLASSIFIERS IMPLEMENTING NOMINAL LOGISTIC REGRESSION

4 � ABSTRACT: There is a wide range of statistical classification methods described in the scientific literature. Each method presents advantages and disadvantages that depend mainly on the probabilistic behaviour of the classes. This article presents two methods of classification based on logistic regression and shows results obtained with three real data sets. The first method is a single-stage classifier based on Nominal Logistic Regression. The second method is a hierarchical classifier, structured like a binary decision tree that uses the traditional logistic regression at each stage. Both methods are compared with traditional classifiers and the results are discussed.

[1]  Denis A. de Oliveira Moraes,et al.  Estabilidade de Classificadores de Decisão em Árvore Binária para Dados Imagem em Alta Dimensão , 2008, RITA.

[2]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[3]  David G. Stork,et al.  Pattern Classification , 1973 .

[4]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[5]  J. A. Anderson,et al.  7 Logistic discrimination , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[6]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[7]  R. T. Clarke,et al.  Logistic discrimination between classes with nearly equal spectral response in high dimensionality , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[8]  B. Efron.  The Efficiency of Logistic Regression Compared to Normal Discriminant Analysis , 1975 .

[9]  Robin Thomas Clarke,et al.  Use of Logistic Discrimination to classify remotely-sensed digital images , 2002 .

[10]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[11]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Theofanis Sapatinas,et al.  Discriminant Analysis and Statistical Pattern Recognition , 2005 .

[13]  Olivier Y. de Vel,et al.  Comparative analysis of statistical pattern recognition methods in high dimensional settings , 1994, Pattern Recognit..

[14]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[15]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[16]  Pramod K. Varshney,et al.  Logistic Regression for Feature Selection and Soft Classification of Remote Sensing Data , 2006, IEEE Geoscience and Remote Sensing Letters.