Feature selection based on the approximation of class densities by finite mixtures of special type

Abstract A new method of feature selection based on the approximation of class conditional densities by a mixture of parameterized densities of a special type, suitable especially for multimodal data, is presented. No search procedure is needed when using the proposed method. Its performance is tested both on real simulated data.

[1]  Josef Kittler,et al.  A new approach to feature selection based on the Karhunen-Loeve expansion , 1973, Pattern Recognit..

[2]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[3]  Anil K. Jain.  Advances in statistical pattern recognition , 1987 .

[4]  P Pudil,et al.  Simultaneous learning of decision rules and important attributes for classification problems in image analysis , 1994, Image Vis. Comput..

[5]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[6]  H. Walker,et al.  An iterative procedure for obtaining maximum-likelihood estimates of the parameters for a mixture of normal distributions , 1978 .

[7]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[8]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[9]  Michael C. Fairhurst,et al.  On the Use of I-Divergence for Generating Distribution Approximations , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  David J. Hand,et al.  Discrimination and Classification , 1982 .

[11]  J. Wolfe.  PATTERN CLUSTERING BY MULTIVARIATE MIXTURE ANALYSIS. , 1970, Multivariate behavioral research.

[12]  Edward B. Fowlkes,et al.  Some Methods for Studying the Mixture of Two Normal (Lognormal) Distributions , 1979 .

[13]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[14]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[15]  Nils Lid Hjort.  Discussion: On the Consistency of Bayes Estimates , 1986 .

[16]  Jirí Grim,et al.  On numerical evaluation of maximum-likelihood estimates for finite mixtures of distributions , 1982, Kybernetika.

[17]  Solomon Kullback,et al.  Approximating discrete probability distributions , 1969, IEEE Trans. Inf. Theory.

[18]  V. Hasselblad.  Estimation of parameters for a mixture of normal distributions , 1966 .

[19]  Jirí Grim,et al.  Multivariate statistical pattern recognition with nonreduced dimensionality , 1986, Kybernetika.

[20]  N. E. Day.  Estimating the components of a mixture of normal distributions , 1969 .

[21]  B. Everitt.  A Monte Carlo Investigation Of The Likelihood Ratio Test For The Number Of Components In A Mixture Of Normal Distributions. , 1981, Multivariate behavioral research.

[22]  D. C. Bowden,et al.  MAXIMUM LIKELIHOOD ESTIMATION FOR MIXTURES OF TWO NORMAL DISTRIBUTIONS , 1973 .