论文信息 - Some aspects of error bounds in feature selection

Some aspects of error bounds in feature selection

Abstract In this paper we discuss various bounds on the Bayesian probability of error, which are used for feature selection, and are based on distance measures and information measures. We show that they are basically of two types. One type can be related to the f -divergence, the other can be related to information measures. This also clarifies some properties of these measures for the two-class problem and for the multiclass problem. We give some general bounds on the Bayesian probability of error and discuss various aspects of the different approaches.

Dick E. Boekee | Jan C. A. van der Lubbe | D. Boekee | J. Lubbe

[1] T. Kailath. The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[2] Josef Kittler,et al. Mathematics Methods of Feature Selection in Pattern Recognition , 1975, Int. J. Man Mach. Stud..

[3] J. T. Chu,et al. Error Probability in Decision Functions for Character Recognition , 1967, JACM.

[4] Laveen N. Kanal,et al. Patterns in pattern recognition: 1968-1974 , 1974, IEEE Trans. Inf. Theory.

[5] Chi Hau Chen,et al. Statistical Pattern Recognition. , 1973 .

[6] Pierre A. Devijver,et al. On a New Class of Bounds on Bayes Risk in Multihypothesis Pattern Recognition , 1974, IEEE Transactions on Computers.

[7] I. Vajda. On thef-divergence and singularity of probability measures , 1972 .

[8] Demetrios G. Lainiotis,et al. A class of upper bounds on probability of error for multihypotheses pattern recognition (Corresp.) , 1969, IEEE Trans. Inf. Theory.

[9] C. H. Chen,et al. On information and distance measures, error bounds, and feature selection , 1976, Information Sciences.

[10] King-Sun Fu,et al. Error estimation in pattern recognition via LAlpha -distance between posterior density functions , 1976, IEEE Trans. Inf. Theory.