A more efficient branch and bound algorithm for feature selection

Abstract An algorithm is presented to be able to select the globally optimal subset of d features from a larger D -feature set. This is a fundamental problem in statistical pattern recognition and combinatorial optimization. Exhaustive enumeration is computationally unfeasible in most applications. This algorithm dynamically searches for the globally optimal solution on a minimum solution tree which is a subtree of the solution tree used in the traditional branch and bound algorithm. The new algorithm is compared theoretically with the branch and bound algorithm. The analysis and the experimental results show that it is more efficient than the traditional algorithm.

[1]  J. Kittler,et al.  Feature Set Search Alborithms , 1978 .

[2]  Keinosuke Fukunaga,et al.  A Branch and Bound Algorithm for Feature Subset Selection , 1977, IEEE Transactions on Computers.

[3]  C. Chang Dynamic programming as applied to feature subset selection in a pattern recognition system , 1972, ACM Annual Conference.

[4]  Jan M. Van Campenhout,et al.  On the Possible Orderings in the Measurement Selection Problem , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  Anthony N. Mucciardi,et al.  A Comparison of Seven Techniques for Choosing Subsets of Pattern Recognition Properties , 1971, IEEE Transactions on Computers.

[6]  Thomas M. Cover,et al.  The Best Two Independent Measurements Are Not the Two Best , 1974, IEEE Trans. Syst. Man Cybern..

[7]  Baozong Yuan,et al.  A feature selection method for multi-class-set classification , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.