The performance of a new hybrid classifier based on boxes and nearest neighbors

In this paper we present a new type of binary classifier defined on the unit cube. This classifier combines some of the aspects of the standard methods that have been used in the logical analysis of data (LAD) and geometric classifiers, with a nearest-neighbor paradigm. We assess the predictive performance of the new classifier in learning from a sample, obtaining generalization error bounds that improve as the ‘sample width’ of the classifier increases.

[1]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[2]  Martin Anthony,et al.  Robust cutpoints in the logical analysis of numerical data , 2012, Discret. Appl. Math..

[3]  Peter L. Bartlett,et al.  The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network , 1998, IEEE Trans. Inf. Theory.

[4]  Peter L. Bartlett,et al.  Neural Network Learning - Theoretical Foundations , 1999 .

[5]  Y. Crama,et al.  Cause-effect relationships and partially defined Boolean functions , 1988 .

[6]  Martin Anthony,et al.  Maximal width learning of binary functions , 2010, Theor. Comput. Sci..

[7]  Sally A. Goldman,et al.  Computational Learning Theory , 2010, Lecture Notes in Computer Science.

[8]  Peter L. Bartlett,et al.  Function Learning from Interpolation , 1995, Combinatorics, Probability and Computing.

[9]  David Haussler,et al.  Learnability and the Vapnik-Chervonenkis dimension , 1989, JACM.

[10]  MuchnikIlya,et al.  An Implementation of Logical Analysis of Data , 2000 .

[11]  Paul W. Goldberg,et al.  Exact Learning of Discretized Geometric Concepts , 1998, SIAM J. Comput..

[12]  Toshihide Ibaraki,et al.  An Implementation of Logical Analysis of Data , 2000, IEEE Trans. Knowl. Data Eng..

[13]  Toshihide Ibaraki,et al.  Logical analysis of numerical data , 1997, Math. Program..

[14]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[15]  John Shawe-Taylor,et al.  Structural Risk Minimization Over Data-Dependent Hierarchies , 1998, IEEE Trans. Inf. Theory.