Bayesian approach, theory of empirical risk minimization. Comparative analysis

Error estimates of empirical-risk minimization methods for an infinite number of decision rules are analyzed. Optimal deterministic estimates of the error of the Bayesian classification procedure for independent features are obtained based on averaging over a great number of training samples as a control. For the Boolean case, the Bayesian procedure is equivalent to a classification procedure based on a separating hyperplane.