The Need for Biases in Learning Generalizations

Learning involves the ability to generalize from past experience in order to deal with new situations that are ”related to” this experience. The inductive leaap needed to deal with new situations seems to be possible only under certain biases for choosing one generalization of the situation over another. This paper defines precisely the notion of bias in generalization problems, then shows that biases are necessary for the inductive leap. Classes of justifiable biases are considered, and the relationship between bias and domain-independence is considered. We restrict the scope of this discussion to the problem of generalizing from training instances, defined as follows: The Generalization Problem Given: